2024-04-19T23:31:29.724 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-19T23:31:29.724 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048 --name teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048/orig.config.yaml 2024-04-19T23:31:29.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T23:31:29.900 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048 branch: reef description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7664048' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: reef ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d wait-for-scrub: false ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d rgw: ec-data-pool: false frontend: beast selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 3659 sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d targets: smithi076.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRptpndLYEzhdJmHrZ9esJiHwvX+0JjAO45LptEvxYn5u31WXUtMCLBzJV3A0knPgPSMhKJ942reozY20A+v10= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO752E6jmqlwthNe6iKcmg0mYKrZeARbTBH2mFvUnNsiCFJmUEPw2JTjXujkUQbtae84l2rwn++hCrzYulPLtz8= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-19_22:40:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-19T23:31:29.900 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa; will attempt to use it 2024-04-19T23:31:29.901 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa/tasks 2024-04-19T23:31:29.901 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-19T23:31:29.903 INFO:teuthology.task.internal:Checking packages... 2024-04-19T23:31:29.951 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '646b8c7d293d8ec31a40c69f7b3237b19c1be24d' 2024-04-19T23:31:29.952 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-19T23:31:29.952 INFO:teuthology.packaging:ref: None 2024-04-19T23:31:29.952 INFO:teuthology.packaging:tag: None 2024-04-19T23:31:29.952 INFO:teuthology.packaging:branch: reef 2024-04-19T23:31:29.952 INFO:teuthology.packaging:sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T23:31:29.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-19T23:31:30.189 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-0 2024-04-19T23:31:30.191 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-19T23:31:30.198 INFO:teuthology.task.internal:no buildpackages task found 2024-04-19T23:31:30.198 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-19T23:31:30.270 INFO:teuthology.task.internal:Saving configuration 2024-04-19T23:31:30.284 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-19T23:31:30.291 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-19T23:31:30.305 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 23:26:06.347497', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRptpndLYEzhdJmHrZ9esJiHwvX+0JjAO45LptEvxYn5u31WXUtMCLBzJV3A0knPgPSMhKJ942reozY20A+v10='} 2024-04-19T23:31:30.322 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 23:26:06.349535', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO752E6jmqlwthNe6iKcmg0mYKrZeARbTBH2mFvUnNsiCFJmUEPw2JTjXujkUQbtae84l2rwn++hCrzYulPLtz8='} 2024-04-19T23:31:30.322 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-19T23:31:30.329 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-04-19T23:31:30.329 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-19T23:31:30.329 INFO:teuthology.run_tasks:Running task console_log... 2024-04-19T23:31:30.392 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f97f514d3a0>, signals=[15]) 2024-04-19T23:31:30.393 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-19T23:31:30.399 INFO:teuthology.task.internal:Opening connections... 2024-04-19T23:31:30.399 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi076.front.sepia.ceph.com 2024-04-19T23:31:30.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T23:31:30.474 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-04-19T23:31:30.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T23:31:30.550 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-19T23:31:30.557 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-04-19T23:31:30.579 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-04-19T23:31:30.579 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-04-19T23:31:30.640 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-04-19T23:31:30.640 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8" 2024-04-19T23:31:30.640 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-04-19T23:31:30.640 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-04-19T23:31:30.640 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8" 2024-04-19T23:31:30.640 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2024-04-19T23:31:30.640 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-19T23:31:30.640 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-04-19T23:31:30.640 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-19T23:31:30.640 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-04-19T23:31:30.640 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T23:31:30.641 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-19T23:31:30.641 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T23:31:30.641 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-04-19T23:31:30.665 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-04-19T23:31:30.687 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-04-19T23:31:30.688 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-04-19T23:31:30.749 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-04-19T23:31:30.749 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8" 2024-04-19T23:31:30.749 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-04-19T23:31:30.750 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-04-19T23:31:30.750 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8" 2024-04-19T23:31:30.750 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2024-04-19T23:31:30.750 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-19T23:31:30.750 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-04-19T23:31:30.750 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-19T23:31:30.750 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-04-19T23:31:30.750 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T23:31:30.750 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-19T23:31:30.751 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T23:31:30.751 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-04-19T23:31:30.773 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-19T23:31:30.782 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-19T23:31:30.788 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-19T23:31:30.788 DEBUG:teuthology.orchestra.run.smithi076:> test '!' -e /home/ubuntu/cephtest 2024-04-19T23:31:30.791 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-04-19T23:31:30.812 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-19T23:31:30.820 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-19T23:31:30.820 DEBUG:teuthology.orchestra.run.smithi076:> test -z $(ls -A /var/lib/ceph) 2024-04-19T23:31:30.853 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-04-19T23:31:30.883 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-19T23:31:30.952 INFO:teuthology.run_tasks:Running task kernel... 2024-04-19T23:31:30.967 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-19T23:31:30.967 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-19T23:31:30.967 DEBUG:teuthology.orchestra.run.smithi076:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T23:31:30.968 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T23:31:30.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T23:31:30.988 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2024-04-19T23:31:30.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T23:31:30.989 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-04-19T23:31:31.049 INFO:teuthology.orchestra.run.smithi076.stdout:4.18.0-489.el8.x86_64 2024-04-19T23:31:31.049 INFO:teuthology.task.kernel:Running kernel on smithi076: 4.18.0-489.el8.x86_64 2024-04-19T23:31:31.049 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum install -y kernel 2024-04-19T23:31:31.051 INFO:teuthology.orchestra.run.smithi155.stdout:4.18.0-489.el8.x86_64 2024-04-19T23:31:31.051 INFO:teuthology.task.kernel:Running kernel on smithi155: 4.18.0-489.el8.x86_64 2024-04-19T23:31:31.051 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum install -y kernel 2024-04-19T23:31:36.312 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - AppStream 10 MB/s | 28 MB 00:02 2024-04-19T23:31:37.017 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 8 - AppStream 8.8 MB/s | 28 MB 00:03 2024-04-19T23:31:42.046 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 10 MB 00:00 2024-04-19T23:31:42.939 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 10 MB 00:00 2024-04-19T23:31:44.038 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2024-04-19T23:31:44.538 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 7.7 kB 00:00 2024-04-19T23:31:44.932 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2024-04-19T23:31:45.018 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 8 - Extras 37 kB/s | 18 kB 00:00 2024-04-19T23:31:45.660 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 7.7 kB 00:00 2024-04-19T23:31:46.062 INFO:teuthology.orchestra.run.smithi076.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2024-04-19T23:31:47.790 INFO:teuthology.orchestra.run.smithi076.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 16 MB 00:01 2024-04-19T23:31:51.505 INFO:teuthology.orchestra.run.smithi076.stdout:lab-extras 653 kB/s | 24 kB 00:00 2024-04-19T23:31:54.619 INFO:teuthology.orchestra.run.smithi076.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-19T23:31:54.619 INFO:teuthology.orchestra.run.smithi076.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-19T23:31:54.729 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:31:54.730 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:31:54.730 INFO:teuthology.orchestra.run.smithi076.stdout: Package Architecture Version Repository Size 2024-04-19T23:31:54.730 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:31:54.730 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:31:54.730 INFO:teuthology.orchestra.run.smithi076.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-19T23:31:54.730 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-04-19T23:31:54.730 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-19T23:31:54.730 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-19T23:31:54.730 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:31:54.731 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:31:54.731 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:31:54.731 INFO:teuthology.orchestra.run.smithi076.stdout:Install 3 Packages 2024-04-19T23:31:54.731 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:31:54.731 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 90 M 2024-04-19T23:31:54.731 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 96 M 2024-04-19T23:31:54.732 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:31:55.490 INFO:teuthology.orchestra.run.smithi076.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 18 MB/s | 10 MB 00:00 2024-04-19T23:31:56.599 INFO:teuthology.orchestra.run.smithi076.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 22 MB/s | 36 MB 00:01 2024-04-19T23:31:57.096 INFO:teuthology.orchestra.run.smithi076.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 20 MB/s | 44 MB 00:02 2024-04-19T23:31:57.096 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:31:57.096 INFO:teuthology.orchestra.run.smithi076.stdout:Total 38 MB/s | 90 MB 00:02 2024-04-19T23:31:57.781 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:31:58.226 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:31:58.226 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:31:59.463 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:31:59.488 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:32:01.450 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 16 MB 00:16 2024-04-19T23:32:02.262 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:32:02.877 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T23:32:05.241 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 453 kB/s | 24 kB 00:00 2024-04-19T23:32:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T23:32:06.852 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T23:32:08.277 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-19T23:32:08.277 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-19T23:32:08.403 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:32:08.403 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:32:08.403 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2024-04-19T23:32:08.404 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:32:08.404 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:32:08.404 INFO:teuthology.orchestra.run.smithi155.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-19T23:32:08.404 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-19T23:32:08.404 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-19T23:32:08.405 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-19T23:32:08.405 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:32:08.405 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:32:08.405 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:32:08.405 INFO:teuthology.orchestra.run.smithi155.stdout:Install 3 Packages 2024-04-19T23:32:08.405 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:32:08.406 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 90 M 2024-04-19T23:32:08.406 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 96 M 2024-04-19T23:32:08.406 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:32:09.015 INFO:teuthology.orchestra.run.smithi155.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 19 MB/s | 10 MB 00:00 2024-04-19T23:32:10.015 INFO:teuthology.orchestra.run.smithi155.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 23 MB/s | 36 MB 00:01 2024-04-19T23:32:10.290 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T23:32:10.415 INFO:teuthology.orchestra.run.smithi155.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 22 MB/s | 44 MB 00:01 2024-04-19T23:32:10.415 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:32:10.415 INFO:teuthology.orchestra.run.smithi155.stdout:Total 45 MB/s | 90 MB 00:02 2024-04-19T23:32:10.576 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T23:32:11.101 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:32:11.678 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:32:11.678 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:32:12.923 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:32:12.943 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:32:15.755 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:32:16.273 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T23:32:19.816 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-19T23:32:20.231 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T23:32:23.666 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-19T23:32:23.956 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T23:32:32.498 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-19T23:32:32.521 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T23:32:32.862 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T23:32:32.863 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-19T23:32:32.863 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-19T23:32:33.356 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T23:32:33.356 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:32:33.356 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:32:33.356 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-19T23:32:33.357 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-19T23:32:33.357 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:32:33.357 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:32:33.499 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T23:32:33.760 INFO:teuthology.orchestra.run.smithi076.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T23:32:33.760 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T23:32:33.760 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-19T23:32:33.760 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T23:32:33.761 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T23:32:33.761 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-19T23:32:33.761 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi076.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T23:32:33.761 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T23:32:33.971 INFO:teuthology.orchestra.run.smithi076.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T23:32:33.971 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T23:32:33.971 DEBUG:teuthology.orchestra.run.smithi076:> sudo rpm -qi grub2-tools 2024-04-19T23:32:34.005 INFO:teuthology.orchestra.run.smithi076.stdout:Name : grub2-tools 2024-04-19T23:32:34.005 INFO:teuthology.orchestra.run.smithi076.stdout:Epoch : 1 2024-04-19T23:32:34.005 INFO:teuthology.orchestra.run.smithi076.stdout:Version : 2.02 2024-04-19T23:32:34.005 INFO:teuthology.orchestra.run.smithi076.stdout:Release : 129.el8 2024-04-19T23:32:34.005 INFO:teuthology.orchestra.run.smithi076.stdout:Architecture: x86_64 2024-04-19T23:32:34.005 INFO:teuthology.orchestra.run.smithi076.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-19T23:32:34.005 INFO:teuthology.orchestra.run.smithi076.stdout:Group : System Environment/Base 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:Size : 9265586 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:License : GPLv3+ 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:Relocations : (not relocatable) 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:Packager : CentOS BuildSystem 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:Vendor : CentOS 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:Summary : Support tools for GRUB. 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:Description : 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-19T23:32:34.006 INFO:teuthology.orchestra.run.smithi076.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-19T23:32:34.007 INFO:teuthology.orchestra.run.smithi076.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-19T23:32:34.007 INFO:teuthology.orchestra.run.smithi076.stdout:hardware devices. 2024-04-19T23:32:34.007 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:32:34.007 INFO:teuthology.orchestra.run.smithi076.stdout:This subpackage provides tools for support of all platforms. 2024-04-19T23:32:34.008 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-19T23:32:34.008 INFO:teuthology.task.kernel:Updating grub on smithi076 to boot 4.18.0-552.el8.x86_64 2024-04-19T23:32:34.008 DEBUG:teuthology.orchestra.run.smithi076:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-19T23:32:35.789 INFO:teuthology.orchestra.run.smithi076.stderr:Generating grub configuration file ... 2024-04-19T23:32:38.047 INFO:teuthology.orchestra.run.smithi076.stderr:done 2024-04-19T23:32:38.049 DEBUG:teuthology.orchestra.run.smithi076:> mktemp 2024-04-19T23:32:38.077 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/tmp.0Dm69ItNSC 2024-04-19T23:32:38.077 DEBUG:teuthology.orchestra.run.smithi076:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0Dm69ItNSC 2024-04-19T23:32:38.153 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0666 /tmp/tmp.0Dm69ItNSC 2024-04-19T23:32:38.292 DEBUG:teuthology.orchestra.remote:smithi076:/tmp/tmp.0Dm69ItNSC is 6KB 2024-04-19T23:32:38.340 DEBUG:teuthology.orchestra.run.smithi076:> rm -fr /tmp/tmp.0Dm69ItNSC 2024-04-19T23:32:38.358 DEBUG:teuthology.orchestra.run.smithi076:> sudo /bin/ls /boot/loader/entries || true 2024-04-19T23:32:38.441 INFO:teuthology.orchestra.run.smithi076.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-19T23:32:38.441 INFO:teuthology.orchestra.run.smithi076.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-19T23:32:38.441 INFO:teuthology.orchestra.run.smithi076.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-19T23:32:38.442 INFO:teuthology.orchestra.run.smithi076.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-19T23:32:38.444 DEBUG:teuthology.orchestra.run.smithi076:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-19T23:32:38.598 DEBUG:teuthology.orchestra.run.smithi076:> sudo shutdown -r now 2024-04-19T23:32:45.813 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-19T23:32:45.838 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T23:32:46.191 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-19T23:32:46.191 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-19T23:32:46.191 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-19T23:32:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-19T23:32:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:32:46.647 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:32:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-19T23:32:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-19T23:32:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:32:46.647 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:32:46.780 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T23:32:47.004 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T23:32:47.004 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T23:32:47.004 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-19T23:32:47.004 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T23:32:47.004 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T23:32:47.004 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-04-19T23:32:47.005 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T23:32:47.005 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T23:32:47.216 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-19T23:32:47.216 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-19T23:32:47.217 DEBUG:teuthology.orchestra.run.smithi155:> sudo rpm -qi grub2-tools 2024-04-19T23:32:47.250 INFO:teuthology.orchestra.run.smithi155.stdout:Name : grub2-tools 2024-04-19T23:32:47.250 INFO:teuthology.orchestra.run.smithi155.stdout:Epoch : 1 2024-04-19T23:32:47.250 INFO:teuthology.orchestra.run.smithi155.stdout:Version : 2.02 2024-04-19T23:32:47.250 INFO:teuthology.orchestra.run.smithi155.stdout:Release : 129.el8 2024-04-19T23:32:47.250 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: x86_64 2024-04-19T23:32:47.250 INFO:teuthology.orchestra.run.smithi155.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-19T23:32:47.250 INFO:teuthology.orchestra.run.smithi155.stdout:Group : System Environment/Base 2024-04-19T23:32:47.250 INFO:teuthology.orchestra.run.smithi155.stdout:Size : 9265586 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:License : GPLv3+ 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:Relocations : (not relocatable) 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:Packager : CentOS BuildSystem 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:Vendor : CentOS 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:Summary : Support tools for GRUB. 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:Description : 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-19T23:32:47.251 INFO:teuthology.orchestra.run.smithi155.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-19T23:32:47.252 INFO:teuthology.orchestra.run.smithi155.stdout:hardware devices. 2024-04-19T23:32:47.252 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:32:47.252 INFO:teuthology.orchestra.run.smithi155.stdout:This subpackage provides tools for support of all platforms. 2024-04-19T23:32:47.253 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-19T23:32:47.253 INFO:teuthology.task.kernel:Updating grub on smithi155 to boot 4.18.0-552.el8.x86_64 2024-04-19T23:32:47.253 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-19T23:32:49.035 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2024-04-19T23:32:51.240 INFO:teuthology.orchestra.run.smithi155.stderr:done 2024-04-19T23:32:51.242 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-04-19T23:32:51.270 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.HhaCFflFqf 2024-04-19T23:32:51.270 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HhaCFflFqf 2024-04-19T23:32:51.343 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.HhaCFflFqf 2024-04-19T23:32:51.490 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.HhaCFflFqf is 6KB 2024-04-19T23:32:51.539 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.HhaCFflFqf 2024-04-19T23:32:51.556 DEBUG:teuthology.orchestra.run.smithi155:> sudo /bin/ls /boot/loader/entries || true 2024-04-19T23:32:51.627 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-19T23:32:51.627 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-19T23:32:51.627 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-19T23:32:51.627 INFO:teuthology.orchestra.run.smithi155.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-19T23:32:51.628 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-19T23:32:51.778 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2024-04-19T23:33:08.618 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-19T23:33:08.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-04-19T23:33:08.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T23:33:21.790 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-04-19T23:33:21.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-19T23:33:21.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T23:33:43.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-04-19T23:33:52.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-04-19T23:33:52.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T23:33:56.386 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-04-19T23:34:05.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-19T23:34:05.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T23:34:23.775 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-04-19T23:34:35.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-19T23:34:35.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T23:34:37.630 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-04-19T23:34:38.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-19T23:34:38.015 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "4.18.0-552.el8.x86_64"... 2024-04-19T23:34:38.015 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-04-19T23:34:38.034 INFO:teuthology.orchestra.run.smithi155.stdout:4.18.0-552.el8.x86_64 2024-04-19T23:34:38.035 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-19T23:34:38.035 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T23:34:38.035 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-19T23:34:39.036 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-19T23:34:39.037 DEBUG:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T23:34:39.117 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2024-04-19T23:34:39.132 DEBUG:teuthology.parallel:result is None 2024-04-19T23:34:52.081 DEBUG:teuthology.orchestra.remote:timed out 2024-04-19T23:35:04.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-04-19T23:35:04.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T23:35:04.450 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-04-19T23:35:04.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-04-19T23:35:04.748 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-552.el8.x86_64"... 2024-04-19T23:35:04.748 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2024-04-19T23:35:04.769 INFO:teuthology.orchestra.run.smithi076.stdout:4.18.0-552.el8.x86_64 2024-04-19T23:35:04.769 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-19T23:35:04.769 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T23:35:04.769 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-19T23:35:05.770 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-19T23:35:05.771 DEBUG:teuthology.orchestra.run.smithi076:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T23:35:05.841 INFO:teuthology.orchestra.run.smithi076.stdout:ttyS1 2024-04-19T23:35:05.870 DEBUG:teuthology.parallel:result is None 2024-04-19T23:35:05.871 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-19T23:35:05.877 INFO:teuthology.task.internal:Creating test directory... 2024-04-19T23:35:05.878 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T23:35:05.880 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T23:35:05.905 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-19T23:35:05.911 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-19T23:35:05.921 INFO:teuthology.task.internal:Creating archive directory... 2024-04-19T23:35:05.921 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T23:35:05.939 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T23:35:05.983 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-19T23:35:05.989 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-19T23:35:05.990 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T23:35:06.018 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T23:35:06.052 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T23:35:06.062 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T23:35:06.065 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T23:35:06.076 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T23:35:06.078 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-19T23:35:06.085 INFO:teuthology.task.internal:Configuring sudo... 2024-04-19T23:35:06.085 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T23:35:06.106 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T23:35:06.136 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-19T23:35:06.145 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-19T23:35:06.146 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T23:35:06.174 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T23:35:06.196 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T23:35:06.268 DEBUG:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T23:35:06.320 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T23:35:06.404 DEBUG:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T23:35:06.448 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:35:06.448 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T23:35:06.515 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T23:35:06.559 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T23:35:06.620 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T23:35:06.707 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T23:35:06.751 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:35:06.751 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T23:35:06.819 DEBUG:teuthology.orchestra.run.smithi076:> sudo service rsyslog restart 2024-04-19T23:35:06.821 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-04-19T23:35:06.886 INFO:teuthology.orchestra.run.smithi076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T23:35:06.926 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T23:35:07.396 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-19T23:35:07.404 INFO:teuthology.task.internal:Starting timer... 2024-04-19T23:35:07.404 INFO:teuthology.run_tasks:Running task pcp... 2024-04-19T23:35:07.413 INFO:teuthology.run_tasks:Running task selinux... 2024-04-19T23:35:07.420 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-19T23:35:07.421 DEBUG:teuthology.orchestra.run.smithi076:> sudo service auditd rotate 2024-04-19T23:35:07.495 INFO:teuthology.orchestra.run.smithi076.stdout:Rotating logs: 2024-04-19T23:35:07.497 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2024-04-19T23:35:07.580 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2024-04-19T23:35:07.581 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-19T23:35:07.582 DEBUG:teuthology.orchestra.run.smithi076:> /usr/sbin/getenforce 2024-04-19T23:35:07.631 INFO:teuthology.orchestra.run.smithi076.stdout:Permissive 2024-04-19T23:35:07.632 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2024-04-19T23:35:07.685 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2024-04-19T23:35:07.685 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi076.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive'} 2024-04-19T23:35:07.686 DEBUG:teuthology.orchestra.run.smithi076:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T23:35:07.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T23:35:07.714 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T23:35:07.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T23:35:07.744 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-19T23:35:07.744 DEBUG:teuthology.orchestra.run.smithi076:> sudo /usr/sbin/setenforce permissive 2024-04-19T23:35:07.780 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2024-04-19T23:35:07.812 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-19T23:35:07.821 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-19T23:35:07.838 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-19T23:35:07.840 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi076.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-19T23:41:02.312 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi076.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2024-04-19T23:41:02.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-04-19T23:41:02.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T23:41:02.428 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-04-19T23:41:02.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-04-19T23:41:02.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-19T23:41:02.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T23:41:02.599 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-04-19T23:41:02.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-19T23:41:02.669 INFO:teuthology.run_tasks:Running task clock... 2024-04-19T23:41:02.679 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-19T23:41:02.679 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T23:41:02.680 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T23:41:02.682 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T23:41:02.682 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T23:41:02.711 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-19T23:41:02.725 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-19T23:41:02.740 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-19T23:41:02.753 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-19T23:41:02.796 INFO:teuthology.orchestra.run.smithi076.stderr:sudo: ntpd: command not found 2024-04-19T23:41:02.806 INFO:teuthology.orchestra.run.smithi076.stdout:506 Cannot talk to daemon 2024-04-19T23:41:02.819 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-19T23:41:02.823 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2024-04-19T23:41:02.833 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-19T23:41:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2024-04-19T23:41:02.847 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-19T23:41:02.860 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-19T23:41:02.900 INFO:teuthology.orchestra.run.smithi076.stderr:bash: ntpq: command not found 2024-04-19T23:41:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T23:41:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:=============================================================================== 2024-04-19T23:41:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T23:41:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T23:41:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T23:41:02.904 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T23:41:02.919 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2024-04-19T23:41:02.923 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T23:41:02.923 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-04-19T23:41:02.923 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T23:41:02.923 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T23:41:02.923 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T23:41:02.923 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T23:41:02.924 INFO:teuthology.run_tasks:Running task install... 2024-04-19T23:41:02.932 DEBUG:teuthology.task.install:project ceph 2024-04-19T23:41:02.932 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}} 2024-04-19T23:41:02.932 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'} 2024-04-19T23:41:02.932 INFO:teuthology.task.install:Using flavor: default 2024-04-19T23:41:02.938 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-19T23:41:02.938 INFO:teuthology.task.install:extra packages: [] 2024-04-19T23:41:02.939 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'tag': None, 'wait_for_package': False} 2024-04-19T23:41:02.939 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T23:41:02.941 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'tag': None, 'wait_for_package': False} 2024-04-19T23:41:02.941 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T23:41:03.125 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/ 2024-04-19T23:41:03.125 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1237.g646b8c7d 2024-04-19T23:41:03.156 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/ 2024-04-19T23:41:03.156 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1237.g646b8c7d 2024-04-19T23:41:03.272 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-19T23:41:03.272 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:41:03.273 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-19T23:41:03.300 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-19T23:41:03.301 DEBUG:teuthology.orchestra.run.smithi076:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-19T23:41:03.340 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-19T23:41:03.340 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:41:03.340 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-19T23:41:03.368 DEBUG:teuthology.orchestra.run.smithi076:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-19T23:41:03.369 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-19T23:41:03.369 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-19T23:41:03.439 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-19T23:41:03.445 DEBUG:teuthology.orchestra.run.smithi076:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-19T23:41:03.511 INFO:teuthology.orchestra.run.smithi076.stdout:check_obsoletes = 1 2024-04-19T23:41:03.512 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum clean all 2024-04-19T23:41:03.516 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-19T23:41:03.582 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2024-04-19T23:41:03.583 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2024-04-19T23:41:03.787 INFO:teuthology.orchestra.run.smithi076.stdout:78 files removed 2024-04-19T23:41:03.817 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-radosgw 2024-04-19T23:41:03.855 INFO:teuthology.orchestra.run.smithi155.stdout:78 files removed 2024-04-19T23:41:03.883 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw 2024-04-19T23:41:04.945 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 124 kB/s | 80 kB 00:00 2024-04-19T23:41:05.010 INFO:teuthology.orchestra.run.smithi076.stdout:ceph packages for x86_64 102 kB/s | 80 kB 00:00 2024-04-19T23:41:05.387 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 28 kB/s | 11 kB 00:00 2024-04-19T23:41:05.411 INFO:teuthology.orchestra.run.smithi076.stdout:ceph noarch packages 31 kB/s | 11 kB 00:00 2024-04-19T23:41:05.711 INFO:teuthology.orchestra.run.smithi076.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2024-04-19T23:41:05.746 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2024-04-19T23:41:09.554 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - AppStream 7.4 MB/s | 28 MB 00:03 2024-04-19T23:41:09.786 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 8 - AppStream 6.9 MB/s | 28 MB 00:04 2024-04-19T23:41:15.696 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - BaseOS 8.8 MB/s | 10 MB 00:01 2024-04-19T23:41:16.031 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 8 - BaseOS 9.1 MB/s | 10 MB 00:01 2024-04-19T23:41:17.837 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 8 - Extras 84 kB/s | 18 kB 00:00 2024-04-19T23:41:17.888 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras 30 kB/s | 18 kB 00:00 2024-04-19T23:41:18.230 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 8 - Extras common packages 27 kB/s | 7.7 kB 00:00 2024-04-19T23:41:18.598 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 8 - PowerTools 18 MB/s | 5.0 MB 00:00 2024-04-19T23:41:18.689 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 7.7 kB 00:00 2024-04-19T23:41:19.399 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 8 - PowerTools 8.0 MB/s | 5.0 MB 00:00 2024-04-19T23:41:19.675 INFO:teuthology.orchestra.run.smithi076.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-04-19T23:41:20.475 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-19T23:41:22.537 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 16 MB 00:01 2024-04-19T23:41:22.817 INFO:teuthology.orchestra.run.smithi076.stdout:Extra Packages for Enterprise Linux 5.3 MB/s | 16 MB 00:03 2024-04-19T23:41:26.360 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 442 kB/s | 24 kB 00:00 2024-04-19T23:41:26.568 INFO:teuthology.orchestra.run.smithi076.stdout:lab-extras 426 kB/s | 24 kB 00:00 2024-04-19T23:41:30.018 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:41:30.020 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:41:30.020 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-19T23:41:30.020 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:41:30.020 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 13 M 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.7 M 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.6 M 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 5.5 M 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 22 M 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 24 k 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 780 k 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-19T23:41:30.021 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 474 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.6 M 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 45 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 129 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 197 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 371 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 364 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 106 k 2024-04-19T23:41:30.022 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-19T23:41:30.023 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:41:30.023 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:41:30.023 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:41:30.023 INFO:teuthology.orchestra.run.smithi155.stdout:Install 21 Packages 2024-04-19T23:41:30.023 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 2 Packages 2024-04-19T23:41:30.023 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:41:30.023 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 60 M 2024-04-19T23:41:30.023 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:41:30.182 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:41:30.184 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:41:30.184 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-04-19T23:41:30.184 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 13 M 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrading: 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout: librados2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.7 M 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.6 M 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 5.5 M 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 22 M 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 24 k 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 780 k 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-19T23:41:30.185 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 474 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.6 M 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 45 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 129 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cephfs x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 197 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rados x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 371 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 364 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 106 k 2024-04-19T23:41:30.186 INFO:teuthology.orchestra.run.smithi076.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-19T23:41:30.187 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:41:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:41:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:41:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:Install 21 Packages 2024-04-19T23:41:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrade 2 Packages 2024-04-19T23:41:30.187 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:41:30.187 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 60 M 2024-04-19T23:41:30.188 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:41:31.528 INFO:teuthology.orchestra.run.smithi155.stdout:(1/23): ceph-common-18.2.2-1237.g646b8c7d.el8.x 16 MB/s | 22 MB 00:01 2024-04-19T23:41:31.587 INFO:teuthology.orchestra.run.smithi155.stdout:(2/23): ceph-selinux-18.2.2-1237.g646b8c7d.el8. 418 kB/s | 24 kB 00:00 2024-04-19T23:41:31.662 INFO:teuthology.orchestra.run.smithi155.stdout:(3/23): ceph-base-18.2.2-1237.g646b8c7d.el8.x86 3.8 MB/s | 5.5 MB 00:01 2024-04-19T23:41:31.695 INFO:teuthology.orchestra.run.smithi155.stdout:(4/23): libcephfs2-18.2.2-1237.g646b8c7d.el8.x8 7.0 MB/s | 780 kB 00:00 2024-04-19T23:41:31.754 INFO:teuthology.orchestra.run.smithi155.stdout:(5/23): libradosstriper1-18.2.2-1237.g646b8c7d. 5.1 MB/s | 474 kB 00:00 2024-04-19T23:41:31.896 INFO:teuthology.orchestra.run.smithi155.stdout:(6/23): python3-ceph-argparse-18.2.2-1237.g646b 315 kB/s | 45 kB 00:00 2024-04-19T23:41:32.046 INFO:teuthology.orchestra.run.smithi155.stdout:(7/23): python3-ceph-common-18.2.2-1237.g646b8c 859 kB/s | 129 kB 00:00 2024-04-19T23:41:32.163 INFO:teuthology.orchestra.run.smithi155.stdout:(8/23): librgw2-18.2.2-1237.g646b8c7d.el8.x86_6 14 MB/s | 6.6 MB 00:00 2024-04-19T23:41:32.188 INFO:teuthology.orchestra.run.smithi155.stdout:(9/23): python3-cephfs-18.2.2-1237.g646b8c7d.el 1.4 MB/s | 197 kB 00:00 2024-04-19T23:41:32.264 INFO:teuthology.orchestra.run.smithi155.stdout:(10/23): python3-rados-18.2.2-1237.g646b8c7d.el 3.6 MB/s | 371 kB 00:00 2024-04-19T23:41:32.289 INFO:teuthology.orchestra.run.smithi155.stdout:(11/23): python3-rbd-18.2.2-1237.g646b8c7d.el8. 3.6 MB/s | 364 kB 00:00 2024-04-19T23:41:32.314 INFO:teuthology.orchestra.run.smithi155.stdout:(12/23): python3-rgw-18.2.2-1237.g646b8c7d.el8. 2.1 MB/s | 106 kB 00:00 2024-04-19T23:41:32.465 INFO:teuthology.orchestra.run.smithi155.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2024-04-19T23:41:32.542 INFO:teuthology.orchestra.run.smithi155.stdout:(14/23): librdkafka-1.6.1-1.el8.x86_64.rpm 2.6 MB/s | 677 kB 00:00 2024-04-19T23:41:32.574 INFO:teuthology.orchestra.run.smithi155.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 404 kB/s | 44 kB 00:00 2024-04-19T23:41:32.716 INFO:teuthology.orchestra.run.smithi155.stdout:(16/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 271 kB/s | 47 kB 00:00 2024-04-19T23:41:32.833 INFO:teuthology.orchestra.run.smithi155.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2024-04-19T23:41:32.858 INFO:teuthology.orchestra.run.smithi155.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 414 kB/s | 59 kB 00:00 2024-04-19T23:41:32.883 INFO:teuthology.orchestra.run.smithi155.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2024-04-19T23:41:33.095 INFO:teuthology.orchestra.run.smithi076.stdout:(1/23): ceph-radosgw-18.2.2-1237.g646b8c7d.el8. 6.0 MB/s | 13 MB 00:02 2024-04-19T23:41:33.142 INFO:teuthology.orchestra.run.smithi155.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 6.1 MB/s | 1.7 MB 00:00 2024-04-19T23:41:33.153 INFO:teuthology.orchestra.run.smithi076.stdout:(2/23): ceph-selinux-18.2.2-1237.g646b8c7d.el8. 419 kB/s | 24 kB 00:00 2024-04-19T23:41:33.295 INFO:teuthology.orchestra.run.smithi076.stdout:(3/23): libcephfs2-18.2.2-1237.g646b8c7d.el8.x8 5.4 MB/s | 780 kB 00:00 2024-04-19T23:41:33.379 INFO:teuthology.orchestra.run.smithi076.stdout:(4/23): libradosstriper1-18.2.2-1237.g646b8c7d. 5.6 MB/s | 474 kB 00:00 2024-04-19T23:41:33.442 INFO:teuthology.orchestra.run.smithi155.stdout:(21/23): librados2-18.2.2-1237.g646b8c7d.el8.x8 6.6 MB/s | 3.7 MB 00:00 2024-04-19T23:41:33.829 INFO:teuthology.orchestra.run.smithi076.stdout:(5/23): ceph-base-18.2.2-1237.g646b8c7d.el8.x86 1.9 MB/s | 5.5 MB 00:02 2024-04-19T23:41:33.993 INFO:teuthology.orchestra.run.smithi155.stdout:(22/23): librbd1-18.2.2-1237.g646b8c7d.el8.x86_ 4.2 MB/s | 3.6 MB 00:00 2024-04-19T23:41:34.012 INFO:teuthology.orchestra.run.smithi076.stdout:(6/23): librgw2-18.2.2-1237.g646b8c7d.el8.x86_6 10 MB/s | 6.6 MB 00:00 2024-04-19T23:41:34.038 INFO:teuthology.orchestra.run.smithi076.stdout:(7/23): python3-ceph-argparse-18.2.2-1237.g646b 214 kB/s | 45 kB 00:00 2024-04-19T23:41:34.071 INFO:teuthology.orchestra.run.smithi076.stdout:(8/23): python3-ceph-common-18.2.2-1237.g646b8c 2.1 MB/s | 129 kB 00:00 2024-04-19T23:41:34.105 INFO:teuthology.orchestra.run.smithi076.stdout:(9/23): python3-cephfs-18.2.2-1237.g646b8c7d.el 2.9 MB/s | 197 kB 00:00 2024-04-19T23:41:34.130 INFO:teuthology.orchestra.run.smithi076.stdout:(10/23): python3-rados-18.2.2-1237.g646b8c7d.el 6.2 MB/s | 371 kB 00:00 2024-04-19T23:41:34.347 INFO:teuthology.orchestra.run.smithi076.stdout:(11/23): ceph-common-18.2.2-1237.g646b8c7d.el8. 6.3 MB/s | 22 MB 00:03 2024-04-19T23:41:34.364 INFO:teuthology.orchestra.run.smithi076.stdout:(12/23): python3-rgw-18.2.2-1237.g646b8c7d.el8. 455 kB/s | 106 kB 00:00 2024-04-19T23:41:34.390 INFO:teuthology.orchestra.run.smithi076.stdout:(13/23): python3-rbd-18.2.2-1237.g646b8c7d.el8. 1.3 MB/s | 364 kB 00:00 2024-04-19T23:41:34.498 INFO:teuthology.orchestra.run.smithi076.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 405 kB/s | 44 kB 00:00 2024-04-19T23:41:34.541 INFO:teuthology.orchestra.run.smithi076.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2024-04-19T23:41:34.580 INFO:teuthology.orchestra.run.smithi076.stdout:(16/23): librdkafka-1.6.1-1.el8.x86_64.rpm 2.9 MB/s | 677 kB 00:00 2024-04-19T23:41:34.650 INFO:teuthology.orchestra.run.smithi076.stdout:(17/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 312 kB/s | 47 kB 00:00 2024-04-19T23:41:35.042 INFO:teuthology.orchestra.run.smithi076.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 127 kB/s | 59 kB 00:00 2024-04-19T23:41:35.142 INFO:teuthology.orchestra.run.smithi076.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 154 kB/s | 75 kB 00:00 2024-04-19T23:41:35.217 INFO:teuthology.orchestra.run.smithi076.stdout:(20/23): gperftools-libs-2.7-9.el8.x86_64.rpm 453 kB/s | 306 kB 00:00 2024-04-19T23:41:35.318 INFO:teuthology.orchestra.run.smithi155.stdout:(23/23): ceph-radosgw-18.2.2-1237.g646b8c7d.el8 2.6 MB/s | 13 MB 00:05 2024-04-19T23:41:35.322 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:41:35.322 INFO:teuthology.orchestra.run.smithi155.stdout:Total 11 MB/s | 60 MB 00:05 2024-04-19T23:41:35.364 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:41:35.410 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:41:35.410 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:41:35.642 INFO:teuthology.orchestra.run.smithi076.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 2.9 MB/s | 1.7 MB 00:00 2024-04-19T23:41:35.761 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:41:35.764 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:41:35.819 INFO:teuthology.orchestra.run.smithi076.stdout:(22/23): librbd1-18.2.2-1237.g646b8c7d.el8.x86_ 5.9 MB/s | 3.6 MB 00:00 2024-04-19T23:41:35.909 INFO:teuthology.orchestra.run.smithi076.stdout:(23/23): librados2-18.2.2-1237.g646b8c7d.el8.x8 4.8 MB/s | 3.7 MB 00:00 2024-04-19T23:41:35.913 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:41:35.914 INFO:teuthology.orchestra.run.smithi076.stdout:Total 10 MB/s | 60 MB 00:05 2024-04-19T23:41:35.955 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:41:36.001 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:41:36.001 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:41:36.335 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:41:36.338 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:41:36.929 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:41:37.124 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2024-04-19T23:41:37.322 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2024-04-19T23:41:37.493 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2024-04-19T23:41:37.526 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:41:37.765 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2024-04-19T23:41:37.909 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2024-04-19T23:41:37.955 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2024-04-19T23:41:38.085 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/25 2024-04-19T23:41:38.100 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2024-04-19T23:41:38.176 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/25 2024-04-19T23:41:38.433 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 5/25 2024-04-19T23:41:38.517 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2024-04-19T23:41:38.593 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/25 2024-04-19T23:41:38.684 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/25 2024-04-19T23:41:38.776 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/25 2024-04-19T23:41:38.974 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/25 2024-04-19T23:41:39.049 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 5/25 2024-04-19T23:41:39.143 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/25 2024-04-19T23:41:39.207 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/25 2024-04-19T23:41:39.242 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/25 2024-04-19T23:41:39.427 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/25 2024-04-19T23:41:39.608 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2024-04-19T23:41:39.636 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/25 2024-04-19T23:41:39.753 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8. 10/25 2024-04-19T23:41:39.825 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/25 2024-04-19T23:41:39.891 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/25 2024-04-19T23:41:39.961 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/25 2024-04-19T23:41:40.101 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/25 2024-04-19T23:41:40.168 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/25 2024-04-19T23:41:40.323 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2024-04-19T23:41:40.334 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_6 13/25 2024-04-19T23:41:40.390 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_6 13/25 2024-04-19T23:41:40.486 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8. 10/25 2024-04-19T23:41:40.610 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2024-04-19T23:41:40.677 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/25 2024-04-19T23:41:40.893 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/25 2024-04-19T23:41:41.025 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_6 13/25 2024-04-19T23:41:41.104 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_6 13/25 2024-04-19T23:41:41.326 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2024-04-19T23:41:41.357 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2024-04-19T23:41:41.501 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/25 2024-04-19T23:41:41.570 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/25 2024-04-19T23:41:41.767 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 17/25 2024-04-19T23:41:41.944 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-04-19T23:41:42.090 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2024-04-19T23:41:42.168 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x8 19/25 2024-04-19T23:41:42.242 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/25 2024-04-19T23:41:42.312 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 16/25 2024-04-19T23:41:42.516 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 17/25 2024-04-19T23:41:42.710 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-04-19T23:41:42.900 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x8 19/25 2024-04-19T23:41:44.697 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 20/25 2024-04-19T23:41:44.918 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 20/25 2024-04-19T23:41:45.460 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 20/25 2024-04-19T23:41:45.528 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 20/25 2024-04-19T23:41:45.683 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 20/25 2024-04-19T23:41:45.792 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 21/25 2024-04-19T23:41:45.895 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 21/25 2024-04-19T23:41:46.058 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/25 2024-04-19T23:41:46.294 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 20/25 2024-04-19T23:41:46.525 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 21/25 2024-04-19T23:41:46.658 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 21/25 2024-04-19T23:41:46.824 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/25 2024-04-19T23:42:05.285 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/25 2024-04-19T23:42:05.285 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2024-04-19T23:42:05.285 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2024-04-19T23:42:05.285 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2024-04-19T23:42:05.285 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /run 2024-04-19T23:42:05.285 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2024-04-19T23:42:05.285 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2024-04-19T23:42:05.286 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2024-04-19T23:42:05.286 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2024-04-19T23:42:05.286 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2024-04-19T23:42:05.286 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:06.200 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/25 2024-04-19T23:42:06.200 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /sys 2024-04-19T23:42:06.200 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /proc 2024-04-19T23:42:06.200 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /dev 2024-04-19T23:42:06.200 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /run 2024-04-19T23:42:06.200 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /mnt 2024-04-19T23:42:06.200 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /var/tmp 2024-04-19T23:42:06.200 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /home 2024-04-19T23:42:06.200 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /tmp 2024-04-19T23:42:06.201 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /dev 2024-04-19T23:42:06.201 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:06.672 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/25 2024-04-19T23:42:06.692 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/25 2024-04-19T23:42:06.692 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-19T23:42:06.907 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-19T23:42:06.908 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-19T23:42:07.589 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/25 2024-04-19T23:42:07.609 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/25 2024-04-19T23:42:07.609 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-19T23:42:07.614 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-19T23:42:07.614 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/25 2024-04-19T23:42:07.614 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/25 2024-04-19T23:42:07.614 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 5/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_6 6/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8. 8/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x8 9/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 13/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-04-19T23:42:07.615 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-04-19T23:42:07.616 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-04-19T23:42:07.616 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2024-04-19T23:42:07.616 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2024-04-19T23:42:07.616 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2024-04-19T23:42:07.616 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/25 2024-04-19T23:42:07.616 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-04-19T23:42:07.616 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 24/25 2024-04-19T23:42:07.790 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-19T23:42:07.790 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-19T23:42:08.451 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-04-19T23:42:08.451 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:08.451 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2024-04-19T23:42:08.451 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.451 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.451 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:42:08.451 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.451 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.451 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.451 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.451 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:08.452 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-19T23:42:08.453 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:08.453 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:42:08.458 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-19T23:42:08.458 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/25 2024-04-19T23:42:08.458 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/25 2024-04-19T23:42:08.458 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/25 2024-04-19T23:42:08.458 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/25 2024-04-19T23:42:08.458 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 5/25 2024-04-19T23:42:08.458 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_6 6/25 2024-04-19T23:42:08.458 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/25 2024-04-19T23:42:08.458 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8. 8/25 2024-04-19T23:42:08.458 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x8 9/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 13/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-04-19T23:42:08.459 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 24/25 2024-04-19T23:42:08.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-test 2024-04-19T23:42:09.306 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-04-19T23:42:09.306 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:09.306 INFO:teuthology.orchestra.run.smithi076.stdout:Upgraded: 2024-04-19T23:42:09.306 INFO:teuthology.orchestra.run.smithi076.stdout: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.306 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.306 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:42:09.306 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-19T23:42:09.307 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-19T23:42:09.308 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.308 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.308 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.308 INFO:teuthology.orchestra.run.smithi076.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-19T23:42:09.308 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.308 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.308 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:09.308 INFO:teuthology.orchestra.run.smithi076.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-19T23:42:09.308 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:09.308 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:42:09.510 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:43 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:42:09.640 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-test 2024-04-19T23:42:10.369 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:00:44 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:42:11.146 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:42:11.147 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:11.147 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-19T23:42:11.147 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:11.147 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:42:11.147 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 47 M 2024-04-19T23:42:11.148 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-19T23:42:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-19T23:42:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 142 k 2024-04-19T23:42:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-19T23:42:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-19T23:42:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-19T23:42:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:11.148 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:42:11.148 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:11.148 INFO:teuthology.orchestra.run.smithi155.stdout:Install 6 Packages 2024-04-19T23:42:11.148 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:11.149 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 48 M 2024-04-19T23:42:11.149 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 213 M 2024-04-19T23:42:11.149 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:42:11.359 INFO:teuthology.orchestra.run.smithi155.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.3 MB/s | 203 kB 00:00 2024-04-19T23:42:11.410 INFO:teuthology.orchestra.run.smithi155.stdout:(2/6): oniguruma-6.8.2-3.el8.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-19T23:42:11.460 INFO:teuthology.orchestra.run.smithi155.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2024-04-19T23:42:11.502 INFO:teuthology.orchestra.run.smithi155.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-04-19T23:42:11.519 INFO:teuthology.orchestra.run.smithi155.stdout:(5/6): libcephsqlite-18.2.2-1237.g646b8c7d.el8. 455 kB/s | 142 kB 00:00 2024-04-19T23:42:12.003 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:42:12.004 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:42:12.004 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 47 M 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout: libcephsqlite x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 142 k 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout:Install 6 Packages 2024-04-19T23:42:12.005 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:12.006 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 48 M 2024-04-19T23:42:12.006 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 213 M 2024-04-19T23:42:12.006 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:42:12.367 INFO:teuthology.orchestra.run.smithi076.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.2 MB/s | 203 kB 00:00 2024-04-19T23:42:12.434 INFO:teuthology.orchestra.run.smithi076.stdout:(2/6): oniguruma-6.8.2-3.el8.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-19T23:42:12.543 INFO:teuthology.orchestra.run.smithi076.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2024-04-19T23:42:12.585 INFO:teuthology.orchestra.run.smithi076.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-04-19T23:42:12.793 INFO:teuthology.orchestra.run.smithi076.stdout:(5/6): libcephsqlite-18.2.2-1237.g646b8c7d.el8. 239 kB/s | 142 kB 00:00 2024-04-19T23:42:13.486 INFO:teuthology.orchestra.run.smithi155.stdout:(6/6): ceph-test-18.2.2-1237.g646b8c7d.el8.x86_ 21 MB/s | 47 MB 00:02 2024-04-19T23:42:13.488 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:42:13.488 INFO:teuthology.orchestra.run.smithi155.stdout:Total 21 MB/s | 48 MB 00:02 2024-04-19T23:42:13.531 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:42:13.552 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:42:13.552 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:42:13.850 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:42:13.853 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:42:14.333 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:42:14.557 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-04-19T23:42:14.763 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-04-19T23:42:14.903 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-19T23:42:14.983 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-19T23:42:15.175 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-04-19T23:42:15.337 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 5/6 2024-04-19T23:42:19.901 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 5/6 2024-04-19T23:42:20.102 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/6 2024-04-19T23:42:20.376 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/6 2024-04-19T23:42:20.376 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/6 2024-04-19T23:42:20.376 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/6 2024-04-19T23:42:20.376 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-04-19T23:42:20.376 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-04-19T23:42:20.376 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-04-19T23:42:20.847 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-04-19T23:42:20.847 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:20.847 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:42:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: jq-1.6-8.el8.x86_64 2024-04-19T23:42:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-19T23:42:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-19T23:42:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-19T23:42:20.848 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:20.848 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:42:21.077 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph 2024-04-19T23:42:21.817 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:55 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:42:23.454 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:42:23.458 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:23.458 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-19T23:42:23.458 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:23.458 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:42:23.458 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.4 k 2024-04-19T23:42:23.458 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-19T23:42:23.458 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 2.3 M 2024-04-19T23:42:23.458 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 1.6 M 2024-04-19T23:42:23.458 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 245 k 2024-04-19T23:42:23.458 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 4.8 M 2024-04-19T23:42:23.458 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 18 M 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-19T23:42:23.459 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-19T23:42:23.460 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-19T23:42:23.461 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-19T23:42:23.461 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:23.461 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:42:23.461 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:23.461 INFO:teuthology.orchestra.run.smithi155.stdout:Install 32 Packages 2024-04-19T23:42:23.461 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:23.462 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 31 M 2024-04-19T23:42:23.462 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 124 M 2024-04-19T23:42:23.462 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:42:23.981 INFO:teuthology.orchestra.run.smithi155.stdout:(1/32): ceph-18.2.2-1237.g646b8c7d.el8.x86_64.r 32 kB/s | 6.4 kB 00:00 2024-04-19T23:42:24.132 INFO:teuthology.orchestra.run.smithi155.stdout:(2/32): ceph-mds-18.2.2-1237.g646b8c7d.el8.x86_ 6.5 MB/s | 2.3 MB 00:00 2024-04-19T23:42:24.824 INFO:teuthology.orchestra.run.smithi155.stdout:(3/32): ceph-mgr-18.2.2-1237.g646b8c7d.el8.x86_ 1.5 MB/s | 1.6 MB 00:01 2024-04-19T23:42:25.133 INFO:teuthology.orchestra.run.smithi155.stdout:(4/32): ceph-osd-18.2.2-1237.g646b8c7d.el8.x86_ 18 MB/s | 18 MB 00:01 2024-04-19T23:42:25.157 INFO:teuthology.orchestra.run.smithi155.stdout:(5/32): ceph-mgr-modules-core-18.2.2-1237.g646b 736 kB/s | 245 kB 00:00 2024-04-19T23:42:25.266 INFO:teuthology.orchestra.run.smithi155.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 358 kB/s | 39 kB 00:00 2024-04-19T23:42:25.292 INFO:teuthology.orchestra.run.smithi155.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 990 kB/s | 157 kB 00:00 2024-04-19T23:42:25.342 INFO:teuthology.orchestra.run.smithi155.stdout:(8/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 1.3 MB/s | 103 kB 00:00 2024-04-19T23:42:25.367 INFO:teuthology.orchestra.run.smithi155.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 757 kB/s | 57 kB 00:00 2024-04-19T23:42:25.476 INFO:teuthology.orchestra.run.smithi155.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 3.3 MB/s | 457 kB 00:00 2024-04-19T23:42:25.551 INFO:teuthology.orchestra.run.smithi076.stdout:(6/6): ceph-test-18.2.2-1237.g646b8c7d.el8.x86_ 3.5 MB/s | 47 MB 00:13 2024-04-19T23:42:25.551 INFO:teuthology.orchestra.run.smithi155.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2024-04-19T23:42:25.553 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:42:25.553 INFO:teuthology.orchestra.run.smithi076.stdout:Total 3.5 MB/s | 48 MB 00:13 2024-04-19T23:42:25.592 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:42:25.610 INFO:teuthology.orchestra.run.smithi155.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 1.8 MB/s | 109 kB 00:00 2024-04-19T23:42:25.612 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:42:25.612 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:42:25.718 INFO:teuthology.orchestra.run.smithi155.stdout:(13/32): python3-cryptography-3.2.1-7.el8.x86_6 2.6 MB/s | 641 kB 00:00 2024-04-19T23:42:25.869 INFO:teuthology.orchestra.run.smithi155.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 168 kB/s | 44 kB 00:00 2024-04-19T23:42:25.915 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:42:25.918 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:42:26.044 INFO:teuthology.orchestra.run.smithi155.stdout:(15/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 987 kB/s | 173 kB 00:00 2024-04-19T23:42:26.070 INFO:teuthology.orchestra.run.smithi155.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 529 kB/s | 185 kB 00:00 2024-04-19T23:42:26.137 INFO:teuthology.orchestra.run.smithi155.stdout:(17/32): ceph-mon-18.2.2-1237.g646b8c7d.el8.x86 2.2 MB/s | 4.8 MB 00:02 2024-04-19T23:42:26.154 INFO:teuthology.orchestra.run.smithi155.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2024-04-19T23:42:26.188 INFO:teuthology.orchestra.run.smithi155.stdout:(19/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.6 MB/s | 384 kB 00:00 2024-04-19T23:42:26.204 INFO:teuthology.orchestra.run.smithi155.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 262 kB/s | 18 kB 00:00 2024-04-19T23:42:26.247 INFO:teuthology.orchestra.run.smithi155.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.0 MB/s | 59 kB 00:00 2024-04-19T23:42:26.305 INFO:teuthology.orchestra.run.smithi155.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 268 kB/s | 16 kB 00:00 2024-04-19T23:42:26.339 INFO:teuthology.orchestra.run.smithi155.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2024-04-19T23:42:26.371 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:42:26.372 INFO:teuthology.orchestra.run.smithi155.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 279 kB/s | 19 kB 00:00 2024-04-19T23:42:26.431 INFO:teuthology.orchestra.run.smithi155.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 260 kB/s | 24 kB 00:00 2024-04-19T23:42:26.456 INFO:teuthology.orchestra.run.smithi155.stdout:(26/32): python3-logutils-0.3.5-11.el8.noarch.r 161 kB/s | 49 kB 00:00 2024-04-19T23:42:26.482 INFO:teuthology.orchestra.run.smithi155.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 268 kB/s | 29 kB 00:00 2024-04-19T23:42:26.507 INFO:teuthology.orchestra.run.smithi155.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 364 kB/s | 27 kB 00:00 2024-04-19T23:42:26.540 INFO:teuthology.orchestra.run.smithi155.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.0 MB/s | 255 kB 00:00 2024-04-19T23:42:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-04-19T23:42:26.582 INFO:teuthology.orchestra.run.smithi155.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2024-04-19T23:42:26.608 INFO:teuthology.orchestra.run.smithi155.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 343 kB/s | 23 kB 00:00 2024-04-19T23:42:26.692 INFO:teuthology.orchestra.run.smithi155.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.2 MB/s | 251 kB 00:00 2024-04-19T23:42:26.696 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:42:26.696 INFO:teuthology.orchestra.run.smithi155.stdout:Total 9.6 MB/s | 31 MB 00:03 2024-04-19T23:42:26.752 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-04-19T23:42:26.776 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:42:26.814 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:42:26.815 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:42:26.886 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-19T23:42:26.964 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-19T23:42:27.122 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:42:27.126 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:42:27.149 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-04-19T23:42:27.277 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 5/6 2024-04-19T23:42:28.223 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:42:28.457 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-19T23:42:28.661 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-19T23:42:28.877 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-19T23:42:29.117 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-19T23:42:29.408 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-19T23:42:29.586 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-19T23:42:29.764 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-19T23:42:29.899 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-19T23:42:30.100 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-19T23:42:30.388 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-19T23:42:30.626 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-19T23:42:30.849 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-19T23:42:31.230 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-19T23:42:31.479 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-19T23:42:31.668 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-19T23:42:31.804 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 5/6 2024-04-19T23:42:31.884 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-19T23:42:32.025 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/6 2024-04-19T23:42:32.077 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-19T23:42:32.289 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/6 2024-04-19T23:42:32.289 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/6 2024-04-19T23:42:32.289 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/6 2024-04-19T23:42:32.290 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-04-19T23:42:32.290 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-04-19T23:42:32.290 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-04-19T23:42:32.425 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-19T23:42:32.615 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-19T23:42:32.741 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-04-19T23:42:32.741 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:32.741 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:42:32.741 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:32.742 INFO:teuthology.orchestra.run.smithi076.stdout: jq-1.6-8.el8.x86_64 2024-04-19T23:42:32.742 INFO:teuthology.orchestra.run.smithi076.stdout: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:32.742 INFO:teuthology.orchestra.run.smithi076.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-19T23:42:32.742 INFO:teuthology.orchestra.run.smithi076.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-19T23:42:32.742 INFO:teuthology.orchestra.run.smithi076.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-19T23:42:32.742 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:32.742 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:42:32.795 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-19T23:42:32.939 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph 2024-04-19T23:42:32.981 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-19T23:42:33.223 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-19T23:42:33.463 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-19T23:42:33.679 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-19T23:42:33.681 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:01:07 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:42:33.986 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-19T23:42:34.333 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-19T23:42:34.709 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8. 27/32 2024-04-19T23:42:34.909 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 28/32 2024-04-19T23:42:35.322 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:42:35.326 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:42:35.326 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-04-19T23:42:35.326 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:42:35.326 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:42:35.326 INFO:teuthology.orchestra.run.smithi076.stdout: ceph x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.4 k 2024-04-19T23:42:35.326 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-04-19T23:42:35.326 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 2.3 M 2024-04-19T23:42:35.326 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 1.6 M 2024-04-19T23:42:35.326 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 245 k 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 4.8 M 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 18 M 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-19T23:42:35.327 INFO:teuthology.orchestra.run.smithi076.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-19T23:42:35.328 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-19T23:42:35.329 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-19T23:42:35.329 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-19T23:42:35.329 INFO:teuthology.orchestra.run.smithi076.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-19T23:42:35.329 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:35.329 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:42:35.329 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:42:35.329 INFO:teuthology.orchestra.run.smithi076.stdout:Install 32 Packages 2024-04-19T23:42:35.329 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:35.330 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 31 M 2024-04-19T23:42:35.330 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 124 M 2024-04-19T23:42:35.330 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:42:36.204 INFO:teuthology.orchestra.run.smithi076.stdout:(1/32): ceph-18.2.2-1237.g646b8c7d.el8.x86_64.r 26 kB/s | 6.4 kB 00:00 2024-04-19T23:42:36.555 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 28/32 2024-04-19T23:42:36.743 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 29/32 2024-04-19T23:42:36.937 INFO:teuthology.orchestra.run.smithi076.stdout:(2/32): ceph-mgr-18.2.2-1237.g646b8c7d.el8.x86_ 1.6 MB/s | 1.6 MB 00:00 2024-04-19T23:42:37.171 INFO:teuthology.orchestra.run.smithi076.stdout:(3/32): ceph-mds-18.2.2-1237.g646b8c7d.el8.x86_ 1.9 MB/s | 2.3 MB 00:01 2024-04-19T23:42:37.220 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 29/32 2024-04-19T23:42:37.279 INFO:teuthology.orchestra.run.smithi076.stdout:(4/32): ceph-mgr-modules-core-18.2.2-1237.g646b 2.2 MB/s | 245 kB 00:00 2024-04-19T23:42:37.385 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 30/32 2024-04-19T23:42:37.430 INFO:teuthology.orchestra.run.smithi076.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.0 MB/s | 157 kB 00:00 2024-04-19T23:42:37.481 INFO:teuthology.orchestra.run.smithi076.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 776 kB/s | 39 kB 00:00 2024-04-19T23:42:37.530 INFO:teuthology.orchestra.run.smithi076.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.0 MB/s | 103 kB 00:00 2024-04-19T23:42:37.572 INFO:teuthology.orchestra.run.smithi076.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.3 MB/s | 57 kB 00:00 2024-04-19T23:42:37.597 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 30/32 2024-04-19T23:42:37.664 INFO:teuthology.orchestra.run.smithi076.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 4.9 MB/s | 457 kB 00:00 2024-04-19T23:42:37.753 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 31/32 2024-04-19T23:42:37.771 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 31/32 2024-04-19T23:42:37.856 INFO:teuthology.orchestra.run.smithi076.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2024-04-19T23:42:37.875 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 32/32 2024-04-19T23:42:37.923 INFO:teuthology.orchestra.run.smithi076.stdout:(11/32): ceph-mon-18.2.2-1237.g646b8c7d.el8.x86 2.8 MB/s | 4.8 MB 00:01 2024-04-19T23:42:38.007 INFO:teuthology.orchestra.run.smithi076.stdout:(12/32): python3-cryptography-3.2.1-7.el8.x86_6 4.2 MB/s | 641 kB 00:00 2024-04-19T23:42:38.082 INFO:teuthology.orchestra.run.smithi076.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 689 kB/s | 109 kB 00:00 2024-04-19T23:42:38.107 INFO:teuthology.orchestra.run.smithi076.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 435 kB/s | 44 kB 00:00 2024-04-19T23:42:38.174 INFO:teuthology.orchestra.run.smithi076.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.7 MB/s | 185 kB 00:00 2024-04-19T23:42:38.200 INFO:teuthology.orchestra.run.smithi076.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.8 MB/s | 173 kB 00:00 2024-04-19T23:42:38.225 INFO:teuthology.orchestra.run.smithi076.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 7.5 MB/s | 384 kB 00:00 2024-04-19T23:42:38.250 INFO:teuthology.orchestra.run.smithi076.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 220 kB/s | 11 kB 00:00 2024-04-19T23:42:38.275 INFO:teuthology.orchestra.run.smithi076.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 350 kB/s | 18 kB 00:00 2024-04-19T23:42:38.294 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 32/32 2024-04-19T23:42:38.294 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/32 2024-04-19T23:42:38.294 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/32 2024-04-19T23:42:38.294 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/32 2024-04-19T23:42:38.294 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 5/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8. 6/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-19T23:42:38.295 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-19T23:42:38.296 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-19T23:42:38.296 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-19T23:42:38.296 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-19T23:42:38.296 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-19T23:42:38.296 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-19T23:42:38.296 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-19T23:42:38.297 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-19T23:42:38.297 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-19T23:42:38.297 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-19T23:42:38.297 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-19T23:42:38.297 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-19T23:42:38.297 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-19T23:42:38.301 INFO:teuthology.orchestra.run.smithi076.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 967 kB/s | 49 kB 00:00 2024-04-19T23:42:38.326 INFO:teuthology.orchestra.run.smithi076.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2024-04-19T23:42:38.377 INFO:teuthology.orchestra.run.smithi076.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2024-04-19T23:42:38.402 INFO:teuthology.orchestra.run.smithi076.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.7 MB/s | 283 kB 00:00 2024-04-19T23:42:38.436 INFO:teuthology.orchestra.run.smithi076.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 320 kB/s | 19 kB 00:00 2024-04-19T23:42:38.461 INFO:teuthology.orchestra.run.smithi076.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 408 kB/s | 24 kB 00:00 2024-04-19T23:42:38.486 INFO:teuthology.orchestra.run.smithi076.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 581 kB/s | 29 kB 00:00 2024-04-19T23:42:38.512 INFO:teuthology.orchestra.run.smithi076.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 549 kB/s | 27 kB 00:00 2024-04-19T23:42:38.545 INFO:teuthology.orchestra.run.smithi076.stdout:(28/32): python3-waitress-1.4.3-1.el8.noarch.rp 4.3 MB/s | 255 kB 00:00 2024-04-19T23:42:38.571 INFO:teuthology.orchestra.run.smithi076.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 4.2 MB/s | 251 kB 00:00 2024-04-19T23:42:38.596 INFO:teuthology.orchestra.run.smithi076.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2024-04-19T23:42:38.613 INFO:teuthology.orchestra.run.smithi076.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 549 kB/s | 23 kB 00:00 2024-04-19T23:42:38.855 INFO:teuthology.orchestra.run.smithi076.stdout:(32/32): ceph-osd-18.2.2-1237.g646b8c7d.el8.x86 9.6 MB/s | 18 MB 00:01 2024-04-19T23:42:38.857 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:42:38.857 INFO:teuthology.orchestra.run.smithi076.stdout:Total 8.8 MB/s | 31 MB 00:03 2024-04-19T23:42:38.936 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:42:38.974 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:42:38.974 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:42:39.123 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-19T23:42:39.124 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-2.6-1.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-19T23:42:39.125 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-19T23:42:39.126 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-19T23:42:39.126 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-19T23:42:39.126 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-19T23:42:39.126 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-19T23:42:39.126 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-19T23:42:39.126 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:39.126 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:42:39.300 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:42:39.303 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:42:39.370 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-base 2024-04-19T23:42:40.112 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:14 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:42:40.419 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:42:40.639 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-19T23:42:40.850 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-19T23:42:41.059 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-19T23:42:41.722 INFO:teuthology.orchestra.run.smithi155.stdout:Package ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:42:41.733 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-19T23:42:41.772 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:42:41.773 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-19T23:42:41.773 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:42:41.881 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install cephadm 2024-04-19T23:42:41.955 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-19T23:42:42.145 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-19T23:42:42.329 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-19T23:42:42.523 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-19T23:42:42.637 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:16 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:42:42.740 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-19T23:42:42.976 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-19T23:42:43.181 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-19T23:42:43.421 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-19T23:42:43.777 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-19T23:42:44.020 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-19T23:42:44.233 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-19T23:42:44.276 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:42:44.277 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 170 k 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 170 k 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 692 k 2024-04-19T23:42:44.278 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:42:44.467 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-19T23:42:44.591 INFO:teuthology.orchestra.run.smithi155.stdout:cephadm-18.2.2-1237.g646b8c7d.el8.noarch.rpm 543 kB/s | 170 kB 00:00 2024-04-19T23:42:44.592 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:42:44.592 INFO:teuthology.orchestra.run.smithi155.stdout:Total 541 kB/s | 170 kB 00:00 2024-04-19T23:42:44.592 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:42:44.600 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:42:44.600 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:42:44.603 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:42:44.606 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:42:44.659 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-19T23:42:44.673 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:42:44.972 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-19T23:42:45.167 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 1/1 2024-04-19T23:42:45.197 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-19T23:42:45.304 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 1/1 2024-04-19T23:42:45.377 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-19T23:42:45.525 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 1/1 2024-04-19T23:42:45.563 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-19T23:42:45.798 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-19T23:42:45.874 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 1/1 2024-04-19T23:42:45.874 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:45.874 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:42:45.874 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:42:45.874 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:45.874 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:42:46.046 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-19T23:42:46.252 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-19T23:42:46.559 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-19T23:42:46.741 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-immutable-object-cache 2024-04-19T23:42:46.847 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-19T23:42:47.206 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8. 27/32 2024-04-19T23:42:47.392 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 28/32 2024-04-19T23:42:47.484 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:21 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:42:49.038 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 28/32 2024-04-19T23:42:49.120 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:42:49.120 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:49.120 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2024-04-19T23:42:49.120 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:49.120 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:42:49.120 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 166 k 2024-04-19T23:42:49.121 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:49.121 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:42:49.121 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:49.121 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-04-19T23:42:49.121 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:49.121 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 166 k 2024-04-19T23:42:49.121 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 503 k 2024-04-19T23:42:49.121 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:42:49.209 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 29/32 2024-04-19T23:42:49.307 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-immutable-object-cache-18.2.2-1237.g646b8c 897 kB/s | 166 kB 00:00 2024-04-19T23:42:49.308 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:42:49.308 INFO:teuthology.orchestra.run.smithi155.stdout:Total 891 kB/s | 166 kB 00:00 2024-04-19T23:42:49.308 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:42:49.319 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:42:49.319 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:42:49.365 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:42:49.368 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:42:49.490 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:42:49.687 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 29/32 2024-04-19T23:42:49.699 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d. 1/1 2024-04-19T23:42:49.867 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 30/32 2024-04-19T23:42:50.080 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 30/32 2024-04-19T23:42:50.117 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d. 1/1 2024-04-19T23:42:50.233 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 31/32 2024-04-19T23:42:50.251 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 31/32 2024-04-19T23:42:50.358 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 32/32 2024-04-19T23:42:50.488 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d. 1/1 2024-04-19T23:42:50.488 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:50.488 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:42:50.488 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:50.488 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:50.489 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:42:50.720 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr 2024-04-19T23:42:50.792 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 32/32 2024-04-19T23:42:50.792 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/32 2024-04-19T23:42:50.792 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/32 2024-04-19T23:42:50.792 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/32 2024-04-19T23:42:50.792 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/32 2024-04-19T23:42:50.792 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 5/32 2024-04-19T23:42:50.792 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8. 6/32 2024-04-19T23:42:50.792 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-19T23:42:50.792 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-19T23:42:50.793 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-19T23:42:50.794 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-19T23:42:50.794 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-19T23:42:50.794 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-19T23:42:50.794 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-19T23:42:50.794 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-19T23:42:50.794 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-19T23:42:50.794 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-19T23:42:50.794 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-19T23:42:51.462 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:25 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:42:51.667 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-19T23:42:51.667 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:51.667 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:42:51.667 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:51.667 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-19T23:42:51.668 INFO:teuthology.orchestra.run.smithi076.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-portend-2.6-1.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-19T23:42:51.669 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-19T23:42:51.670 INFO:teuthology.orchestra.run.smithi076.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-19T23:42:51.670 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:51.670 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:42:51.939 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-base 2024-04-19T23:42:52.677 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:01:26 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:42:53.053 INFO:teuthology.orchestra.run.smithi155.stdout:Package ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:42:53.101 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:42:53.102 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-19T23:42:53.102 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:42:53.216 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-dashboard 2024-04-19T23:42:53.947 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:27 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:42:54.269 INFO:teuthology.orchestra.run.smithi076.stdout:Package ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:42:54.318 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:42:54.319 INFO:teuthology.orchestra.run.smithi076.stdout:Nothing to do. 2024-04-19T23:42:54.319 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:42:54.436 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install cephadm 2024-04-19T23:42:55.170 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:01:29 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:42:55.571 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:42:55.572 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:55.572 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-19T23:42:55.572 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 3.5 M 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 24 k 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 15 k 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout:Install 5 Packages 2024-04-19T23:42:55.573 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:55.574 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 3.8 M 2024-04-19T23:42:55.574 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 87 M 2024-04-19T23:42:55.574 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:42:55.920 INFO:teuthology.orchestra.run.smithi155.stdout:(1/5): ceph-grafana-dashboards-18.2.2-1237.g646 111 kB/s | 24 kB 00:00 2024-04-19T23:42:55.936 INFO:teuthology.orchestra.run.smithi155.stdout:(2/5): ceph-prometheus-alerts-18.2.2-1237.g646b 65 kB/s | 15 kB 00:00 2024-04-19T23:42:56.212 INFO:teuthology.orchestra.run.smithi155.stdout:(3/5): ceph-mgr-dashboard-18.2.2-1237.g646b8c7d 6.9 MB/s | 3.5 MB 00:00 2024-04-19T23:42:56.254 INFO:teuthology.orchestra.run.smithi155.stdout:(4/5): python3-repoze-lru-0.7-6.el8.noarch.rpm 101 kB/s | 34 kB 00:00 2024-04-19T23:42:56.412 INFO:teuthology.orchestra.run.smithi155.stdout:(5/5): python3-routes-2.4.1-12.el8.noarch.rpm 413 kB/s | 196 kB 00:00 2024-04-19T23:42:56.414 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:42:56.415 INFO:teuthology.orchestra.run.smithi155.stdout:Total 4.5 MB/s | 3.8 MB 00:00 2024-04-19T23:42:56.415 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:42:56.423 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:42:56.423 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:42:56.513 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:42:56.516 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:42:56.757 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:42:56.801 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:42:56.802 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:42:56.802 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-04-19T23:42:56.802 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:42:56.802 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:42:56.802 INFO:teuthology.orchestra.run.smithi076.stdout: cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 170 k 2024-04-19T23:42:56.802 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:56.802 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:42:56.802 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:42:56.802 INFO:teuthology.orchestra.run.smithi076.stdout:Install 1 Package 2024-04-19T23:42:56.802 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:56.803 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 170 k 2024-04-19T23:42:56.803 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 692 k 2024-04-19T23:42:56.803 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:42:56.937 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/5 2024-04-19T23:42:56.995 INFO:teuthology.orchestra.run.smithi076.stdout:cephadm-18.2.2-1237.g646b8c7d.el8.noarch.rpm 885 kB/s | 170 kB 00:00 2024-04-19T23:42:56.996 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:42:56.996 INFO:teuthology.orchestra.run.smithi076.stdout:Total 879 kB/s | 170 kB 00:00 2024-04-19T23:42:56.996 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:42:57.004 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:42:57.004 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:42:57.006 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:42:57.009 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:42:57.143 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/5 2024-04-19T23:42:57.271 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.n 3/5 2024-04-19T23:42:57.297 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:42:57.945 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 1/1 2024-04-19T23:42:58.112 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 1/1 2024-04-19T23:42:58.332 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 1/1 2024-04-19T23:42:58.429 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8. 4/5 2024-04-19T23:42:58.647 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarc 5/5 2024-04-19T23:42:58.696 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 1/1 2024-04-19T23:42:58.696 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:58.696 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:42:58.696 INFO:teuthology.orchestra.run.smithi076.stdout: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:42:58.696 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:42:58.696 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:42:58.901 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-immutable-object-cache 2024-04-19T23:42:58.949 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarc 5/5 2024-04-19T23:42:58.949 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8. 1/5 2024-04-19T23:42:58.949 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarc 2/5 2024-04-19T23:42:58.949 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.n 3/5 2024-04-19T23:42:58.949 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/5 2024-04-19T23:42:59.312 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/5 2024-04-19T23:42:59.312 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:59.312 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:42:59.312 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:42:59.312 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:42:59.312 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:42:59.312 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-19T23:42:59.313 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-19T23:42:59.313 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:42:59.313 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:42:59.444 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-19T23:42:59.637 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:01:33 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:00.186 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:34 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:01.256 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:43:01.257 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:01.257 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repo Size 2024-04-19T23:43:01.257 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:01.257 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:43:01.257 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 166 k 2024-04-19T23:43:01.257 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:01.257 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:43:01.257 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:01.257 INFO:teuthology.orchestra.run.smithi076.stdout:Install 1 Package 2024-04-19T23:43:01.257 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:01.258 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 166 k 2024-04-19T23:43:01.258 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 503 k 2024-04-19T23:43:01.258 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:43:01.451 INFO:teuthology.orchestra.run.smithi076.stdout:ceph-immutable-object-cache-18.2.2-1237.g646b8c 861 kB/s | 166 kB 00:00 2024-04-19T23:43:01.451 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:01.451 INFO:teuthology.orchestra.run.smithi076.stdout:Total 855 kB/s | 166 kB 00:00 2024-04-19T23:43:01.452 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:43:01.463 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:43:01.463 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:43:01.510 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:43:01.513 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:43:01.629 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:43:01.798 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d. 1/1 2024-04-19T23:43:01.825 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:43:01.826 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2024-04-19T23:43:01.826 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-19T23:43:01.826 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 7.4 M 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout:Install 8 Packages 2024-04-19T23:43:01.827 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:01.828 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 36 M 2024-04-19T23:43:01.828 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 210 M 2024-04-19T23:43:01.828 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:43:02.201 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d. 1/1 2024-04-19T23:43:02.578 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d. 1/1 2024-04-19T23:43:02.578 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:02.578 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:43:02.578 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:43:02.578 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:02.578 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:43:03.104 INFO:teuthology.orchestra.run.smithi155.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 6.0 MB/s | 4.7 MB 00:00 2024-04-19T23:43:03.170 INFO:teuthology.orchestra.run.smithi155.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 5.7 MB/s | 4.9 MB 00:00 2024-04-19T23:43:03.263 INFO:teuthology.orchestra.run.smithi155.stdout:(3/8): ceph-mgr-diskprediction-local-18.2.2-123 7.8 MB/s | 7.4 MB 00:00 2024-04-19T23:43:03.288 INFO:teuthology.orchestra.run.smithi155.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.9 MB/s | 225 kB 00:00 2024-04-19T23:43:03.547 INFO:teuthology.orchestra.run.smithi155.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 8.4 MB/s | 3.7 MB 00:00 2024-04-19T23:43:03.714 INFO:teuthology.orchestra.run.smithi155.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.5 MB/s | 645 kB 00:00 2024-04-19T23:43:03.739 INFO:teuthology.orchestra.run.smithi155.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 898 kB/s | 172 kB 00:00 2024-04-19T23:43:04.164 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-mgr 2024-04-19T23:43:04.907 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:01:38 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:04.964 INFO:teuthology.orchestra.run.smithi155.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 8.3 MB/s | 14 MB 00:01 2024-04-19T23:43:04.964 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:04.965 INFO:teuthology.orchestra.run.smithi155.stdout:Total 11 MB/s | 36 MB 00:03 2024-04-19T23:43:05.197 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:43:05.215 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:43:05.215 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:43:05.609 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:43:05.612 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:43:06.157 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:43:06.313 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-19T23:43:06.426 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-19T23:43:06.522 INFO:teuthology.orchestra.run.smithi076.stdout:Package ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:43:06.570 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:43:06.571 INFO:teuthology.orchestra.run.smithi076.stdout:Nothing to do. 2024-04-19T23:43:06.572 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:43:06.590 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-19T23:43:06.686 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-mgr-dashboard 2024-04-19T23:43:07.188 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-19T23:43:07.355 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-04-19T23:43:07.412 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:01:41 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:07.976 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-04-19T23:43:09.038 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:43:09.038 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:09.039 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-04-19T23:43:09.039 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:09.039 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:43:09.039 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 3.5 M 2024-04-19T23:43:09.039 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-04-19T23:43:09.039 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 24 k 2024-04-19T23:43:09.039 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 15 k 2024-04-19T23:43:09.039 INFO:teuthology.orchestra.run.smithi076.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-19T23:43:09.039 INFO:teuthology.orchestra.run.smithi076.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-19T23:43:09.039 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:09.039 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:43:09.040 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:09.040 INFO:teuthology.orchestra.run.smithi076.stdout:Install 5 Packages 2024-04-19T23:43:09.040 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:09.040 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 3.8 M 2024-04-19T23:43:09.040 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 87 M 2024-04-19T23:43:09.040 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:43:09.257 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-19T23:43:09.505 INFO:teuthology.orchestra.run.smithi076.stdout:(1/5): ceph-prometheus-alerts-18.2.2-1237.g646b 52 kB/s | 15 kB 00:00 2024-04-19T23:43:09.580 INFO:teuthology.orchestra.run.smithi076.stdout:(2/5): ceph-grafana-dashboards-18.2.2-1237.g646 66 kB/s | 24 kB 00:00 2024-04-19T23:43:09.764 INFO:teuthology.orchestra.run.smithi076.stdout:(3/5): python3-repoze-lru-0.7-6.el8.noarch.rpm 130 kB/s | 34 kB 00:00 2024-04-19T23:43:09.972 INFO:teuthology.orchestra.run.smithi076.stdout:(4/5): python3-routes-2.4.1-12.el8.noarch.rpm 501 kB/s | 196 kB 00:00 2024-04-19T23:43:09.998 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-19T23:43:10.308 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-19T23:43:10.397 INFO:teuthology.orchestra.run.smithi076.stdout:(5/5): ceph-mgr-dashboard-18.2.2-1237.g646b8c7d 3.0 MB/s | 3.5 MB 00:01 2024-04-19T23:43:10.399 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:10.399 INFO:teuthology.orchestra.run.smithi076.stdout:Total 2.8 MB/s | 3.8 MB 00:01 2024-04-19T23:43:10.400 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:43:10.408 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:43:10.408 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:43:10.489 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:43:10.492 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:43:10.531 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-19T23:43:10.718 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:43:10.912 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/5 2024-04-19T23:43:11.116 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/5 2024-04-19T23:43:11.262 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.n 3/5 2024-04-19T23:43:12.288 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-19T23:43:12.407 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8. 4/5 2024-04-19T23:43:12.639 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarc 5/5 2024-04-19T23:43:12.920 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarc 5/5 2024-04-19T23:43:12.920 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8. 1/5 2024-04-19T23:43:12.920 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarc 2/5 2024-04-19T23:43:12.920 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.n 3/5 2024-04-19T23:43:12.920 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/5 2024-04-19T23:43:13.311 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/5 2024-04-19T23:43:13.311 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:13.311 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:43:13.311 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:43:13.311 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:43:13.311 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:43:13.311 INFO:teuthology.orchestra.run.smithi076.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-19T23:43:13.311 INFO:teuthology.orchestra.run.smithi076.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-19T23:43:13.311 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:13.312 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:43:13.448 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-19T23:43:13.521 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-04-19T23:43:13.746 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7 8/8 2024-04-19T23:43:14.064 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7 8/8 2024-04-19T23:43:14.064 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7 1/8 2024-04-19T23:43:14.064 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-04-19T23:43:14.065 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-04-19T23:43:14.065 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-19T23:43:14.065 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-19T23:43:14.065 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-04-19T23:43:14.065 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-04-19T23:43:14.183 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:01:48 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-04-19T23:43:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:14.463 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:43:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:43:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-19T23:43:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-19T23:43:14.463 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-19T23:43:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-19T23:43:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-19T23:43:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-19T23:43:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-19T23:43:14.464 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:14.464 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:43:14.599 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-rook 2024-04-19T23:43:15.332 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:49 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:15.835 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:43:15.836 INFO:teuthology.orchestra.run.smithi076.stdout:============================================================================================ 2024-04-19T23:43:15.836 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-04-19T23:43:15.836 INFO:teuthology.orchestra.run.smithi076.stdout:============================================================================================ 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 7.4 M 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout:============================================================================================ 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout:Install 8 Packages 2024-04-19T23:43:15.837 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:15.838 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 36 M 2024-04-19T23:43:15.838 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 210 M 2024-04-19T23:43:15.838 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:43:16.967 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 49 k 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-19T23:43:16.969 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout:Install 14 Packages 2024-04-19T23:43:16.970 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:16.971 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 2.0 M 2024-04-19T23:43:16.971 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 25 M 2024-04-19T23:43:16.971 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:43:17.258 INFO:teuthology.orchestra.run.smithi076.stdout:(1/8): ceph-mgr-diskprediction-local-18.2.2-123 6.3 MB/s | 7.4 MB 00:01 2024-04-19T23:43:17.333 INFO:teuthology.orchestra.run.smithi076.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 3.8 MB/s | 4.7 MB 00:01 2024-04-19T23:43:17.433 INFO:teuthology.orchestra.run.smithi076.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.2 MB/s | 225 kB 00:00 2024-04-19T23:43:17.723 INFO:teuthology.orchestra.run.smithi155.stdout:(1/14): python3-jsonpointer-1.10-11.el8.noarch. 168 kB/s | 20 kB 00:00 2024-04-19T23:43:17.748 INFO:teuthology.orchestra.run.smithi155.stdout:(2/14): python3-jsonpatch-1.21-2.el8.noarch.rpm 184 kB/s | 27 kB 00:00 2024-04-19T23:43:17.857 INFO:teuthology.orchestra.run.smithi155.stdout:(3/14): python3-pyasn1-0.3.7-6.el8.noarch.rpm 947 kB/s | 126 kB 00:00 2024-04-19T23:43:17.883 INFO:teuthology.orchestra.run.smithi155.stdout:(4/14): python3-pyasn1-modules-0.3.7-6.el8.noar 821 kB/s | 110 kB 00:00 2024-04-19T23:43:17.908 INFO:teuthology.orchestra.run.smithi076.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 5.7 MB/s | 3.7 MB 00:00 2024-04-19T23:43:17.941 INFO:teuthology.orchestra.run.smithi155.stdout:(5/14): ceph-mgr-rook-18.2.2-1237.g646b8c7d.el8 146 kB/s | 49 kB 00:00 2024-04-19T23:43:18.001 INFO:teuthology.orchestra.run.smithi076.stdout:(5/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 2.5 MB/s | 4.9 MB 00:01 2024-04-19T23:43:18.050 INFO:teuthology.orchestra.run.smithi155.stdout:(6/14): python3-jwt-1.6.1-2.el8.noarch.rpm 221 kB/s | 43 kB 00:00 2024-04-19T23:43:18.075 INFO:teuthology.orchestra.run.smithi155.stdout:(7/14): python3-requests-oauthlib-1.0.0-1.el8.n 319 kB/s | 43 kB 00:00 2024-04-19T23:43:18.101 INFO:teuthology.orchestra.run.smithi155.stdout:(8/14): python3-oauthlib-2.1.0-1.el8.noarch.rpm 712 kB/s | 155 kB 00:00 2024-04-19T23:43:18.168 INFO:teuthology.orchestra.run.smithi076.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2024-04-19T23:43:18.193 INFO:teuthology.orchestra.run.smithi155.stdout:(9/14): python3-cachetools-3.1.1-4.el8.noarch.r 232 kB/s | 33 kB 00:00 2024-04-19T23:43:18.218 INFO:teuthology.orchestra.run.smithi076.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.0 MB/s | 645 kB 00:00 2024-04-19T23:43:18.218 INFO:teuthology.orchestra.run.smithi155.stdout:(10/14): python3-certifi-2018.10.15-7.el8.noarc 114 kB/s | 16 kB 00:00 2024-04-19T23:43:18.252 INFO:teuthology.orchestra.run.smithi155.stdout:(11/14): python3-google-auth-1.1.1-10.el8.noarc 538 kB/s | 81 kB 00:00 2024-04-19T23:43:18.336 INFO:teuthology.orchestra.run.smithi155.stdout:(12/14): python3-rsa-4.9-2.el8.noarch.rpm 572 kB/s | 64 kB 00:00 2024-04-19T23:43:18.361 INFO:teuthology.orchestra.run.smithi155.stdout:(13/14): python3-websocket-client-0.56.0-5.el8. 594 kB/s | 61 kB 00:00 2024-04-19T23:43:18.544 INFO:teuthology.orchestra.run.smithi155.stdout:(14/14): python3-kubernetes-11.0.0-6.el8.noarch 3.3 MB/s | 1.2 MB 00:00 2024-04-19T23:43:18.545 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:18.546 INFO:teuthology.orchestra.run.smithi155.stdout:Total 1.3 MB/s | 2.0 MB 00:01 2024-04-19T23:43:18.610 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:43:18.626 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:43:18.626 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:43:18.716 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:43:18.719 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:43:19.085 INFO:teuthology.orchestra.run.smithi076.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 8.6 MB/s | 14 MB 00:01 2024-04-19T23:43:19.085 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:19.086 INFO:teuthology.orchestra.run.smithi076.stdout:Total 11 MB/s | 36 MB 00:03 2024-04-19T23:43:19.265 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:43:19.320 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:43:19.338 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:43:19.339 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:43:19.539 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/14 2024-04-19T23:43:19.728 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/14 2024-04-19T23:43:19.739 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:43:19.743 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:43:19.964 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/14 2024-04-19T23:43:20.184 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/14 2024-04-19T23:43:20.340 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:43:20.391 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/14 2024-04-19T23:43:20.617 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/14 2024-04-19T23:43:20.847 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/14 2024-04-19T23:43:21.127 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 8/14 2024-04-19T23:43:21.263 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-19T23:43:21.389 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-19T23:43:21.417 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 9/14 2024-04-19T23:43:21.537 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-19T23:43:22.137 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-19T23:43:22.312 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-04-19T23:43:22.447 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 10/14 2024-04-19T23:43:22.667 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 11/14 2024-04-19T23:43:22.861 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 12/14 2024-04-19T23:43:22.930 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-04-19T23:43:23.062 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-19T23:43:23.071 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 13/14 2024-04-19T23:43:23.302 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 14/14 2024-04-19T23:43:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 14/14 2024-04-19T23:43:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 1/14 2024-04-19T23:43:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/14 2024-04-19T23:43:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/14 2024-04-19T23:43:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/14 2024-04-19T23:43:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/14 2024-04-19T23:43:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/14 2024-04-19T23:43:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 7/14 2024-04-19T23:43:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 8/14 2024-04-19T23:43:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 9/14 2024-04-19T23:43:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 10/14 2024-04-19T23:43:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 11/14 2024-04-19T23:43:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 12/14 2024-04-19T23:43:23.607 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 13/14 2024-04-19T23:43:23.766 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-19T23:43:24.088 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 14/14 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-19T23:43:24.089 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-19T23:43:24.090 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-19T23:43:24.090 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-19T23:43:24.090 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:24.090 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:43:24.099 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-19T23:43:24.209 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-cephadm 2024-04-19T23:43:24.362 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-19T23:43:24.940 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:58 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:26.116 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-19T23:43:26.592 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:43:26.593 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:26.593 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-19T23:43:26.593 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:26.593 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:43:26.593 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 138 k 2024-04-19T23:43:26.593 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-19T23:43:26.593 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-19T23:43:26.593 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-19T23:43:26.594 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-19T23:43:26.594 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-19T23:43:26.594 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:26.594 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:43:26.594 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:26.594 INFO:teuthology.orchestra.run.smithi155.stdout:Install 5 Packages 2024-04-19T23:43:26.594 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:26.595 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 6.0 M 2024-04-19T23:43:26.595 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 26 M 2024-04-19T23:43:26.595 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:43:27.279 INFO:teuthology.orchestra.run.smithi155.stdout:(1/5): python3-jinja2-2.10.1-4.el8.noarch.rpm 2.1 MB/s | 578 kB 00:00 2024-04-19T23:43:27.304 INFO:teuthology.orchestra.run.smithi155.stdout:(2/5): ceph-mgr-cephadm-18.2.2-1237.g646b8c7d.e 460 kB/s | 138 kB 00:00 2024-04-19T23:43:27.328 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-04-19T23:43:27.549 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7 8/8 2024-04-19T23:43:27.688 INFO:teuthology.orchestra.run.smithi155.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 7.0 MB/s | 4.8 MB 00:00 2024-04-19T23:43:27.796 INFO:teuthology.orchestra.run.smithi155.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 122 kB/s | 60 kB 00:00 2024-04-19T23:43:27.860 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7 8/8 2024-04-19T23:43:27.860 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7 1/8 2024-04-19T23:43:27.860 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-04-19T23:43:27.860 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-04-19T23:43:27.860 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-19T23:43:27.860 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-19T23:43:27.860 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-04-19T23:43:27.860 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-04-19T23:43:28.061 INFO:teuthology.orchestra.run.smithi155.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 609 kB/s | 476 kB 00:00 2024-04-19T23:43:28.063 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:28.063 INFO:teuthology.orchestra.run.smithi155.stdout:Total 4.1 MB/s | 6.0 MB 00:01 2024-04-19T23:43:28.114 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:43:28.125 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:43:28.125 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:43:28.226 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:43:28.229 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:28.268 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:43:28.431 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-mgr-rook 2024-04-19T23:43:28.489 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:43:28.839 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2024-04-19T23:43:29.156 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:03 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:29.831 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2024-04-19T23:43:30.805 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:43:30.806 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:30.806 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-04-19T23:43:30.806 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 49 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-19T23:43:30.807 INFO:teuthology.orchestra.run.smithi076.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-19T23:43:30.808 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:30.808 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:43:30.808 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:30.808 INFO:teuthology.orchestra.run.smithi076.stdout:Install 14 Packages 2024-04-19T23:43:30.808 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:30.808 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 2.0 M 2024-04-19T23:43:30.808 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 25 M 2024-04-19T23:43:30.809 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:43:30.920 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2024-04-19T23:43:31.151 INFO:teuthology.orchestra.run.smithi076.stdout:(1/14): python3-jsonpointer-1.10-11.el8.noarch. 205 kB/s | 20 kB 00:00 2024-04-19T23:43:31.168 INFO:teuthology.orchestra.run.smithi076.stdout:(2/14): python3-jsonpatch-1.21-2.el8.noarch.rpm 233 kB/s | 27 kB 00:00 2024-04-19T23:43:31.212 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 4/5 2024-04-19T23:43:31.251 INFO:teuthology.orchestra.run.smithi076.stdout:(3/14): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.3 MB/s | 126 kB 00:00 2024-04-19T23:43:31.277 INFO:teuthology.orchestra.run.smithi076.stdout:(4/14): python3-pyasn1-modules-0.3.7-6.el8.noar 1.0 MB/s | 110 kB 00:00 2024-04-19T23:43:31.435 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 5/5 2024-04-19T23:43:31.642 INFO:teuthology.orchestra.run.smithi076.stdout:(5/14): python3-jwt-1.6.1-2.el8.noarch.rpm 109 kB/s | 43 kB 00:00 2024-04-19T23:43:31.661 INFO:teuthology.orchestra.run.smithi076.stdout:(6/14): ceph-mgr-rook-18.2.2-1237.g646b8c7d.el8 81 kB/s | 49 kB 00:00 2024-04-19T23:43:31.686 INFO:teuthology.orchestra.run.smithi076.stdout:(7/14): python3-oauthlib-2.1.0-1.el8.noarch.rpm 379 kB/s | 155 kB 00:00 2024-04-19T23:43:31.720 INFO:teuthology.orchestra.run.smithi076.stdout:(8/14): python3-requests-oauthlib-1.0.0-1.el8.n 545 kB/s | 43 kB 00:00 2024-04-19T23:43:31.727 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 5/5 2024-04-19T23:43:31.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 1/5 2024-04-19T23:43:31.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2024-04-19T23:43:31.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/5 2024-04-19T23:43:31.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2024-04-19T23:43:32.054 INFO:teuthology.orchestra.run.smithi076.stdout:(9/14): python3-certifi-2018.10.15-7.el8.noarch 44 kB/s | 16 kB 00:00 2024-04-19T23:43:32.106 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2024-04-19T23:43:32.106 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:32.106 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:43:32.106 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:43:32.106 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-19T23:43:32.107 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-19T23:43:32.107 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-19T23:43:32.107 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-19T23:43:32.107 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:32.107 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:43:32.171 INFO:teuthology.orchestra.run.smithi076.stdout:(10/14): python3-cachetools-3.1.1-4.el8.noarch. 65 kB/s | 33 kB 00:00 2024-04-19T23:43:32.225 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-fuse 2024-04-19T23:43:32.338 INFO:teuthology.orchestra.run.smithi076.stdout:(11/14): python3-google-auth-1.1.1-10.el8.noarc 132 kB/s | 81 kB 00:00 2024-04-19T23:43:32.430 INFO:teuthology.orchestra.run.smithi076.stdout:(12/14): python3-rsa-4.9-2.el8.noarch.rpm 248 kB/s | 64 kB 00:00 2024-04-19T23:43:32.605 INFO:teuthology.orchestra.run.smithi076.stdout:(13/14): python3-websocket-client-0.56.0-5.el8. 229 kB/s | 61 kB 00:00 2024-04-19T23:43:32.960 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:06 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:34.584 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:43:34.585 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:34.585 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-19T23:43:34.585 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:34.585 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:43:34.585 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 859 k 2024-04-19T23:43:34.585 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-19T23:43:34.585 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-19T23:43:34.585 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:34.585 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:43:34.586 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:34.586 INFO:teuthology.orchestra.run.smithi155.stdout:Install 2 Packages 2024-04-19T23:43:34.586 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:34.586 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 943 k 2024-04-19T23:43:34.586 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 3.0 M 2024-04-19T23:43:34.586 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:43:34.780 INFO:teuthology.orchestra.run.smithi076.stdout:(14/14): python3-kubernetes-11.0.0-6.el8.noarch 438 kB/s | 1.2 MB 00:02 2024-04-19T23:43:34.781 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:34.781 INFO:teuthology.orchestra.run.smithi076.stdout:Total 509 kB/s | 2.0 MB 00:03 2024-04-19T23:43:34.840 INFO:teuthology.orchestra.run.smithi155.stdout:(1/2): fuse-2.9.7-19.el8.x86_64.rpm 456 kB/s | 83 kB 00:00 2024-04-19T23:43:34.841 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:43:34.856 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:43:34.856 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:43:34.942 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:43:34.945 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:43:35.506 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:43:35.507 INFO:teuthology.orchestra.run.smithi155.stdout:(2/2): ceph-fuse-18.2.2-1237.g646b8c7d.el8.x86_ 1.0 MB/s | 859 kB 00:00 2024-04-19T23:43:35.508 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:35.508 INFO:teuthology.orchestra.run.smithi155.stdout:Total 1.0 MB/s | 943 kB 00:00 2024-04-19T23:43:35.519 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:43:35.542 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:43:35.542 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:43:35.630 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:43:35.634 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:43:35.729 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/14 2024-04-19T23:43:35.797 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:43:35.910 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/14 2024-04-19T23:43:36.067 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-19T23:43:36.146 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/14 2024-04-19T23:43:36.294 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/2 2024-04-19T23:43:36.417 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/14 2024-04-19T23:43:36.624 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/14 2024-04-19T23:43:36.681 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/2 2024-04-19T23:43:36.681 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/2 2024-04-19T23:43:36.863 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/14 2024-04-19T23:43:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-19T23:43:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:37.111 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:43:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-19T23:43:37.111 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:37.111 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:43:37.128 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/14 2024-04-19T23:43:37.327 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-volume 2024-04-19T23:43:37.422 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 8/14 2024-04-19T23:43:37.672 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 9/14 2024-04-19T23:43:38.076 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:12 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:38.694 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 10/14 2024-04-19T23:43:38.950 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 11/14 2024-04-19T23:43:39.184 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 12/14 2024-04-19T23:43:39.388 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 13/14 2024-04-19T23:43:39.568 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 14/14 2024-04-19T23:43:39.698 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 263 k 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout:Install 2 Packages 2024-04-19T23:43:39.699 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:39.700 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 311 k 2024-04-19T23:43:39.700 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 1.4 M 2024-04-19T23:43:39.700 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:43:39.821 INFO:teuthology.orchestra.run.smithi155.stdout:(1/2): python3-packaging-16.8-9.el8.noarch.rpm 754 kB/s | 48 kB 00:00 2024-04-19T23:43:39.854 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 14/14 2024-04-19T23:43:39.854 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 1/14 2024-04-19T23:43:39.854 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/14 2024-04-19T23:43:39.854 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/14 2024-04-19T23:43:39.854 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/14 2024-04-19T23:43:39.854 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/14 2024-04-19T23:43:39.855 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/14 2024-04-19T23:43:39.855 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 7/14 2024-04-19T23:43:39.855 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 8/14 2024-04-19T23:43:39.855 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 9/14 2024-04-19T23:43:39.855 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 10/14 2024-04-19T23:43:39.855 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 11/14 2024-04-19T23:43:39.855 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 12/14 2024-04-19T23:43:39.855 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 13/14 2024-04-19T23:43:40.321 INFO:teuthology.orchestra.run.smithi155.stdout:(2/2): ceph-volume-18.2.2-1237.g646b8c7d.el8.no 466 kB/s | 263 kB 00:00 2024-04-19T23:43:40.321 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:40.321 INFO:teuthology.orchestra.run.smithi155.stdout:Total 500 kB/s | 311 kB 00:00 2024-04-19T23:43:40.331 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:43:40.333 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 14/14 2024-04-19T23:43:40.333 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:40.333 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:43:40.333 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:43:40.333 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-19T23:43:40.333 INFO:teuthology.orchestra.run.smithi076.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-19T23:43:40.333 INFO:teuthology.orchestra.run.smithi076.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-19T23:43:40.333 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-19T23:43:40.333 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-19T23:43:40.333 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-19T23:43:40.333 INFO:teuthology.orchestra.run.smithi076.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-19T23:43:40.334 INFO:teuthology.orchestra.run.smithi076.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-19T23:43:40.334 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-19T23:43:40.334 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-19T23:43:40.334 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-19T23:43:40.334 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-19T23:43:40.334 INFO:teuthology.orchestra.run.smithi076.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-19T23:43:40.334 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:40.334 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:43:40.344 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:43:40.344 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:43:40.391 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:43:40.394 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:43:40.454 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-mgr-cephadm 2024-04-19T23:43:40.523 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:43:40.823 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-packaging-16.8-9.el8.noarch 1/2 2024-04-19T23:43:41.092 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2/2 2024-04-19T23:43:41.180 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:15 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:41.505 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2/2 2024-04-19T23:43:41.505 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 1/2 2024-04-19T23:43:42.306 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 2/2 2024-04-19T23:43:42.306 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:42.306 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:43:42.306 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:43:42.306 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-19T23:43:42.306 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:42.306 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:43:42.815 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:43:42.815 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 138 k 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:42.816 INFO:teuthology.orchestra.run.smithi076.stdout:Install 5 Packages 2024-04-19T23:43:42.817 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:42.817 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 6.0 M 2024-04-19T23:43:42.817 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 26 M 2024-04-19T23:43:42.817 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:43:43.315 INFO:teuthology.orchestra.run.smithi076.stdout:(1/5): python3-jinja2-2.10.1-4.el8.noarch.rpm 3.1 MB/s | 578 kB 00:00 2024-04-19T23:43:43.465 INFO:teuthology.orchestra.run.smithi076.stdout:(2/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 3.1 MB/s | 476 kB 00:00 2024-04-19T23:43:43.516 INFO:teuthology.orchestra.run.smithi076.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 1.2 MB/s | 60 kB 00:00 2024-04-19T23:43:43.800 INFO:teuthology.orchestra.run.smithi076.stdout:(4/5): python3-babel-2.5.1-7.el8.noarch.rpm 7.2 MB/s | 4.8 MB 00:00 2024-04-19T23:43:43.825 INFO:teuthology.orchestra.run.smithi076.stdout:(5/5): ceph-mgr-cephadm-18.2.2-1237.g646b8c7d.e 200 kB/s | 138 kB 00:00 2024-04-19T23:43:43.826 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:43.826 INFO:teuthology.orchestra.run.smithi076.stdout:Total 6.0 MB/s | 6.0 MB 00:01 2024-04-19T23:43:43.877 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:43:43.888 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:43:43.888 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:43:43.986 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:43:43.989 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:43:44.106 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librados-devel 2024-04-19T23:43:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:43:44.641 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2024-04-19T23:43:44.861 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:18 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:45.597 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2024-04-19T23:43:45.948 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2024-04-19T23:43:46.243 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 4/5 2024-04-19T23:43:46.485 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 5/5 2024-04-19T23:43:46.497 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:43:46.497 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:46.497 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2024-04-19T23:43:46.497 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:46.498 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:43:46.498 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 139 k 2024-04-19T23:43:46.498 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:46.498 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:43:46.498 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:46.498 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-04-19T23:43:46.498 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:46.499 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 139 k 2024-04-19T23:43:46.499 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 513 k 2024-04-19T23:43:46.499 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:43:46.769 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 5/5 2024-04-19T23:43:46.769 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 1/5 2024-04-19T23:43:46.769 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2024-04-19T23:43:46.769 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/5 2024-04-19T23:43:46.769 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2024-04-19T23:43:46.823 INFO:teuthology.orchestra.run.smithi155.stdout:librados-devel-18.2.2-1237.g646b8c7d.el8.x86_64 428 kB/s | 139 kB 00:00 2024-04-19T23:43:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:Total 427 kB/s | 139 kB 00:00 2024-04-19T23:43:46.824 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:43:46.830 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:43:46.830 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:43:46.881 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:43:46.883 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:43:46.992 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:43:47.169 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2024-04-19T23:43:47.170 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:47.170 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:43:47.170 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:43:47.170 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-19T23:43:47.170 INFO:teuthology.orchestra.run.smithi076.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-19T23:43:47.170 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-19T23:43:47.170 INFO:teuthology.orchestra.run.smithi076.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-19T23:43:47.170 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:47.170 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:43:47.217 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:43:47.315 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-fuse 2024-04-19T23:43:47.512 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:43:47.876 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:43:47.876 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:47.876 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:43:47.876 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:43:47.876 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:47.876 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:43:48.050 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:22 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:48.095 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install libcephfs2 2024-04-19T23:43:48.841 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:22 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:49.681 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:43:49.682 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:49.682 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-04-19T23:43:49.682 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:49.682 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:43:49.682 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 859 k 2024-04-19T23:43:49.682 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-04-19T23:43:49.682 INFO:teuthology.orchestra.run.smithi076.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-19T23:43:49.682 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:49.683 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:43:49.683 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:49.683 INFO:teuthology.orchestra.run.smithi076.stdout:Install 2 Packages 2024-04-19T23:43:49.683 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:49.683 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 943 k 2024-04-19T23:43:49.683 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 3.0 M 2024-04-19T23:43:49.683 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:43:49.971 INFO:teuthology.orchestra.run.smithi076.stdout:(1/2): fuse-2.9.7-19.el8.x86_64.rpm 361 kB/s | 83 kB 00:00 2024-04-19T23:43:50.422 INFO:teuthology.orchestra.run.smithi155.stdout:Package libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:43:50.471 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:43:50.472 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-19T23:43:50.472 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:43:50.483 INFO:teuthology.orchestra.run.smithi076.stdout:(2/2): ceph-fuse-18.2.2-1237.g646b8c7d.el8.x86_ 1.1 MB/s | 859 kB 00:00 2024-04-19T23:43:50.484 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:50.484 INFO:teuthology.orchestra.run.smithi076.stdout:Total 1.1 MB/s | 943 kB 00:00 2024-04-19T23:43:50.494 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:43:50.516 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:43:50.516 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:43:50.568 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install libcephfs-devel 2024-04-19T23:43:50.602 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:43:50.605 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:43:50.769 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:43:51.109 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-19T23:43:51.292 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/2 2024-04-19T23:43:51.303 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:25 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:51.671 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/2 2024-04-19T23:43:51.671 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/2 2024-04-19T23:43:52.049 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-19T23:43:52.049 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:52.050 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:43:52.050 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-19T23:43:52.050 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:52.050 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:43:52.263 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-volume 2024-04-19T23:43:52.948 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:43:52.949 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:52.949 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2024-04-19T23:43:52.949 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:52.949 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:43:52.949 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 31 k 2024-04-19T23:43:52.949 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:52.949 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:43:52.949 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:43:52.949 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-04-19T23:43:52.949 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:52.950 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 31 k 2024-04-19T23:43:52.950 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 139 k 2024-04-19T23:43:52.950 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:43:53.002 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:27 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:53.102 INFO:teuthology.orchestra.run.smithi155.stdout:libcephfs-devel-18.2.2-1237.g646b8c7d.el8.x86_6 204 kB/s | 31 kB 00:00 2024-04-19T23:43:53.103 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:53.103 INFO:teuthology.orchestra.run.smithi155.stdout:Total 202 kB/s | 31 kB 00:00 2024-04-19T23:43:53.103 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:43:53.106 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:43:53.106 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:43:53.129 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:43:53.132 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:43:53.190 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:43:53.388 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:43:53.656 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:43:54.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:43:54.006 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:54.006 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:43:54.007 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:43:54.007 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:43:54.007 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:43:54.121 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librados2 2024-04-19T23:43:54.662 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:43:54.663 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:54.663 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-04-19T23:43:54.663 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:54.663 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:43:54.663 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-volume noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 263 k 2024-04-19T23:43:54.663 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-04-19T23:43:54.663 INFO:teuthology.orchestra.run.smithi076.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-19T23:43:54.663 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:54.663 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:43:54.663 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:54.663 INFO:teuthology.orchestra.run.smithi076.stdout:Install 2 Packages 2024-04-19T23:43:54.664 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:54.664 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 311 k 2024-04-19T23:43:54.664 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 1.4 M 2024-04-19T23:43:54.664 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:43:54.857 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:28 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:54.948 INFO:teuthology.orchestra.run.smithi076.stdout:(1/2): python3-packaging-16.8-9.el8.noarch.rpm 245 kB/s | 48 kB 00:00 2024-04-19T23:43:55.356 INFO:teuthology.orchestra.run.smithi076.stdout:(2/2): ceph-volume-18.2.2-1237.g646b8c7d.el8.no 435 kB/s | 263 kB 00:00 2024-04-19T23:43:55.357 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:43:55.357 INFO:teuthology.orchestra.run.smithi076.stdout:Total 449 kB/s | 311 kB 00:00 2024-04-19T23:43:55.366 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:43:55.378 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:43:55.379 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:43:55.424 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:43:55.427 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:43:55.562 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:43:55.873 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-packaging-16.8-9.el8.noarch 1/2 2024-04-19T23:43:56.125 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2/2 2024-04-19T23:43:56.440 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:43:56.489 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:43:56.490 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-19T23:43:56.491 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:43:56.522 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2/2 2024-04-19T23:43:56.522 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 1/2 2024-04-19T23:43:56.595 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librbd1 2024-04-19T23:43:56.948 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 2/2 2024-04-19T23:43:56.948 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:56.948 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:43:56.948 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T23:43:56.948 INFO:teuthology.orchestra.run.smithi076.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-19T23:43:56.948 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:56.948 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:43:57.209 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install librados-devel 2024-04-19T23:43:57.338 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:31 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:57.952 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:31 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:43:58.900 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:43:58.948 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:43:58.949 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-19T23:43:58.949 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:43:59.086 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rados 2024-04-19T23:43:59.595 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:43:59.596 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:59.596 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repo Size 2024-04-19T23:43:59.596 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:59.596 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:43:59.596 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 139 k 2024-04-19T23:43:59.596 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:59.596 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:43:59.596 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:43:59.596 INFO:teuthology.orchestra.run.smithi076.stdout:Install 1 Package 2024-04-19T23:43:59.596 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:43:59.597 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 139 k 2024-04-19T23:43:59.597 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 513 k 2024-04-19T23:43:59.597 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:43:59.818 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:33 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:00.140 INFO:teuthology.orchestra.run.smithi076.stdout:librados-devel-18.2.2-1237.g646b8c7d.el8.x86_64 256 kB/s | 139 kB 00:00 2024-04-19T23:44:00.140 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:44:00.141 INFO:teuthology.orchestra.run.smithi076.stdout:Total 256 kB/s | 139 kB 00:00 2024-04-19T23:44:00.141 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:44:00.147 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:44:00.147 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:44:00.199 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:44:00.202 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:44:00.316 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:44:00.540 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:00.824 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:01.220 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:01.220 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:01.220 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:44:01.221 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:44:01.221 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:01.221 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:01.407 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:44:01.454 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:44:01.456 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-19T23:44:01.456 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:44:01.463 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install libcephfs2 2024-04-19T23:44:01.562 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rgw 2024-04-19T23:44:02.204 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:36 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:02.302 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:36 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:03.779 INFO:teuthology.orchestra.run.smithi076.stdout:Package libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:44:03.827 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:44:03.828 INFO:teuthology.orchestra.run.smithi076.stdout:Nothing to do. 2024-04-19T23:44:03.828 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:03.912 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:44:03.936 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install libcephfs-devel 2024-04-19T23:44:03.960 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:44:03.961 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-19T23:44:03.961 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:44:04.067 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-cephfs 2024-04-19T23:44:04.675 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:38 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:04.802 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:38 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:06.308 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:44:06.309 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repo Size 2024-04-19T23:44:06.309 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:06.309 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:44:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 31 k 2024-04-19T23:44:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:06.309 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:44:06.309 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:06.309 INFO:teuthology.orchestra.run.smithi076.stdout:Install 1 Package 2024-04-19T23:44:06.309 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:06.310 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 31 k 2024-04-19T23:44:06.310 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 139 k 2024-04-19T23:44:06.310 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:44:06.407 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:44:06.455 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:44:06.456 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-19T23:44:06.456 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:44:06.460 INFO:teuthology.orchestra.run.smithi076.stdout:libcephfs-devel-18.2.2-1237.g646b8c7d.el8.x86_6 206 kB/s | 31 kB 00:00 2024-04-19T23:44:06.460 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:44:06.461 INFO:teuthology.orchestra.run.smithi076.stdout:Total 204 kB/s | 31 kB 00:00 2024-04-19T23:44:06.461 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:44:06.465 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:44:06.465 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:44:06.485 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:44:06.488 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:44:06.548 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:44:06.561 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rbd 2024-04-19T23:44:06.731 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:06.997 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:07.294 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:41 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:07.347 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:44:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:44:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:07.348 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:07.470 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install librados2 2024-04-19T23:44:08.219 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:42 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:08.988 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:44:09.035 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:44:09.037 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-19T23:44:09.037 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:44:09.140 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-fuse 2024-04-19T23:44:09.811 INFO:teuthology.orchestra.run.smithi076.stdout:Package librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:44:09.860 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:44:09.861 INFO:teuthology.orchestra.run.smithi076.stdout:Nothing to do. 2024-04-19T23:44:09.861 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:09.877 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:43 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:09.975 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install librbd1 2024-04-19T23:44:10.709 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:44 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:11.513 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:44:11.514 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:44:11.514 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2024-04-19T23:44:11.514 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:44:11.514 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:44:11.514 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 95 k 2024-04-19T23:44:11.514 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:11.514 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:44:11.515 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:44:11.515 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-04-19T23:44:11.515 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:11.515 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 95 k 2024-04-19T23:44:11.515 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 280 k 2024-04-19T23:44:11.515 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:44:11.970 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-fuse-18.2.2-1237.g646b8c7d.el8.x86_64.rpm 209 kB/s | 95 kB 00:00 2024-04-19T23:44:11.970 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:44:11.970 INFO:teuthology.orchestra.run.smithi155.stdout:Total 209 kB/s | 95 kB 00:00 2024-04-19T23:44:11.970 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:44:11.981 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:44:11.981 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:44:12.030 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:44:12.033 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:44:12.140 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:44:12.301 INFO:teuthology.orchestra.run.smithi076.stdout:Package librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:44:12.344 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:12.348 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:44:12.350 INFO:teuthology.orchestra.run.smithi076.stdout:Nothing to do. 2024-04-19T23:44:12.350 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:12.466 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install python3-rados 2024-04-19T23:44:12.658 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:13.015 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:13.016 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:44:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:44:13.016 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:13.016 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:44:13.197 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:47 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:13.211 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-mirror 2024-04-19T23:44:13.958 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:47 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:14.791 INFO:teuthology.orchestra.run.smithi076.stdout:Package python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:44:14.840 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:44:14.841 INFO:teuthology.orchestra.run.smithi076.stdout:Nothing to do. 2024-04-19T23:44:14.841 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:14.944 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install python3-rgw 2024-04-19T23:44:15.595 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:44:15.595 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:44:15.595 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2024-04-19T23:44:15.595 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:44:15.596 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:44:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.5 M 2024-04-19T23:44:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:15.596 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:44:15.596 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:44:15.596 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-04-19T23:44:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:15.596 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 3.5 M 2024-04-19T23:44:15.596 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 16 M 2024-04-19T23:44:15.596 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:44:15.676 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:49 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-mirror-18.2.2-1237.g646b8c7d.el8.x86_64.rpm 8.7 MB/s | 3.5 MB 00:00 2024-04-19T23:44:15.991 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:44:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:Total 8.7 MB/s | 3.5 MB 00:00 2024-04-19T23:44:15.992 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:44:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:44:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:44:16.066 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:44:16.069 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:44:16.612 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:44:16.795 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:17.209 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:17.262 INFO:teuthology.orchestra.run.smithi076.stdout:Package python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:44:17.310 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:44:17.311 INFO:teuthology.orchestra.run.smithi076.stdout:Nothing to do. 2024-04-19T23:44:17.312 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:17.418 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install python3-cephfs 2024-04-19T23:44:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:17.580 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:44:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:44:17.580 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:17.581 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:44:17.797 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-nbd 2024-04-19T23:44:18.160 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:52 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:18.549 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:52 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:19.734 INFO:teuthology.orchestra.run.smithi076.stdout:Package python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:44:19.781 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:44:19.782 INFO:teuthology.orchestra.run.smithi076.stdout:Nothing to do. 2024-04-19T23:44:19.782 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:19.892 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install python3-rbd 2024-04-19T23:44:20.194 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-19T23:44:20.194 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:44:20.194 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2024-04-19T23:44:20.195 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:44:20.195 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-19T23:44:20.195 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 181 k 2024-04-19T23:44:20.195 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:20.195 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-19T23:44:20.195 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-19T23:44:20.195 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-04-19T23:44:20.195 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:20.196 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 181 k 2024-04-19T23:44:20.196 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 572 k 2024-04-19T23:44:20.196 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-19T23:44:20.512 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-nbd-18.2.2-1237.g646b8c7d.el8.x86_64.rpm 574 kB/s | 181 kB 00:00 2024-04-19T23:44:20.512 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:44:20.512 INFO:teuthology.orchestra.run.smithi155.stdout:Total 571 kB/s | 181 kB 00:00 2024-04-19T23:44:20.512 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-19T23:44:20.524 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-19T23:44:20.524 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-19T23:44:20.572 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-19T23:44:20.575 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-19T23:44:20.623 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:54 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:20.692 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-19T23:44:20.901 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:21.195 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:21.629 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:21.629 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:21.629 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-19T23:44:21.630 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:44:21.630 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:21.630 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-19T23:44:21.841 DEBUG:teuthology.parallel:result is None 2024-04-19T23:44:22.215 INFO:teuthology.orchestra.run.smithi076.stdout:Package python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 is already installed. 2024-04-19T23:44:22.262 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:44:22.263 INFO:teuthology.orchestra.run.smithi076.stdout:Nothing to do. 2024-04-19T23:44:22.264 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:22.362 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install rbd-fuse 2024-04-19T23:44:23.098 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:02:57 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:24.704 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:44:24.705 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:24.705 INFO:teuthology.orchestra.run.smithi076.stdout: Package Architecture Version Repository Size 2024-04-19T23:44:24.705 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:24.705 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:44:24.705 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 95 k 2024-04-19T23:44:24.705 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:24.705 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:44:24.705 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:24.705 INFO:teuthology.orchestra.run.smithi076.stdout:Install 1 Package 2024-04-19T23:44:24.705 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:24.706 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 95 k 2024-04-19T23:44:24.706 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 280 k 2024-04-19T23:44:24.706 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:44:24.959 INFO:teuthology.orchestra.run.smithi076.stdout:rbd-fuse-18.2.2-1237.g646b8c7d.el8.x86_64.rpm 376 kB/s | 95 kB 00:00 2024-04-19T23:44:24.960 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:44:24.960 INFO:teuthology.orchestra.run.smithi076.stdout:Total 374 kB/s | 95 kB 00:00 2024-04-19T23:44:24.960 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:44:24.970 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:44:24.970 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:44:25.020 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:44:25.023 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:44:25.125 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:44:25.304 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:25.583 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:25.972 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:25.972 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:25.972 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:44:25.972 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:44:25.972 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:25.972 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:26.185 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install rbd-mirror 2024-04-19T23:44:26.932 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:03:00 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:28.577 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:44:28.577 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:28.577 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repo Size 2024-04-19T23:44:28.577 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:28.578 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:44:28.578 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-mirror x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.5 M 2024-04-19T23:44:28.578 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:28.578 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:44:28.578 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:28.578 INFO:teuthology.orchestra.run.smithi076.stdout:Install 1 Package 2024-04-19T23:44:28.578 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:28.579 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 3.5 M 2024-04-19T23:44:28.579 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 16 M 2024-04-19T23:44:28.579 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:44:29.088 INFO:teuthology.orchestra.run.smithi076.stdout:rbd-mirror-18.2.2-1237.g646b8c7d.el8.x86_64.rpm 6.8 MB/s | 3.5 MB 00:00 2024-04-19T23:44:29.089 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:44:29.089 INFO:teuthology.orchestra.run.smithi076.stdout:Total 6.8 MB/s | 3.5 MB 00:00 2024-04-19T23:44:29.090 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:44:29.102 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:44:29.102 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:44:29.163 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:44:29.166 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:44:29.603 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:44:29.788 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:30.207 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:30.646 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:44:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:44:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:30.646 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:30.862 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install rbd-nbd 2024-04-19T23:44:31.612 INFO:teuthology.orchestra.run.smithi076.stdout:Last metadata expiration check: 0:03:05 ago on Fri 19 Apr 2024 11:41:26 PM UTC. 2024-04-19T23:44:33.242 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-04-19T23:44:33.242 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:33.242 INFO:teuthology.orchestra.run.smithi076.stdout: Package Architecture Version Repository Size 2024-04-19T23:44:33.242 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:33.242 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-04-19T23:44:33.242 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-nbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 181 k 2024-04-19T23:44:33.242 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:33.243 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-04-19T23:44:33.243 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-04-19T23:44:33.243 INFO:teuthology.orchestra.run.smithi076.stdout:Install 1 Package 2024-04-19T23:44:33.243 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:33.243 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 181 k 2024-04-19T23:44:33.243 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 572 k 2024-04-19T23:44:33.243 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-04-19T23:44:33.542 INFO:teuthology.orchestra.run.smithi076.stdout:rbd-nbd-18.2.2-1237.g646b8c7d.el8.x86_64.rpm 607 kB/s | 181 kB 00:00 2024-04-19T23:44:33.543 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-04-19T23:44:33.543 INFO:teuthology.orchestra.run.smithi076.stdout:Total 604 kB/s | 181 kB 00:00 2024-04-19T23:44:33.543 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-04-19T23:44:33.554 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-04-19T23:44:33.554 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-04-19T23:44:33.603 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-04-19T23:44:33.607 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-04-19T23:44:33.733 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-04-19T23:44:33.936 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:34.234 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:34.627 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/1 2024-04-19T23:44:34.628 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:34.628 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-04-19T23:44:34.628 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T23:44:34.628 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:34.628 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-04-19T23:44:34.904 DEBUG:teuthology.parallel:result is None 2024-04-19T23:44:34.905 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T23:44:35.139 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-19T23:44:35.161 INFO:teuthology.orchestra.run.smithi076.stdout:18.2.2-1237.g646b8c7d.el8 2024-04-19T23:44:35.162 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237.g646b8c7d.el8 2024-04-19T23:44:35.163 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237.g646b8c7d is installed. 2024-04-19T23:44:35.166 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T23:44:35.396 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-19T23:44:35.423 INFO:teuthology.orchestra.run.smithi155.stdout:18.2.2-1237.g646b8c7d.el8 2024-04-19T23:44:35.424 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237.g646b8c7d.el8 2024-04-19T23:44:35.424 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237.g646b8c7d is installed. 2024-04-19T23:44:35.425 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-19T23:44:35.426 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:35.426 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T23:44:35.453 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:35.454 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T23:44:35.493 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-19T23:44:35.494 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:35.494 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T23:44:35.520 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T23:44:35.586 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:35.586 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T23:44:35.615 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T23:44:35.684 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-19T23:44:35.684 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:35.684 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T23:44:35.710 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T23:44:35.777 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:35.777 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T23:44:35.806 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T23:44:35.874 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-19T23:44:35.874 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:35.874 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T23:44:35.901 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T23:44:35.968 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:35.968 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T23:44:35.996 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T23:44:36.065 INFO:teuthology.run_tasks:Running task ceph... 2024-04-19T23:44:36.151 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-19T23:44:36.151 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 777 /var/log/ceph 2024-04-19T23:44:36.153 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2024-04-19T23:44:36.181 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-19T23:44:36.181 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T23:44:36.220 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T23:44:36.248 INFO:tasks.ceph:Creating extra log directories... 2024-04-19T23:44:36.248 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T23:44:36.286 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T23:44:36.323 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-19T23:44:36.323 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-19T23:44:36.324 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048', 'branch': 'reef', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7664048', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'wait-for-scrub': False}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 3659, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'targets': {'smithi076.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRptpndLYEzhdJmHrZ9esJiHwvX+0JjAO45LptEvxYn5u31WXUtMCLBzJV3A0knPgPSMhKJ942reozY20A+v10=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO752E6jmqlwthNe6iKcmg0mYKrZeARbTBH2mFvUnNsiCFJmUEPw2JTjXujkUQbtae84l2rwn++hCrzYulPLtz8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'wait-for-scrub': False, 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-19_22:40:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-19T23:44:36.324 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T23:44:36.353 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T23:44:36.374 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T23:44:36.411 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T23:44:36.440 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:36.440 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T23:44:36.494 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T23:44:36.494 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_1 2024-04-19T23:44:36.551 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T23:44:36.551 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T23:44:36.551 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 164620 Links: 1 2024-04-19T23:44:36.552 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T23:44:36.552 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T23:44:36.552 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-04-19 23:44:29.957775987 +0000 2024-04-19T23:44:36.552 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-04-19 23:40:28.447359222 +0000 2024-04-19T23:44:36.552 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-04-19 23:40:28.447359222 +0000 2024-04-19T23:44:36.552 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: - 2024-04-19T23:44:36.552 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T23:44:36.617 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-04-19T23:44:36.617 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-04-19T23:44:36.617 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000273539 s, 1.9 MB/s 2024-04-19T23:44:36.618 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T23:44:36.679 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_2 2024-04-19T23:44:36.737 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T23:44:36.738 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T23:44:36.738 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 170022 Links: 1 2024-04-19T23:44:36.738 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T23:44:36.738 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T23:44:36.738 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-04-19 23:44:29.957775987 +0000 2024-04-19T23:44:36.738 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-04-19 23:40:28.780349503 +0000 2024-04-19T23:44:36.738 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-04-19 23:40:28.780349503 +0000 2024-04-19T23:44:36.738 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: - 2024-04-19T23:44:36.738 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T23:44:36.802 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-04-19T23:44:36.802 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-04-19T23:44:36.802 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000186389 s, 2.7 MB/s 2024-04-19T23:44:36.803 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T23:44:36.862 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_3 2024-04-19T23:44:36.920 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T23:44:36.920 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T23:44:36.920 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 168553 Links: 1 2024-04-19T23:44:36.920 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T23:44:36.920 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T23:44:36.921 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-04-19 23:44:29.957775987 +0000 2024-04-19T23:44:36.921 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-04-19 23:40:29.130339287 +0000 2024-04-19T23:44:36.921 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-04-19 23:40:29.130339287 +0000 2024-04-19T23:44:36.921 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: - 2024-04-19T23:44:36.921 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T23:44:36.986 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-04-19T23:44:36.986 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-04-19T23:44:36.986 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000182604 s, 2.8 MB/s 2024-04-19T23:44:36.987 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T23:44:37.046 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_4 2024-04-19T23:44:37.103 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T23:44:37.104 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T23:44:37.104 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 6h/6d Inode: 166633 Links: 1 2024-04-19T23:44:37.104 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T23:44:37.104 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T23:44:37.104 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-04-19 23:44:29.958775958 +0000 2024-04-19T23:44:37.104 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-04-19 23:40:29.484328955 +0000 2024-04-19T23:44:37.104 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-04-19 23:40:29.484328955 +0000 2024-04-19T23:44:37.104 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: - 2024-04-19T23:44:37.104 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T23:44:37.169 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-04-19T23:44:37.169 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-04-19T23:44:37.169 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000275871 s, 1.9 MB/s 2024-04-19T23:44:37.170 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T23:44:37.229 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T23:44:37.230 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:37.230 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T23:44:37.249 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T23:44:37.249 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-04-19T23:44:37.309 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T23:44:37.309 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T23:44:37.309 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 166468 Links: 1 2024-04-19T23:44:37.309 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T23:44:37.310 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T23:44:37.310 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-19 23:44:16.964045563 +0000 2024-04-19T23:44:37.310 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-19 23:40:28.405895714 +0000 2024-04-19T23:44:37.310 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-19 23:40:28.405895714 +0000 2024-04-19T23:44:37.310 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-04-19T23:44:37.310 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T23:44:37.377 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-19T23:44:37.377 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-19T23:44:37.377 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.00027511 s, 1.9 MB/s 2024-04-19T23:44:37.378 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T23:44:37.439 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-04-19T23:44:37.497 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T23:44:37.498 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T23:44:37.498 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 166561 Links: 1 2024-04-19T23:44:37.498 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T23:44:37.498 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T23:44:37.498 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-19 23:44:16.964045563 +0000 2024-04-19T23:44:37.498 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-19 23:40:28.754888829 +0000 2024-04-19T23:44:37.499 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-19 23:40:28.754888829 +0000 2024-04-19T23:44:37.499 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-04-19T23:44:37.499 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T23:44:37.564 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-19T23:44:37.564 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-19T23:44:37.564 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000215409 s, 2.4 MB/s 2024-04-19T23:44:37.565 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T23:44:37.624 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-04-19T23:44:37.682 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T23:44:37.683 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T23:44:37.683 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 165544 Links: 1 2024-04-19T23:44:37.683 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T23:44:37.683 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T23:44:37.683 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-19 23:44:16.964045563 +0000 2024-04-19T23:44:37.683 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-19 23:40:29.077882457 +0000 2024-04-19T23:44:37.683 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-19 23:40:29.077882457 +0000 2024-04-19T23:44:37.683 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-04-19T23:44:37.685 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T23:44:37.748 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-19T23:44:37.748 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-19T23:44:37.748 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000181341 s, 2.8 MB/s 2024-04-19T23:44:37.749 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T23:44:37.808 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-04-19T23:44:37.866 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T23:44:37.866 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T23:44:37.866 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 168700 Links: 1 2024-04-19T23:44:37.866 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T23:44:37.866 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T23:44:37.866 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-19 23:44:16.964045563 +0000 2024-04-19T23:44:37.866 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-19 23:40:29.452875058 +0000 2024-04-19T23:44:37.866 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-19 23:40:29.452875058 +0000 2024-04-19T23:44:37.866 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-04-19T23:44:37.866 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T23:44:37.931 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-19T23:44:37.931 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-19T23:44:37.931 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000208685 s, 2.5 MB/s 2024-04-19T23:44:37.932 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T23:44:37.990 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-19T23:44:37.991 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi076.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-19T23:44:37.991 INFO:tasks.ceph:Generating config... 2024-04-19T23:44:37.992 INFO:tasks.ceph:[client] debug ms = 1 2024-04-19T23:44:37.992 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-04-19T23:44:37.992 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-19T23:44:37.992 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-19T23:44:37.992 INFO:tasks.ceph:[client] setuser = ceph 2024-04-19T23:44:37.992 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-19T23:44:37.992 INFO:tasks.ceph:[osd] debug objclass = 20 2024-04-19T23:44:37.992 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-19T23:44:37.992 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-19T23:44:37.992 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-19T23:44:37.992 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-19T23:44:37.992 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-19T23:44:37.993 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-19T23:44:37.993 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-19T23:44:37.993 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-19T23:44:37.993 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-19T23:44:37.993 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-19T23:44:37.993 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-19T23:44:37.993 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-19T23:44:37.993 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-19T23:44:37.993 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-19T23:44:37.993 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-19T23:44:37.993 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-19T23:44:37.993 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-19T23:44:37.993 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-19T23:44:37.993 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-19T23:44:37.993 INFO:tasks.ceph:Setting up mon.a... 2024-04-19T23:44:37.994 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-19T23:44:38.050 INFO:teuthology.orchestra.run.smithi076.stdout:creating /etc/ceph/ceph.keyring 2024-04-19T23:44:38.053 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-19T23:44:38.099 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T23:44:38.126 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.76')] 2024-04-19T23:44:38.126 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.76'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-04-19T23:44:38.127 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:38.127 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T23:44:38.184 DEBUG:teuthology.orchestra.run.smithi076:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.76 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-19T23:44:38.266 INFO:teuthology.orchestra.run.smithi076.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:44:38.266 INFO:teuthology.orchestra.run.smithi076.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:44:38.267 INFO:teuthology.orchestra.run.smithi076.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-19T23:44:38.267 INFO:teuthology.orchestra.run.smithi076.stdout:monmaptool: generated fsid b5aadf88-3af0-412d-86c8-081593c483a2 2024-04-19T23:44:38.267 INFO:teuthology.orchestra.run.smithi076.stdout:setting min_mon_release = pacific 2024-04-19T23:44:38.267 INFO:teuthology.orchestra.run.smithi076.stdout:epoch 0 2024-04-19T23:44:38.267 INFO:teuthology.orchestra.run.smithi076.stdout:fsid b5aadf88-3af0-412d-86c8-081593c483a2 2024-04-19T23:44:38.267 INFO:teuthology.orchestra.run.smithi076.stdout:last_changed 2024-04-19T23:44:38.268757+0000 2024-04-19T23:44:38.268 INFO:teuthology.orchestra.run.smithi076.stdout:created 2024-04-19T23:44:38.268757+0000 2024-04-19T23:44:38.268 INFO:teuthology.orchestra.run.smithi076.stdout:min_mon_release 16 (pacific) 2024-04-19T23:44:38.268 INFO:teuthology.orchestra.run.smithi076.stdout:election_strategy: 1 2024-04-19T23:44:38.268 INFO:teuthology.orchestra.run.smithi076.stdout:0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-04-19T23:44:38.268 INFO:teuthology.orchestra.run.smithi076.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-19T23:44:38.269 DEBUG:teuthology.orchestra.run.smithi076:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T23:44:38.326 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b5aadf88-3af0-412d-86c8-081593c483a2... 2024-04-19T23:44:38.327 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T23:44:38.369 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T23:44:38.411 INFO:teuthology.orchestra.run.smithi076.stdout:[global] 2024-04-19T23:44:38.411 INFO:teuthology.orchestra.run.smithi076.stdout: chdir = "" 2024-04-19T23:44:38.411 INFO:teuthology.orchestra.run.smithi076.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T23:44:38.411 INFO:teuthology.orchestra.run.smithi076.stdout: auth supported = cephx 2024-04-19T23:44:38.411 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.411 INFO:teuthology.orchestra.run.smithi076.stdout: filestore xattr use omap = true 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: mon clock drift allowed = 1.000 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: osd crush chooseleaf type = 0 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: auth debug = true 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on old message = true 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on bug = true 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: mon pg warn max object skew = 0 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T23:44:38.412 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default size = 2 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow primary affinity = true 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow pg remap = true 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on legacy crush tunables = false 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on crush straw calc version zero = false 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on no sortbitwise = false 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on osd down out interval zero = false 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on too few osds = false 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: mon_allow_pool_size_one = true 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T23:44:38.413 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: osd default data pool replay window = 5 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: mon allow pool delete = true 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: mon cluster log file level = debug 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: debug asserts on shutdown = true 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: mon health detail to clog = false 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: mon host = 172.21.15.76 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: fsid = b5aadf88-3af0-412d-86c8-081593c483a2 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout:[osd] 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: osd journal size = 100 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.414 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub load threshold = 5.0 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub max interval = 600 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: osd mclock profile = high_recovery_ops 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: osd recover clone overlap = true 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: osd recovery max chunk = 1048576 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug shutdown = true 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug op order = true 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug verify stray on activate = true 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: osd open classes on start = true 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug pg log writeout = true 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: osd deep scrub update digest min age = 30 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.415 INFO:teuthology.orchestra.run.smithi076.stdout: osd map max advance = 10 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: journal zero on create = true 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: filestore ondisk finisher threads = 3 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: filestore apply finisher threads = 3 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: bdev debug aio = true 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug misdirected ops = true 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: debug objclass = 20 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: bdev async discard = True 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: bdev enable discard = True 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: bluestore allocator = bitmap 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: bluestore block size = 96636764160 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: bluestore fsck on mount = True 2024-04-19T23:44:38.416 INFO:teuthology.orchestra.run.smithi076.stdout: debug bluefs = 1/20 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: debug bluestore = 1/20 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: debug osd = 20 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: debug rocksdb = 4/10 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd full ratio = 0.9 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd nearfull ratio = 0.8 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: osd failsafe full ratio = 0.95 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: osd objectstore = bluestore 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout:[mgr] 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: debug mgr = 20 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2024-04-19T23:44:38.417 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: mgr/telemetry/nag = false 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout:[mon] 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: debug paxos = 20 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: mon data avail warn = 5 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: mon mgr mkfs grace = 240 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd reporter subtree level = osd 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd prime pg temp = true 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2024-04-19T23:44:38.418 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: # 1m isn't quite enough 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: mon_down_mkfs_grace = 2m 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_filestore_osds = false 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout:[client] 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: rgw cache enabled = true 2024-04-19T23:44:38.419 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable ops log = true 2024-04-19T23:44:38.420 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable usage log = true 2024-04-19T23:44:38.420 INFO:teuthology.orchestra.run.smithi076.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T23:44:38.420 INFO:teuthology.orchestra.run.smithi076.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T23:44:38.420 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-04-19T23:44:38.420 INFO:teuthology.orchestra.run.smithi076.stdout: rgw gc obj min wait = 15 2024-04-19T23:44:38.420 INFO:teuthology.orchestra.run.smithi076.stdout: debug rgw = 20 2024-04-19T23:44:38.420 INFO:teuthology.orchestra.run.smithi076.stdout: setgroup = ceph 2024-04-19T23:44:38.420 INFO:teuthology.orchestra.run.smithi076.stdout: setuser = ceph 2024-04-19T23:44:38.420 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.a] 2024-04-19T23:44:38.420 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-04-19T23:44:38.420 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T23:44:38.421 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T23:44:38.422 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = 172.21.15.76 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = b5aadf88-3af0-412d-86c8-081593c483a2 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-04-19T23:44:38.423 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-04-19T23:44:38.424 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: debug objclass = 20 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2024-04-19T23:44:38.425 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 1/20 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 1/20 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 4/10 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-04-19T23:44:38.426 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-04-19T23:44:38.427 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-04-19T23:44:38.428 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: rgw gc obj min wait = 15 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: debug rgw = 20 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: setgroup = ceph 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout: setuser = ceph 2024-04-19T23:44:38.429 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-04-19T23:44:38.431 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-19T23:44:38.431 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-19T23:44:38.528 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-19T23:44:38.528 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:38.528 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-19T23:44:38.545 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:38.545 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-19T23:44:38.603 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi076.front.sepia.ceph.com 2024-04-19T23:44:38.603 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:38.603 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T23:44:38.603 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T23:44:38.678 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:38.678 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T23:44:38.736 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2024-04-19T23:44:38.736 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:38.736 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T23:44:38.736 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T23:44:38.772 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:38.772 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T23:44:38.830 INFO:tasks.ceph:Setting up mon nodes... 2024-04-19T23:44:38.830 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-19T23:44:38.830 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T23:44:38.931 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T23:44:38.934 INFO:tasks.ceph:Setting up mds nodes... 2024-04-19T23:44:38.934 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-19T23:44:38.934 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-19T23:44:38.977 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-19T23:44:38.989 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-19T23:44:38.990 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi076.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-19T23:44:38.990 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-19T23:44:39.018 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T23:44:39.018 INFO:tasks.ceph:role: osd.0 2024-04-19T23:44:39.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi076.front.sepia.ceph.com 2024-04-19T23:44:39.018 DEBUG:teuthology.orchestra.run.smithi076:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T23:44:39.092 INFO:teuthology.orchestra.run.smithi076.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T23:44:39.092 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T23:44:39.092 INFO:teuthology.orchestra.run.smithi076.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T23:44:39.092 INFO:teuthology.orchestra.run.smithi076.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T23:44:39.093 INFO:teuthology.orchestra.run.smithi076.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T23:44:39.093 INFO:teuthology.orchestra.run.smithi076.stdout: = sunit=0 swidth=0 blks 2024-04-19T23:44:39.093 INFO:teuthology.orchestra.run.smithi076.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T23:44:39.093 INFO:teuthology.orchestra.run.smithi076.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T23:44:39.093 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T23:44:39.093 INFO:teuthology.orchestra.run.smithi076.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T23:44:39.518 INFO:teuthology.orchestra.run.smithi076.stdout:Discarding blocks...Done. 2024-04-19T23:44:39.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi076.front.sepia.ceph.com -o noatime 2024-04-19T23:44:39.519 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-19T23:44:39.665 DEBUG:teuthology.orchestra.run.smithi076:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-19T23:44:39.700 DEBUG:teuthology.orchestra.run.smithi076:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T23:44:39.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:39.795+0000 7f7082ae07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-19T23:44:39.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:39.798+0000 7f7082ae07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-19T23:44:39.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:39.798+0000 7f7082ae07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T23:44:39.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:39.798+0000 7f7082ae07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T23:44:39.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:39.798+0000 7f7082ae07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T23:44:39.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:39.806+0000 7f7082ae07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-19T23:44:42.649 DEBUG:teuthology.orchestra.run.smithi076:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-19T23:44:42.682 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-19T23:44:42.714 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-19T23:44:42.714 INFO:tasks.ceph:role: osd.1 2024-04-19T23:44:42.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-19T23:44:42.714 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T23:44:42.793 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T23:44:42.793 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T23:44:42.793 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T23:44:42.793 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T23:44:42.793 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T23:44:42.793 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-19T23:44:42.793 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T23:44:42.793 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T23:44:42.793 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T23:44:42.794 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T23:44:43.240 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-19T23:44:43.242 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-19T23:44:43.242 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-19T23:44:43.417 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-19T23:44:43.454 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-19T23:44:43.522 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-19T23:44:43.522 INFO:tasks.ceph:role: osd.2 2024-04-19T23:44:43.522 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-19T23:44:43.522 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-19T23:44:43.597 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T23:44:43.598 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T23:44:43.598 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T23:44:43.598 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T23:44:43.598 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T23:44:43.598 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-19T23:44:43.598 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T23:44:43.598 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T23:44:43.598 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T23:44:43.598 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T23:44:44.017 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-19T23:44:44.019 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-19T23:44:44.019 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-04-19T23:44:44.127 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-19T23:44:44.162 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-19T23:44:44.234 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-19T23:44:44.234 INFO:tasks.ceph:role: osd.3 2024-04-19T23:44:44.234 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-19T23:44:44.234 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-19T23:44:44.310 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T23:44:44.310 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T23:44:44.311 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T23:44:44.311 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T23:44:44.311 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T23:44:44.311 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-19T23:44:44.311 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T23:44:44.311 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T23:44:44.311 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T23:44:44.311 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T23:44:44.755 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-19T23:44:44.757 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-19T23:44:44.757 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-04-19T23:44:44.919 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-19T23:44:44.952 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T23:44:45.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:45.052+0000 7f6c12f627c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-19T23:44:45.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:45.053+0000 7f6c12f627c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-19T23:44:45.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:45.053+0000 7f6c12f627c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T23:44:45.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:45.053+0000 7f6c12f627c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T23:44:45.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:45.053+0000 7f6c12f627c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T23:44:45.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:45.061+0000 7f6c12f627c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-19T23:44:47.909 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-19T23:44:47.940 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T23:44:48.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:48.032+0000 7fadeb9a37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-19T23:44:48.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:48.032+0000 7fadeb9a37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-19T23:44:48.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:48.032+0000 7fadeb9a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T23:44:48.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:48.032+0000 7fadeb9a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T23:44:48.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:48.032+0000 7fadeb9a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T23:44:48.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:48.033+0000 7fadeb9a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-19T23:44:50.888 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-19T23:44:50.921 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T23:44:51.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:51.013+0000 7fe729c6f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-19T23:44:51.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:51.013+0000 7fe729c6f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-19T23:44:51.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:51.013+0000 7fe729c6f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-19T23:44:51.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:51.013+0000 7fe729c6f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-19T23:44:51.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:51.013+0000 7fe729c6f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-19T23:44:51.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:51.013+0000 7fe729c6f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-19T23:44:53.859 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-19T23:44:53.892 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-19T23:44:53.892 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:53.893 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-19T23:44:53.925 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:53.925 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-19T23:44:53.964 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:53.964 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-19T23:44:54.035 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:54.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-19T23:44:54.104 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:54.105 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-19T23:44:54.173 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:54.173 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-19T23:44:54.232 INFO:tasks.ceph:Adding keys to all mons... 2024-04-19T23:44:54.232 DEBUG:teuthology.orchestra.run.smithi076:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-19T23:44:54.267 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.0] 2024-04-19T23:44:54.267 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQDnASNmmjZ+LxAAKN27ZtFYKAmc79EMUn4dCQ== 2024-04-19T23:44:54.267 INFO:teuthology.orchestra.run.smithi076.stdout:[mgr.x] 2024-04-19T23:44:54.267 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQDmASNmYMmjNxAAXomwqvbGOeGt/u3IVCjENg== 2024-04-19T23:44:54.268 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.1] 2024-04-19T23:44:54.268 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQDtASNmE3Y5AxAAmkptk7/Jg+AegjVD6ZZlkw== 2024-04-19T23:44:54.268 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.2] 2024-04-19T23:44:54.268 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQDwASNmttb8ARAA9p5Lh0UEx/2YAEhrKS2z9A== 2024-04-19T23:44:54.268 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.3] 2024-04-19T23:44:54.268 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQDzASNmMLTXABAAZ4PuqcYtHM28mnEQ5Le1ig== 2024-04-19T23:44:54.268 INFO:teuthology.orchestra.run.smithi076.stdout:[client.0] 2024-04-19T23:44:54.268 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQDmASNms1NjOhAA3mfzpRhbw3yXenXPmDykGg== 2024-04-19T23:44:54.269 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T23:44:54.370 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-19T23:44:54.432 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T23:44:54.493 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T23:44:54.550 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T23:44:54.605 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-19T23:44:54.661 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-19T23:44:54.661 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-19T23:44:54.689 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T23:44:54.789 DEBUG:teuthology.orchestra.run.smithi076:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-19T23:44:54.816 DEBUG:teuthology.orchestra.run.smithi076:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-19T23:44:54.873 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-19T23:44:54.873 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-19T23:44:54.873 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-19T23:44:54.915 INFO:tasks.ceph.mon.a:Started 2024-04-19T23:44:54.915 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-19T23:44:54.915 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-19T23:44:54.915 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-19T23:44:54.918 INFO:tasks.ceph.mgr.x:Started 2024-04-19T23:44:54.918 INFO:tasks.ceph:Setting crush tunables to default 2024-04-19T23:44:54.918 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --cluster ceph osd crush tunables default 2024-04-19T23:44:55.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89dc006700 1 Processor -- start 2024-04-19T23:44:55.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89dc006700 1 -- start start 2024-04-19T23:44:55.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89dc006700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f89d412a810 0x7f89d412ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:55.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89dc006700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d4097100 con 0x7f89d412b270 2024-04-19T23:44:55.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89dc006700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d4096e60 con 0x7f89d412a810 2024-04-19T23:44:55.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89d95a1700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f89d412b270 0x7f89d4127310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:52988/0 (socket says 172.21.15.76:52988) 2024-04-19T23:44:55.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89d95a1700 1 -- 172.21.15.76:0/3594201327 learned_addr learned my addr 172.21.15.76:0/3594201327 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:44:55.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89d9da2700 1 --2- 172.21.15.76:0/3594201327 >> v2:172.21.15.76:3300/0 conn(0x7f89d412a810 0x7f89d412ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:55.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89d9da2700 1 -- 172.21.15.76:0/3594201327 >> v2:172.21.15.76:3300/0 conn(0x7f89d412a810 msgr2=0x7f89d412ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-19T23:44:55.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89d9da2700 1 -- 172.21.15.76:0/3594201327 >> v2:172.21.15.76:3300/0 conn(0x7f89d412a810 msgr2=0x7f89d412ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-19T23:44:55.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89d9da2700 1 --2- 172.21.15.76:0/3594201327 >> v2:172.21.15.76:3300/0 conn(0x7f89d412a810 0x7f89d412ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-19T23:44:55.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.040+0000 7f89d9da2700 1 --2- 172.21.15.76:0/3594201327 >> v2:172.21.15.76:3300/0 conn(0x7f89d412a810 0x7f89d412ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d8da0700 1 -- 172.21.15.76:0/3594201327 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248259398 0 0) 0x7f89d4097100 con 0x7f89d412b270 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d8da0700 1 -- 172.21.15.76:0/3594201327 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c00057c0 con 0x7f89d412b270 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d8da0700 1 -- 172.21.15.76:0/3594201327 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1440364090 0 0) 0x7f89c00057c0 con 0x7f89d412b270 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d8da0700 1 -- 172.21.15.76:0/3594201327 >> v2:172.21.15.76:3300/0 conn(0x7f89d412a810 msgr2=0x7f89d412ad30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d8da0700 1 --2- 172.21.15.76:0/3594201327 >> v2:172.21.15.76:3300/0 conn(0x7f89d412a810 0x7f89d412ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d8da0700 1 -- 172.21.15.76:0/3594201327 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d412b6e0 con 0x7f89d412b270 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d8da0700 1 -- 172.21.15.76:0/3594201327 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2246541106 0 0) 0x7f89c40015a0 con 0x7f89d412b270 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d8da0700 1 -- 172.21.15.76:0/3594201327 >> v1:172.21.15.76:6789/0 conn(0x7f89d412b270 legacy=0x7f89d4127310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d8da0700 1 --2- 172.21.15.76:0/3594201327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 0x7f89c0006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d8da0700 1 -- 172.21.15.76:0/3594201327 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d4096e60 con 0x7f89c0005c10 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d9da2700 1 --2- 172.21.15.76:0/3594201327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 0x7f89c0006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d9da2700 1 -- 172.21.15.76:0/3594201327 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c00057c0 con 0x7f89c0005c10 2024-04-19T23:44:55.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.048+0000 7f89d9da2700 1 --2- 172.21.15.76:0/3594201327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 0x7f89c0006010 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009810 tx=0x7f89c0007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e91ec62a2256f0a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:55.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.049+0000 7f89d8da0700 1 -- 172.21.15.76:0/3594201327 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89d0017070 con 0x7f89c0005c10 2024-04-19T23:44:55.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.049+0000 7f89d8da0700 1 -- 172.21.15.76:0/3594201327 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d0004150 con 0x7f89c0005c10 2024-04-19T23:44:55.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.049+0000 7f89d8da0700 1 -- 172.21.15.76:0/3594201327 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89d000c070 con 0x7f89c0005c10 2024-04-19T23:44:55.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.049+0000 7f89dc006700 1 -- 172.21.15.76:0/3594201327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 msgr2=0x7f89c0006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:55.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.049+0000 7f89dc006700 1 --2- 172.21.15.76:0/3594201327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 0x7f89c0006010 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009810 tx=0x7f89c0007a90 comp rx=0 tx=0).stop 2024-04-19T23:44:55.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.049+0000 7f89dc006700 1 -- 172.21.15.76:0/3594201327 shutdown_connections 2024-04-19T23:44:55.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.049+0000 7f89dc006700 1 --2- 172.21.15.76:0/3594201327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 0x7f89c0006010 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.049+0000 7f89dc006700 1 --2- 172.21.15.76:0/3594201327 >> v2:172.21.15.76:3300/0 conn(0x7f89d412a810 0x7f89d412ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.049+0000 7f89dc006700 1 -- 172.21.15.76:0/3594201327 >> 172.21.15.76:0/3594201327 conn(0x7f89d409d020 msgr2=0x7f89d409d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:55.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.049+0000 7f89dc006700 1 -- 172.21.15.76:0/3594201327 shutdown_connections 2024-04-19T23:44:55.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.049+0000 7f89dc006700 1 -- 172.21.15.76:0/3594201327 wait complete. 2024-04-19T23:44:55.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.050+0000 7f89dc006700 1 Processor -- start 2024-04-19T23:44:55.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.050+0000 7f89dc006700 1 -- start start 2024-04-19T23:44:55.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89dc006700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 0x7f89d406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:55.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89dc006700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d4089490 con 0x7f89c0005c10 2024-04-19T23:44:55.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89d9da2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 0x7f89d406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89d9da2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 0x7f89d406f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60688/0 (socket says 172.21.15.76:60688) 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89d9da2700 1 -- 172.21.15.76:0/1501584337 learned_addr learned my addr 172.21.15.76:0/1501584337 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89d9da2700 1 -- 172.21.15.76:0/1501584337 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d40711d0 con 0x7f89c0005c10 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89d9da2700 1 --2- 172.21.15.76:0/1501584337 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 0x7f89d406f9a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f89d406e060 tx=0x7f89d00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89ca7fc700 1 -- 172.21.15.76:0/1501584337 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89d0017030 con 0x7f89c0005c10 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89ca7fc700 1 -- 172.21.15.76:0/1501584337 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d001e430 con 0x7f89c0005c10 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89dc006700 1 -- 172.21.15.76:0/1501584337 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d4071d20 con 0x7f89c0005c10 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89ca7fc700 1 -- 172.21.15.76:0/1501584337 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89d001e710 con 0x7f89c0005c10 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89dc006700 1 -- 172.21.15.76:0/1501584337 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d4088fc0 con 0x7f89c0005c10 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89ca7fc700 1 -- 172.21.15.76:0/1501584337 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f89d001e870 con 0x7f89c0005c10 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.051+0000 7f89ca7fc700 1 -- 172.21.15.76:0/1501584337 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f89d0013c20 con 0x7f89c0005c10 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.052+0000 7f89dc006700 1 -- 172.21.15.76:0/1501584337 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d4070b00 con 0x7f89c0005c10 2024-04-19T23:44:55.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.054+0000 7f89ca7fc700 1 -- 172.21.15.76:0/1501584337 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f89d000f040 con 0x7f89c0005c10 2024-04-19T23:44:55.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.126+0000 7f89dc006700 1 -- 172.21.15.76:0/1501584337 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f89d4062510 con 0x7f89c0005c10 2024-04-19T23:44:55.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.128+0000 7f89ca7fc700 1 -- 172.21.15.76:0/1501584337 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f89d0013430 con 0x7f89c0005c10 2024-04-19T23:44:55.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.129+0000 7f89dc006700 1 -- 172.21.15.76:0/1501584337 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 msgr2=0x7f89d406f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:55.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.129+0000 7f89dc006700 1 --2- 172.21.15.76:0/1501584337 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 0x7f89d406f9a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f89d406e060 tx=0x7f89d00047c0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.129+0000 7f89dc006700 1 -- 172.21.15.76:0/1501584337 shutdown_connections 2024-04-19T23:44:55.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.129+0000 7f89dc006700 1 --2- 172.21.15.76:0/1501584337 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89c0005c10 0x7f89d406f9a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.129+0000 7f89dc006700 1 -- 172.21.15.76:0/1501584337 >> 172.21.15.76:0/1501584337 conn(0x7f89d409d020 msgr2=0x7f89d4094560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:55.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.129+0000 7f89dc006700 1 -- 172.21.15.76:0/1501584337 shutdown_connections 2024-04-19T23:44:55.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:55.129+0000 7f89dc006700 1 -- 172.21.15.76:0/1501584337 wait complete. 2024-04-19T23:44:55.129 INFO:teuthology.orchestra.run.smithi076.stderr:adjusted tunables profile to default 2024-04-19T23:44:55.140 INFO:tasks.ceph:check_enable_crimson: False 2024-04-19T23:44:55.140 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-19T23:44:55.140 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-04-19T23:44:55.140 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-19T23:44:55.166 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:55.166 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-19T23:44:55.196 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:55.196 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-19T23:44:55.264 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-19T23:44:55.264 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-19T23:44:55.331 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new bb7b1ad0-ba98-4542-a23d-e070a35df21e 0 2024-04-19T23:44:55.333 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:55.333+0000 7fd4919da200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T23:44:55.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.468+0000 7faa41f56700 1 Processor -- start 2024-04-19T23:44:55.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.468+0000 7faa41f56700 1 -- start start 2024-04-19T23:44:55.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.468+0000 7faa41f56700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7faa3c116be0 0x7faa3c118fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:55.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.468+0000 7faa41f56700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3c1195a0 con 0x7faa3c113f20 2024-04-19T23:44:55.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.468+0000 7faa41f56700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3c11a740 con 0x7faa3c116be0 2024-04-19T23:44:55.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.469+0000 7faa3b7fe700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7faa3c113f20 0x7faa3c114300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:39400/0 (socket says 172.21.15.155:39400) 2024-04-19T23:44:55.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.469+0000 7faa3b7fe700 1 -- 172.21.15.155:0/4135474904 learned_addr learned my addr 172.21.15.155:0/4135474904 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:44:55.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.469+0000 7faa3affd700 1 --2- 172.21.15.155:0/4135474904 >> v2:172.21.15.76:3300/0 conn(0x7faa3c116be0 0x7faa3c118fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:55.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.469+0000 7faa3a7fc700 1 -- 172.21.15.155:0/4135474904 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020609456 0 0) 0x7faa3c1195a0 con 0x7faa3c113f20 2024-04-19T23:44:55.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.469+0000 7faa3a7fc700 1 -- 172.21.15.155:0/4135474904 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa240035b0 con 0x7faa3c113f20 2024-04-19T23:44:55.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.469+0000 7faa3affd700 1 -- 172.21.15.155:0/4135474904 >> v1:172.21.15.76:6789/0 conn(0x7faa3c113f20 legacy=0x7faa3c114300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:55.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.469+0000 7faa3affd700 1 -- 172.21.15.155:0/4135474904 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c11a8b0 con 0x7faa3c116be0 2024-04-19T23:44:55.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.469+0000 7faa3affd700 1 --2- 172.21.15.155:0/4135474904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa3c116be0 0x7faa3c118fd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa300097c0 tx=0x7faa30009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126f0fc4a92c70dc server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:55.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.469+0000 7faa3a7fc700 1 -- 172.21.15.155:0/4135474904 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa30004160 con 0x7faa3c116be0 2024-04-19T23:44:55.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.469+0000 7faa3a7fc700 1 -- 172.21.15.155:0/4135474904 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa300042c0 con 0x7faa3c116be0 2024-04-19T23:44:55.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.469+0000 7faa3a7fc700 1 -- 172.21.15.155:0/4135474904 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa30004580 con 0x7faa3c116be0 2024-04-19T23:44:55.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.470+0000 7faa41f56700 1 -- 172.21.15.155:0/4135474904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa3c116be0 msgr2=0x7faa3c118fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:55.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.470+0000 7faa41f56700 1 --2- 172.21.15.155:0/4135474904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa3c116be0 0x7faa3c118fd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa300097c0 tx=0x7faa30009ad0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.470+0000 7faa41f56700 1 -- 172.21.15.155:0/4135474904 shutdown_connections 2024-04-19T23:44:55.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.470+0000 7faa41f56700 1 --2- 172.21.15.155:0/4135474904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa3c116be0 0x7faa3c118fd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.470+0000 7faa41f56700 1 -- 172.21.15.155:0/4135474904 >> 172.21.15.155:0/4135474904 conn(0x7faa3c06ec20 msgr2=0x7faa3c071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:55.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.470+0000 7faa41f56700 1 -- 172.21.15.155:0/4135474904 shutdown_connections 2024-04-19T23:44:55.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.470+0000 7faa41f56700 1 -- 172.21.15.155:0/4135474904 wait complete. 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.471+0000 7faa41f56700 1 Processor -- start 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.471+0000 7faa41f56700 1 -- start start 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.472+0000 7faa41f56700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa3c113f20 0x7faa3c1a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.472+0000 7faa41f56700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c1a73e0 con 0x7faa3c113f20 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.472+0000 7faa3b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa3c113f20 0x7faa3c1a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.472+0000 7faa3b7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa3c113f20 0x7faa3c1a6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:51822/0 (socket says 172.21.15.155:51822) 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.472+0000 7faa3b7fe700 1 -- 172.21.15.155:0/3769227794 learned_addr learned my addr 172.21.15.155:0/3769227794 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.472+0000 7faa3b7fe700 1 -- 172.21.15.155:0/3769227794 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300094a0 con 0x7faa3c113f20 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.472+0000 7faa3b7fe700 1 --2- 172.21.15.155:0/3769227794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa3c113f20 0x7faa3c1a6e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00c680 tx=0x7faa2c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.473+0000 7faa23fff700 1 -- 172.21.15.155:0/3769227794 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa2c005ca0 con 0x7faa3c113f20 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.473+0000 7faa23fff700 1 -- 172.21.15.155:0/3769227794 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c005e00 con 0x7faa3c113f20 2024-04-19T23:44:55.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.473+0000 7faa23fff700 1 -- 172.21.15.155:0/3769227794 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa2c007200 con 0x7faa3c113f20 2024-04-19T23:44:55.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.473+0000 7faa41f56700 1 -- 172.21.15.155:0/3769227794 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3c1a75e0 con 0x7faa3c113f20 2024-04-19T23:44:55.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.473+0000 7faa41f56700 1 -- 172.21.15.155:0/3769227794 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3c1a0f00 con 0x7faa3c113f20 2024-04-19T23:44:55.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.473+0000 7faa23fff700 1 -- 172.21.15.155:0/3769227794 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7faa2c007660 con 0x7faa3c113f20 2024-04-19T23:44:55.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.473+0000 7faa23fff700 1 -- 172.21.15.155:0/3769227794 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7faa2c012740 con 0x7faa3c113f20 2024-04-19T23:44:55.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.474+0000 7faa41f56700 1 -- 172.21.15.155:0/3769227794 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3c04f400 con 0x7faa3c113f20 2024-04-19T23:44:55.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.476+0000 7faa23fff700 1 -- 172.21.15.155:0/3769227794 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7faa2c021060 con 0x7faa3c113f20 2024-04-19T23:44:55.509 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:55.509+0000 7fd4919da200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T23:44:55.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.571+0000 7faa41f56700 1 -- 172.21.15.155:0/3769227794 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bb7b1ad0-ba98-4542-a23d-e070a35df21e", "id": 0} v 0) v1 -- 0x7faa3c116be0 con 0x7faa3c113f20 2024-04-19T23:44:55.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.573+0000 7faa23fff700 1 -- 172.21.15.155:0/3769227794 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb7b1ad0-ba98-4542-a23d-e070a35df21e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7faa3c116be0 con 0x7faa3c113f20 2024-04-19T23:44:55.573 INFO:teuthology.orchestra.run.smithi155.stdout:0 2024-04-19T23:44:55.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.574+0000 7faa41f56700 1 -- 172.21.15.155:0/3769227794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa3c113f20 msgr2=0x7faa3c1a6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:55.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.574+0000 7faa41f56700 1 --2- 172.21.15.155:0/3769227794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa3c113f20 0x7faa3c1a6e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00c680 tx=0x7faa2c00ca40 comp rx=0 tx=0).stop 2024-04-19T23:44:55.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.574+0000 7faa41f56700 1 -- 172.21.15.155:0/3769227794 shutdown_connections 2024-04-19T23:44:55.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.574+0000 7faa41f56700 1 --2- 172.21.15.155:0/3769227794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faa3c113f20 0x7faa3c1a6e10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.574+0000 7faa41f56700 1 -- 172.21.15.155:0/3769227794 >> 172.21.15.155:0/3769227794 conn(0x7faa3c06ec20 msgr2=0x7faa3c06f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:55.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.575+0000 7faa41f56700 1 -- 172.21.15.155:0/3769227794 shutdown_connections 2024-04-19T23:44:55.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.575+0000 7faa41f56700 1 -- 172.21.15.155:0/3769227794 wait complete. 2024-04-19T23:44:55.586 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new b7cede46-301b-45db-ad7d-7c10f1844893 1 2024-04-19T23:44:55.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.707+0000 7f81a2bed700 1 Processor -- start 2024-04-19T23:44:55.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.707+0000 7f81a2bed700 1 -- start start 2024-04-19T23:44:55.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.708+0000 7f81a2bed700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f819c06b070 0x7f819c06b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:55.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.708+0000 7f81a2bed700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c06be20 con 0x7f819c06b990 2024-04-19T23:44:55.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.708+0000 7f81a2bed700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c11db30 con 0x7f819c06b070 2024-04-19T23:44:55.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.708+0000 7f81a0989700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f819c06b070 0x7f819c06b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:55.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.708+0000 7f81a0989700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f819c06b070 0x7f819c06b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:51834/0 (socket says 172.21.15.155:51834) 2024-04-19T23:44:55.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.708+0000 7f819bfff700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f819c06b990 0x7f819c11b400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:39402/0 (socket says 172.21.15.155:39402) 2024-04-19T23:44:55.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.708+0000 7f81a0989700 1 -- 172.21.15.155:0/2562799899 learned_addr learned my addr 172.21.15.155:0/2562799899 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.708+0000 7f81a0989700 1 -- 172.21.15.155:0/2562799899 >> v1:172.21.15.76:6789/0 conn(0x7f819c06b990 legacy=0x7f819c11b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.708+0000 7f819b7fe700 1 -- 172.21.15.155:0/2562799899 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012151885 0 0) 0x7f819c06be20 con 0x7f819c06b990 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.708+0000 7f81a0989700 1 -- 172.21.15.155:0/2562799899 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c11dc70 con 0x7f819c06b070 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.708+0000 7f81a0989700 1 --2- 172.21.15.155:0/2562799899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f819c06b070 0x7f819c06b450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8190009870 tx=0x7f8190009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab36aef2797f25f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.709+0000 7f819b7fe700 1 -- 172.21.15.155:0/2562799899 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8190004160 con 0x7f819c06b070 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.709+0000 7f819b7fe700 1 -- 172.21.15.155:0/2562799899 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81900042c0 con 0x7f819c06b070 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.709+0000 7f819b7fe700 1 -- 172.21.15.155:0/2562799899 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8190004580 con 0x7f819c06b070 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.709+0000 7f81a2bed700 1 -- 172.21.15.155:0/2562799899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f819c06b070 msgr2=0x7f819c06b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.709+0000 7f81a2bed700 1 --2- 172.21.15.155:0/2562799899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f819c06b070 0x7f819c06b450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8190009870 tx=0x7f8190009b80 comp rx=0 tx=0).stop 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.709+0000 7f81a2bed700 1 -- 172.21.15.155:0/2562799899 shutdown_connections 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.709+0000 7f81a2bed700 1 --2- 172.21.15.155:0/2562799899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f819c06b070 0x7f819c06b450 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.709+0000 7f81a2bed700 1 -- 172.21.15.155:0/2562799899 >> 172.21.15.155:0/2562799899 conn(0x7f819c06fe40 msgr2=0x7f819c072260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.709+0000 7f81a2bed700 1 -- 172.21.15.155:0/2562799899 shutdown_connections 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.709+0000 7f81a2bed700 1 -- 172.21.15.155:0/2562799899 wait complete. 2024-04-19T23:44:55.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.710+0000 7f81a2bed700 1 Processor -- start 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.710+0000 7f81a2bed700 1 -- start start 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.710+0000 7f81a2bed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f819c06b070 0x7f819c1ab200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.710+0000 7f81a2bed700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c1ab7d0 con 0x7f819c06b070 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.710+0000 7f81a0989700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f819c06b070 0x7f819c1ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.710+0000 7f81a0989700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f819c06b070 0x7f819c1ab200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:51840/0 (socket says 172.21.15.155:51840) 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.710+0000 7f81a0989700 1 -- 172.21.15.155:0/249229131 learned_addr learned my addr 172.21.15.155:0/249229131 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.711+0000 7f81a0989700 1 -- 172.21.15.155:0/249229131 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190009550 con 0x7f819c06b070 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.711+0000 7f81a0989700 1 --2- 172.21.15.155:0/249229131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f819c06b070 0x7f819c1ab200 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8190009130 tx=0x7f8190004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.711+0000 7f81997fa700 1 -- 172.21.15.155:0/249229131 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8190003d10 con 0x7f819c06b070 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.711+0000 7f81997fa700 1 -- 172.21.15.155:0/249229131 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819001f070 con 0x7f819c06b070 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.711+0000 7f81997fa700 1 -- 172.21.15.155:0/249229131 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8190011630 con 0x7f819c06b070 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.711+0000 7f81a2bed700 1 -- 172.21.15.155:0/249229131 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c1ab970 con 0x7f819c06b070 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.711+0000 7f81a2bed700 1 -- 172.21.15.155:0/249229131 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c1a5270 con 0x7f819c06b070 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.711+0000 7f81997fa700 1 -- 172.21.15.155:0/249229131 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8190021030 con 0x7f819c06b070 2024-04-19T23:44:55.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.711+0000 7f81997fa700 1 -- 172.21.15.155:0/249229131 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f81900249b0 con 0x7f819c06b070 2024-04-19T23:44:55.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.712+0000 7f81a2bed700 1 -- 172.21.15.155:0/249229131 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c04f400 con 0x7f819c06b070 2024-04-19T23:44:55.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.715+0000 7f81997fa700 1 -- 172.21.15.155:0/249229131 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f8190024480 con 0x7f819c06b070 2024-04-19T23:44:55.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.798+0000 7f81a2bed700 1 -- 172.21.15.155:0/249229131 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b7cede46-301b-45db-ad7d-7c10f1844893", "id": 1} v 0) v1 -- 0x7f819c06b990 con 0x7f819c06b070 2024-04-19T23:44:55.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.800+0000 7f81997fa700 1 -- 172.21.15.155:0/249229131 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7cede46-301b-45db-ad7d-7c10f1844893", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f819c06b990 con 0x7f819c06b070 2024-04-19T23:44:55.800 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-04-19T23:44:55.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.801+0000 7f81a2bed700 1 -- 172.21.15.155:0/249229131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f819c06b070 msgr2=0x7f819c1ab200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:55.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.801+0000 7f81a2bed700 1 --2- 172.21.15.155:0/249229131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f819c06b070 0x7f819c1ab200 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8190009130 tx=0x7f8190004750 comp rx=0 tx=0).stop 2024-04-19T23:44:55.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.801+0000 7f81a2bed700 1 -- 172.21.15.155:0/249229131 shutdown_connections 2024-04-19T23:44:55.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.801+0000 7f81a2bed700 1 --2- 172.21.15.155:0/249229131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f819c06b070 0x7f819c1ab200 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.801+0000 7f81a2bed700 1 -- 172.21.15.155:0/249229131 >> 172.21.15.155:0/249229131 conn(0x7f819c06fe40 msgr2=0x7f819c1163c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:55.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.801+0000 7f81a2bed700 1 -- 172.21.15.155:0/249229131 shutdown_connections 2024-04-19T23:44:55.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.801+0000 7f81a2bed700 1 -- 172.21.15.155:0/249229131 wait complete. 2024-04-19T23:44:55.813 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new ba9112f9-ce2a-4f53-9345-9a7c4ca89189 2 2024-04-19T23:44:55.883 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:55.884+0000 7fd4919da200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T23:44:55.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.936+0000 7f2f72a77700 1 Processor -- start 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.936+0000 7f2f72a77700 1 -- start start 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.936+0000 7f2f72a77700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f2f6c116b80 0x7f2f6c118f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.936+0000 7f2f72a77700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c119540 con 0x7f2f6c113e40 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.936+0000 7f2f72a77700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c11a6e0 con 0x7f2f6c116b80 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.937+0000 7f2f6bfff700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f2f6c116b80 0x7f2f6c118f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.937+0000 7f2f70813700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f2f6c113e40 0x7f2f6c114220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:39418/0 (socket says 172.21.15.155:39418) 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.937+0000 7f2f70813700 1 -- 172.21.15.155:0/633202949 learned_addr learned my addr 172.21.15.155:0/633202949 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.937+0000 7f2f6bfff700 1 -- 172.21.15.155:0/633202949 >> v1:172.21.15.76:6789/0 conn(0x7f2f6c113e40 legacy=0x7f2f6c114220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.937+0000 7f2f6b7fe700 1 -- 172.21.15.155:0/633202949 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544268727 0 0) 0x7f2f6c119540 con 0x7f2f6c113e40 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.937+0000 7f2f6bfff700 1 -- 172.21.15.155:0/633202949 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c11a850 con 0x7f2f6c116b80 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.937+0000 7f2f6bfff700 1 --2- 172.21.15.155:0/633202949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f6c116b80 0x7f2f6c118f70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f580097c0 tx=0x7f2f58009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704b46347ab0e41b server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.937+0000 7f2f6b7fe700 1 -- 172.21.15.155:0/633202949 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f58004160 con 0x7f2f6c116b80 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.937+0000 7f2f6b7fe700 1 -- 172.21.15.155:0/633202949 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f580042c0 con 0x7f2f6c116b80 2024-04-19T23:44:55.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.937+0000 7f2f6b7fe700 1 -- 172.21.15.155:0/633202949 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f58004580 con 0x7f2f6c116b80 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.938+0000 7f2f72a77700 1 -- 172.21.15.155:0/633202949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f6c116b80 msgr2=0x7f2f6c118f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.938+0000 7f2f72a77700 1 --2- 172.21.15.155:0/633202949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f6c116b80 0x7f2f6c118f70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f580097c0 tx=0x7f2f58009ad0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.938+0000 7f2f72a77700 1 -- 172.21.15.155:0/633202949 shutdown_connections 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.938+0000 7f2f72a77700 1 --2- 172.21.15.155:0/633202949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f6c116b80 0x7f2f6c118f70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.938+0000 7f2f72a77700 1 -- 172.21.15.155:0/633202949 >> 172.21.15.155:0/633202949 conn(0x7f2f6c06fe40 msgr2=0x7f2f6c072260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.938+0000 7f2f72a77700 1 -- 172.21.15.155:0/633202949 shutdown_connections 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.938+0000 7f2f72a77700 1 -- 172.21.15.155:0/633202949 wait complete. 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.939+0000 7f2f72a77700 1 Processor -- start 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.939+0000 7f2f72a77700 1 -- start start 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.939+0000 7f2f72a77700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f6c113e40 0x7f2f6c1a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.939+0000 7f2f72a77700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c1a4780 con 0x7f2f6c113e40 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.939+0000 7f2f70813700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f6c113e40 0x7f2f6c1a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:55.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.939+0000 7f2f70813700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f6c113e40 0x7f2f6c1a41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:51866/0 (socket says 172.21.15.155:51866) 2024-04-19T23:44:55.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.939+0000 7f2f70813700 1 -- 172.21.15.155:0/3684041877 learned_addr learned my addr 172.21.15.155:0/3684041877 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:44:55.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.939+0000 7f2f70813700 1 -- 172.21.15.155:0/3684041877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580094a0 con 0x7f2f6c113e40 2024-04-19T23:44:55.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.940+0000 7f2f70813700 1 --2- 172.21.15.155:0/3684041877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f6c113e40 0x7f2f6c1a41b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2f60001eb0 tx=0x7f2f6000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:55.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.940+0000 7f2f697fa700 1 -- 172.21.15.155:0/3684041877 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f60004bb0 con 0x7f2f6c113e40 2024-04-19T23:44:55.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.940+0000 7f2f697fa700 1 -- 172.21.15.155:0/3684041877 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f60004d10 con 0x7f2f6c113e40 2024-04-19T23:44:55.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.940+0000 7f2f72a77700 1 -- 172.21.15.155:0/3684041877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c1a4980 con 0x7f2f6c113e40 2024-04-19T23:44:55.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.940+0000 7f2f697fa700 1 -- 172.21.15.155:0/3684041877 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f600070d0 con 0x7f2f6c113e40 2024-04-19T23:44:55.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.940+0000 7f2f72a77700 1 -- 172.21.15.155:0/3684041877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c1a4e10 con 0x7f2f6c113e40 2024-04-19T23:44:55.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.940+0000 7f2f697fa700 1 -- 172.21.15.155:0/3684041877 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2f6001d3f0 con 0x7f2f6c113e40 2024-04-19T23:44:55.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.940+0000 7f2f697fa700 1 -- 172.21.15.155:0/3684041877 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2f600137e0 con 0x7f2f6c113e40 2024-04-19T23:44:55.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.941+0000 7f2f72a77700 1 -- 172.21.15.155:0/3684041877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c04f400 con 0x7f2f6c113e40 2024-04-19T23:44:55.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:55.943+0000 7f2f697fa700 1 -- 172.21.15.155:0/3684041877 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f2f600133c0 con 0x7f2f6c113e40 2024-04-19T23:44:56.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.026+0000 7f2f72a77700 1 -- 172.21.15.155:0/3684041877 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ba9112f9-ce2a-4f53-9345-9a7c4ca89189", "id": 2} v 0) v1 -- 0x7f2f6c116b80 con 0x7f2f6c113e40 2024-04-19T23:44:56.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.028+0000 7f2f697fa700 1 -- 172.21.15.155:0/3684041877 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ba9112f9-ce2a-4f53-9345-9a7c4ca89189", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f60013ac0 con 0x7f2f6c113e40 2024-04-19T23:44:56.027 INFO:teuthology.orchestra.run.smithi155.stdout:2 2024-04-19T23:44:56.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.029+0000 7f2f72a77700 1 -- 172.21.15.155:0/3684041877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f6c113e40 msgr2=0x7f2f6c1a41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:56.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.029+0000 7f2f72a77700 1 --2- 172.21.15.155:0/3684041877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f6c113e40 0x7f2f6c1a41b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2f60001eb0 tx=0x7f2f6000c830 comp rx=0 tx=0).stop 2024-04-19T23:44:56.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.029+0000 7f2f72a77700 1 -- 172.21.15.155:0/3684041877 shutdown_connections 2024-04-19T23:44:56.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.029+0000 7f2f72a77700 1 --2- 172.21.15.155:0/3684041877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2f6c113e40 0x7f2f6c1a41b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:56.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.029+0000 7f2f72a77700 1 -- 172.21.15.155:0/3684041877 >> 172.21.15.155:0/3684041877 conn(0x7f2f6c06fe40 msgr2=0x7f2f6c071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:56.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.029+0000 7f2f72a77700 1 -- 172.21.15.155:0/3684041877 shutdown_connections 2024-04-19T23:44:56.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.029+0000 7f2f72a77700 1 -- 172.21.15.155:0/3684041877 wait complete. 2024-04-19T23:44:56.040 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new d67c8a52-2656-4aba-adc0-a2ece8ee5d1e 3 2024-04-19T23:44:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.163+0000 7f0d4f42b700 1 Processor -- start 2024-04-19T23:44:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.163+0000 7f0d4f42b700 1 -- start start 2024-04-19T23:44:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.163+0000 7f0d4f42b700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f0d4806bb40 0x7f0d4811c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.163+0000 7f0d4f42b700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4811c980 con 0x7f0d4806b050 2024-04-19T23:44:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.163+0000 7f0d4f42b700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4811db20 con 0x7f0d4806bb40 2024-04-19T23:44:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.163+0000 7f0d4c9c6700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f0d4806bb40 0x7f0d4811c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.163+0000 7f0d4d1c7700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f0d4806b050 0x7f0d4806b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:39426/0 (socket says 172.21.15.155:39426) 2024-04-19T23:44:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.164+0000 7f0d4d1c7700 1 -- 172.21.15.155:0/3666113725 learned_addr learned my addr 172.21.15.155:0/3666113725 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:44:56.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.164+0000 7f0d4c9c6700 1 -- 172.21.15.155:0/3666113725 >> v1:172.21.15.76:6789/0 conn(0x7f0d4806b050 legacy=0x7f0d4806b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.164+0000 7f0d4c9c6700 1 -- 172.21.15.155:0/3666113725 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4811dc90 con 0x7f0d4806bb40 2024-04-19T23:44:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.164+0000 7f0d3ffff700 1 -- 172.21.15.155:0/3666113725 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593053410 0 0) 0x7f0d4811c980 con 0x7f0d4806b050 2024-04-19T23:44:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.164+0000 7f0d4c9c6700 1 --2- 172.21.15.155:0/3666113725 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d4806bb40 0x7f0d4811c410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0d380097c0 tx=0x7f0d38009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9322ebbd66bc7fbf server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.164+0000 7f0d3ffff700 1 -- 172.21.15.155:0/3666113725 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d38004160 con 0x7f0d4806bb40 2024-04-19T23:44:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.164+0000 7f0d3ffff700 1 -- 172.21.15.155:0/3666113725 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d380042c0 con 0x7f0d4806bb40 2024-04-19T23:44:56.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.164+0000 7f0d3ffff700 1 -- 172.21.15.155:0/3666113725 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d38004580 con 0x7f0d4806bb40 2024-04-19T23:44:56.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.165+0000 7f0d4f42b700 1 -- 172.21.15.155:0/3666113725 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d4806bb40 msgr2=0x7f0d4811c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:56.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.165+0000 7f0d4f42b700 1 --2- 172.21.15.155:0/3666113725 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d4806bb40 0x7f0d4811c410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0d380097c0 tx=0x7f0d38009ad0 comp rx=0 tx=0).stop 2024-04-19T23:44:56.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.165+0000 7f0d4f42b700 1 -- 172.21.15.155:0/3666113725 shutdown_connections 2024-04-19T23:44:56.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.165+0000 7f0d4f42b700 1 --2- 172.21.15.155:0/3666113725 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d4806bb40 0x7f0d4811c410 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:56.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.165+0000 7f0d4f42b700 1 -- 172.21.15.155:0/3666113725 >> 172.21.15.155:0/3666113725 conn(0x7f0d4806fea0 msgr2=0x7f0d480722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:56.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.165+0000 7f0d4f42b700 1 -- 172.21.15.155:0/3666113725 shutdown_connections 2024-04-19T23:44:56.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.165+0000 7f0d4f42b700 1 -- 172.21.15.155:0/3666113725 wait complete. 2024-04-19T23:44:56.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.165+0000 7f0d4f42b700 1 Processor -- start 2024-04-19T23:44:56.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.166+0000 7f0d4f42b700 1 -- start start 2024-04-19T23:44:56.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.166+0000 7f0d4f42b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d4806b050 0x7f0d481ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:56.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.166+0000 7f0d4f42b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d481ab930 con 0x7f0d4806b050 2024-04-19T23:44:56.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.166+0000 7f0d4d1c7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d4806b050 0x7f0d481ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:56.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.166+0000 7f0d4d1c7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d4806b050 0x7f0d481ab360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:51878/0 (socket says 172.21.15.155:51878) 2024-04-19T23:44:56.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.166+0000 7f0d4d1c7700 1 -- 172.21.15.155:0/96527604 learned_addr learned my addr 172.21.15.155:0/96527604 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:44:56.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.166+0000 7f0d4d1c7700 1 -- 172.21.15.155:0/96527604 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380094a0 con 0x7f0d4806b050 2024-04-19T23:44:56.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.166+0000 7f0d4d1c7700 1 --2- 172.21.15.155:0/96527604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d4806b050 0x7f0d481ab360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d44001eb0 tx=0x7f0d4400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:56.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.166+0000 7f0d3dffb700 1 -- 172.21.15.155:0/96527604 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d44004bb0 con 0x7f0d4806b050 2024-04-19T23:44:56.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.167+0000 7f0d3dffb700 1 -- 172.21.15.155:0/96527604 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d44004d10 con 0x7f0d4806b050 2024-04-19T23:44:56.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.167+0000 7f0d4f42b700 1 -- 172.21.15.155:0/96527604 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d481abb30 con 0x7f0d4806b050 2024-04-19T23:44:56.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.167+0000 7f0d3dffb700 1 -- 172.21.15.155:0/96527604 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d440070d0 con 0x7f0d4806b050 2024-04-19T23:44:56.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.167+0000 7f0d3dffb700 1 -- 172.21.15.155:0/96527604 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0d440133c0 con 0x7f0d4806b050 2024-04-19T23:44:56.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.167+0000 7f0d4f42b700 1 -- 172.21.15.155:0/96527604 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d481a5450 con 0x7f0d4806b050 2024-04-19T23:44:56.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.167+0000 7f0d3dffb700 1 -- 172.21.15.155:0/96527604 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0d44013d30 con 0x7f0d4806b050 2024-04-19T23:44:56.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.168+0000 7f0d4f42b700 1 -- 172.21.15.155:0/96527604 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4804f400 con 0x7f0d4806b050 2024-04-19T23:44:56.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.170+0000 7f0d3dffb700 1 -- 172.21.15.155:0/96527604 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f0d440138a0 con 0x7f0d4806b050 2024-04-19T23:44:56.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.254+0000 7f0d4f42b700 1 -- 172.21.15.155:0/96527604 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d67c8a52-2656-4aba-adc0-a2ece8ee5d1e", "id": 3} v 0) v1 -- 0x7f0d4806bb40 con 0x7f0d4806b050 2024-04-19T23:44:56.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.256+0000 7f0d3dffb700 1 -- 172.21.15.155:0/96527604 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d67c8a52-2656-4aba-adc0-a2ece8ee5d1e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d44013ac0 con 0x7f0d4806b050 2024-04-19T23:44:56.255 INFO:teuthology.orchestra.run.smithi155.stdout:3 2024-04-19T23:44:56.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.257+0000 7f0d4f42b700 1 -- 172.21.15.155:0/96527604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d4806b050 msgr2=0x7f0d481ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:56.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.257+0000 7f0d4f42b700 1 --2- 172.21.15.155:0/96527604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d4806b050 0x7f0d481ab360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d44001eb0 tx=0x7f0d4400c830 comp rx=0 tx=0).stop 2024-04-19T23:44:56.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.257+0000 7f0d4f42b700 1 -- 172.21.15.155:0/96527604 shutdown_connections 2024-04-19T23:44:56.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.257+0000 7f0d4f42b700 1 --2- 172.21.15.155:0/96527604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d4806b050 0x7f0d481ab360 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:56.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.257+0000 7f0d4f42b700 1 -- 172.21.15.155:0/96527604 >> 172.21.15.155:0/96527604 conn(0x7f0d4806fea0 msgr2=0x7f0d481163c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:56.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.257+0000 7f0d4f42b700 1 -- 172.21.15.155:0/96527604 shutdown_connections 2024-04-19T23:44:56.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:44:56.257+0000 7f0d4f42b700 1 -- 172.21.15.155:0/96527604 wait complete. 2024-04-19T23:44:56.268 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-19T23:44:56.269 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-19T23:44:56.271 INFO:tasks.ceph.osd.0:Started 2024-04-19T23:44:56.271 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-19T23:44:56.271 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-19T23:44:56.274 INFO:tasks.ceph.osd.1:Started 2024-04-19T23:44:56.274 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-19T23:44:56.274 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-19T23:44:56.276 INFO:tasks.ceph.osd.2:Started 2024-04-19T23:44:56.276 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-19T23:44:56.276 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-19T23:44:56.278 INFO:tasks.ceph.osd.3:Started 2024-04-19T23:44:56.279 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T23:44:56.391 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:56.391+0000 7fd4919da200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-19T23:44:56.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.406+0000 7fd759c69700 1 Processor -- start 2024-04-19T23:44:56.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.406+0000 7fd759c69700 1 -- start start 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd759c69700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fd75412da00 0x7fd75412fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd759c69700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75406e1c0 con 0x7fd754095370 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd759c69700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd754096200 con 0x7fd75412da00 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd7537fe700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fd754095370 0x7fd754095750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:52998/0 (socket says 172.21.15.76:52998) 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd7537fe700 1 -- 172.21.15.76:0/1940033810 learned_addr learned my addr 172.21.15.76:0/1940033810 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd752ffd700 1 --2- 172.21.15.76:0/1940033810 >> v2:172.21.15.76:3300/0 conn(0x7fd75412da00 0x7fd75412fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd7527fc700 1 -- 172.21.15.76:0/1940033810 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474361987 0 0) 0x7fd75406e1c0 con 0x7fd754095370 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd7527fc700 1 -- 172.21.15.76:0/1940033810 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7400035b0 con 0x7fd754095370 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd752ffd700 1 -- 172.21.15.76:0/1940033810 >> v1:172.21.15.76:6789/0 conn(0x7fd754095370 legacy=0x7fd754095750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd752ffd700 1 -- 172.21.15.76:0/1940033810 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75404fb40 con 0x7fd75412da00 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd752ffd700 1 --2- 172.21.15.76:0/1940033810 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd75412da00 0x7fd75412fdf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd7440097c0 tx=0x7fd744009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d4a88555b6784 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.407+0000 7fd7527fc700 1 -- 172.21.15.76:0/1940033810 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd744004160 con 0x7fd75412da00 2024-04-19T23:44:56.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.408+0000 7fd7527fc700 1 -- 172.21.15.76:0/1940033810 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7440042c0 con 0x7fd75412da00 2024-04-19T23:44:56.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.408+0000 7fd7527fc700 1 -- 172.21.15.76:0/1940033810 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd744004580 con 0x7fd75412da00 2024-04-19T23:44:56.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.408+0000 7fd759c69700 1 -- 172.21.15.76:0/1940033810 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd75412da00 msgr2=0x7fd75412fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:56.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.408+0000 7fd759c69700 1 --2- 172.21.15.76:0/1940033810 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd75412da00 0x7fd75412fdf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd7440097c0 tx=0x7fd744009ad0 comp rx=0 tx=0).stop 2024-04-19T23:44:56.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.408+0000 7fd759c69700 1 -- 172.21.15.76:0/1940033810 shutdown_connections 2024-04-19T23:44:56.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.408+0000 7fd759c69700 1 --2- 172.21.15.76:0/1940033810 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd75412da00 0x7fd75412fdf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:56.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.408+0000 7fd759c69700 1 -- 172.21.15.76:0/1940033810 >> 172.21.15.76:0/1940033810 conn(0x7fd75409a5d0 msgr2=0x7fd75409a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:56.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.408+0000 7fd759c69700 1 -- 172.21.15.76:0/1940033810 shutdown_connections 2024-04-19T23:44:56.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.408+0000 7fd759c69700 1 -- 172.21.15.76:0/1940033810 wait complete. 2024-04-19T23:44:56.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.409+0000 7fd759c69700 1 Processor -- start 2024-04-19T23:44:56.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.409+0000 7fd759c69700 1 -- start start 2024-04-19T23:44:56.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.409+0000 7fd759c69700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd754095370 0x7fd7541230a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:56.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.409+0000 7fd759c69700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7541249b0 con 0x7fd754095370 2024-04-19T23:44:56.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.409+0000 7fd7537fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd754095370 0x7fd7541230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:56.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.410+0000 7fd7537fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd754095370 0x7fd7541230a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60698/0 (socket says 172.21.15.76:60698) 2024-04-19T23:44:56.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.410+0000 7fd7537fe700 1 -- 172.21.15.76:0/1685926319 learned_addr learned my addr 172.21.15.76:0/1685926319 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:44:56.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.410+0000 7fd7537fe700 1 -- 172.21.15.76:0/1685926319 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7440094a0 con 0x7fd754095370 2024-04-19T23:44:56.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.410+0000 7fd7537fe700 1 --2- 172.21.15.76:0/1685926319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd754095370 0x7fd7541230a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00c450 tx=0x7fd73c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:56.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.410+0000 7fd74bfff700 1 -- 172.21.15.76:0/1685926319 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd73c005ca0 con 0x7fd754095370 2024-04-19T23:44:56.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.410+0000 7fd74bfff700 1 -- 172.21.15.76:0/1685926319 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73c005e00 con 0x7fd754095370 2024-04-19T23:44:56.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.410+0000 7fd759c69700 1 -- 172.21.15.76:0/1685926319 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd754124190 con 0x7fd754095370 2024-04-19T23:44:56.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.410+0000 7fd74bfff700 1 -- 172.21.15.76:0/1685926319 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd73c007200 con 0x7fd754095370 2024-04-19T23:44:56.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.410+0000 7fd759c69700 1 -- 172.21.15.76:0/1685926319 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd754071e50 con 0x7fd754095370 2024-04-19T23:44:56.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.410+0000 7fd74bfff700 1 -- 172.21.15.76:0/1685926319 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd73c007660 con 0x7fd754095370 2024-04-19T23:44:56.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.410+0000 7fd74bfff700 1 -- 172.21.15.76:0/1685926319 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd73c012910 con 0x7fd754095370 2024-04-19T23:44:56.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.411+0000 7fd759c69700 1 -- 172.21.15.76:0/1685926319 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd754125630 con 0x7fd754095370 2024-04-19T23:44:56.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.413+0000 7fd74bfff700 1 -- 172.21.15.76:0/1685926319 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fd73c021060 con 0x7fd754095370 2024-04-19T23:44:56.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.480+0000 7fd759c69700 1 -- 172.21.15.76:0/1685926319 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd754067b70 con 0x7fd754095370 2024-04-19T23:44:56.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.480+0000 7fd74bfff700 1 -- 172.21.15.76:0/1685926319 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7fd754124190 con 0x7fd754095370 2024-04-19T23:44:56.480 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:44:56.480 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":6,"fsid":"b5aadf88-3af0-412d-86c8-081593c483a2","created":"2024-04-19T23:44:55.042601+0000","modified":"2024-04-19T23:44:56.255933+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T23:44:56.255933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb7b1ad0-ba98-4542-a23d-e070a35df21e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7cede46-301b-45db-ad7d-7c10f1844893","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ba9112f9-ce2a-4f53-9345-9a7c4ca89189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d67c8a52-2656-4aba-adc0-a2ece8ee5d1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T23:44:56.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.481+0000 7fd759c69700 1 -- 172.21.15.76:0/1685926319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd754095370 msgr2=0x7fd7541230a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:56.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.481+0000 7fd759c69700 1 --2- 172.21.15.76:0/1685926319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd754095370 0x7fd7541230a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00c450 tx=0x7fd73c00c810 comp rx=0 tx=0).stop 2024-04-19T23:44:56.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.481+0000 7fd759c69700 1 -- 172.21.15.76:0/1685926319 shutdown_connections 2024-04-19T23:44:56.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.481+0000 7fd759c69700 1 --2- 172.21.15.76:0/1685926319 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd754095370 0x7fd7541230a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:56.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.481+0000 7fd759c69700 1 -- 172.21.15.76:0/1685926319 >> 172.21.15.76:0/1685926319 conn(0x7fd75409a5d0 msgr2=0x7fd7541285f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:56.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.481+0000 7fd759c69700 1 -- 172.21.15.76:0/1685926319 shutdown_connections 2024-04-19T23:44:56.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:44:56.481+0000 7fd759c69700 1 -- 172.21.15.76:0/1685926319 wait complete. 2024-04-19T23:44:56.492 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-19T23:44:56.492 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-19T23:44:56.597 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:56.598+0000 7fd4919da200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-19T23:44:56.871 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-04-19T23:44:56.871+0000 7f97718a37c0 -1 Falling back to public interface 2024-04-19T23:44:56.876 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-04-19T23:44:56.876+0000 7fa746d037c0 -1 Falling back to public interface 2024-04-19T23:44:56.880 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-04-19T23:44:56.880+0000 7fe7d947e7c0 -1 Falling back to public interface 2024-04-19T23:44:56.881 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-04-19T23:44:56.881+0000 7f4b93be57c0 -1 Falling back to public interface 2024-04-19T23:44:56.895 DEBUG:teuthology.orchestra.run.smithi076:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T23:44:56.990 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:56.990+0000 7fd4919da200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T23:44:57.009 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.007+0000 7f4462aa0700 1 Processor -- start 2024-04-19T23:44:57.009 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.007+0000 7f4462aa0700 1 -- start start 2024-04-19T23:44:57.009 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.007+0000 7f4462aa0700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f445c1286d0 0x7f445c128ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:57.009 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.007+0000 7f4462aa0700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c071f40 con 0x7f445c06fb30 2024-04-19T23:44:57.009 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.007+0000 7f4462aa0700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c071c10 con 0x7f445c1286d0 2024-04-19T23:44:57.009 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.008+0000 7f446083c700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f445c1286d0 0x7f445c128ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:57.009 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.008+0000 7f445bfff700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f445c06fb30 0x7f445c06ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:53002/0 (socket says 172.21.15.76:53002) 2024-04-19T23:44:57.009 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.008+0000 7f445bfff700 1 -- 172.21.15.76:0/718591345 learned_addr learned my addr 172.21.15.76:0/718591345 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:44:57.009 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.008+0000 7f446083c700 1 -- 172.21.15.76:0/718591345 >> v1:172.21.15.76:6789/0 conn(0x7f445c06fb30 legacy=0x7f445c06ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.008+0000 7f446083c700 1 -- 172.21.15.76:0/718591345 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c09e500 con 0x7f445c1286d0 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.008+0000 7f446083c700 1 --2- 172.21.15.76:0/718591345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f445c1286d0 0x7f445c128ab0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f44500097c0 tx=0x7f4450009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce40c326c29acf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.008+0000 7f445b7fe700 1 -- 172.21.15.76:0/718591345 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4450004160 con 0x7f445c1286d0 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.008+0000 7f445b7fe700 1 -- 172.21.15.76:0/718591345 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44500042c0 con 0x7f445c1286d0 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.008+0000 7f445b7fe700 1 -- 172.21.15.76:0/718591345 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4450004580 con 0x7f445c1286d0 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.009+0000 7f4462aa0700 1 -- 172.21.15.76:0/718591345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f445c1286d0 msgr2=0x7f445c128ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.009+0000 7f4462aa0700 1 --2- 172.21.15.76:0/718591345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f445c1286d0 0x7f445c128ab0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f44500097c0 tx=0x7f4450009ad0 comp rx=0 tx=0).stop 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.009+0000 7f4462aa0700 1 -- 172.21.15.76:0/718591345 shutdown_connections 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.009+0000 7f4462aa0700 1 --2- 172.21.15.76:0/718591345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f445c1286d0 0x7f445c128ab0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.009+0000 7f4462aa0700 1 -- 172.21.15.76:0/718591345 >> 172.21.15.76:0/718591345 conn(0x7f445c09c0b0 msgr2=0x7f445c09db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.009+0000 7f4462aa0700 1 -- 172.21.15.76:0/718591345 shutdown_connections 2024-04-19T23:44:57.010 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.009+0000 7f4462aa0700 1 -- 172.21.15.76:0/718591345 wait complete. 2024-04-19T23:44:57.012 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.010+0000 7f4462aa0700 1 Processor -- start 2024-04-19T23:44:57.012 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.010+0000 7f4462aa0700 1 -- start start 2024-04-19T23:44:57.012 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.010+0000 7f4462aa0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f445c06fb30 0x7f445c115e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:44:57.012 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.010+0000 7f4462aa0700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c118400 con 0x7f445c06fb30 2024-04-19T23:44:57.012 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.010+0000 7f446083c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f445c06fb30 0x7f445c115e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:44:57.012 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.010+0000 7f446083c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f445c06fb30 0x7f445c115e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:60720/0 (socket says 172.21.15.76:60720) 2024-04-19T23:44:57.013 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.010+0000 7f446083c700 1 -- 172.21.15.76:0/449326729 learned_addr learned my addr 172.21.15.76:0/449326729 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:44:57.013 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.010+0000 7f446083c700 1 -- 172.21.15.76:0/449326729 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44500094a0 con 0x7f445c06fb30 2024-04-19T23:44:57.013 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.010+0000 7f446083c700 1 --2- 172.21.15.76:0/449326729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f445c06fb30 0x7f445c115e40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4450009b10 tx=0x7f4450004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:44:57.013 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.011+0000 7f44597fa700 1 -- 172.21.15.76:0/449326729 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4450011630 con 0x7f445c06fb30 2024-04-19T23:44:57.013 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.011+0000 7f44597fa700 1 -- 172.21.15.76:0/449326729 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445001e070 con 0x7f445c06fb30 2024-04-19T23:44:57.013 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.011+0000 7f4462aa0700 1 -- 172.21.15.76:0/449326729 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c1b3530 con 0x7f445c06fb30 2024-04-19T23:44:57.013 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.011+0000 7f44597fa700 1 -- 172.21.15.76:0/449326729 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4450011900 con 0x7f445c06fb30 2024-04-19T23:44:57.013 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.011+0000 7f4462aa0700 1 -- 172.21.15.76:0/449326729 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c117030 con 0x7f445c06fb30 2024-04-19T23:44:57.013 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.011+0000 7f44597fa700 1 -- 172.21.15.76:0/449326729 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f445001a430 con 0x7f445c06fb30 2024-04-19T23:44:57.013 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.011+0000 7f44597fa700 1 -- 172.21.15.76:0/449326729 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4450011db0 con 0x7f445c06fb30 2024-04-19T23:44:57.013 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.012+0000 7f4462aa0700 1 -- 172.21.15.76:0/449326729 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c119510 con 0x7f445c06fb30 2024-04-19T23:44:57.014 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.014+0000 7f44597fa700 1 -- 172.21.15.76:0/449326729 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f445c119510 con 0x7f445c06fb30 2024-04-19T23:44:57.080 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.080+0000 7f4462aa0700 1 -- 172.21.15.76:0/449326729 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f445c119300 con 0x7f445c06fb30 2024-04-19T23:44:57.081 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.081+0000 7f44597fa700 1 -- 172.21.15.76:0/449326729 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7f4450032060 con 0x7f445c06fb30 2024-04-19T23:44:57.081 INFO:teuthology.misc.health.smithi076.stdout: 2024-04-19T23:44:57.081 INFO:teuthology.misc.health.smithi076.stdout:{"epoch":6,"fsid":"b5aadf88-3af0-412d-86c8-081593c483a2","created":"2024-04-19T23:44:55.042601+0000","modified":"2024-04-19T23:44:56.255933+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T23:44:56.255933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb7b1ad0-ba98-4542-a23d-e070a35df21e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b7cede46-301b-45db-ad7d-7c10f1844893","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ba9112f9-ce2a-4f53-9345-9a7c4ca89189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d67c8a52-2656-4aba-adc0-a2ece8ee5d1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T23:44:57.082 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.081+0000 7f4462aa0700 1 -- 172.21.15.76:0/449326729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f445c06fb30 msgr2=0x7f445c115e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:44:57.082 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.081+0000 7f4462aa0700 1 --2- 172.21.15.76:0/449326729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f445c06fb30 0x7f445c115e40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4450009b10 tx=0x7f4450004750 comp rx=0 tx=0).stop 2024-04-19T23:44:57.082 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.082+0000 7f4462aa0700 1 -- 172.21.15.76:0/449326729 shutdown_connections 2024-04-19T23:44:57.082 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.082+0000 7f4462aa0700 1 --2- 172.21.15.76:0/449326729 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f445c06fb30 0x7f445c115e40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:44:57.082 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.082+0000 7f4462aa0700 1 -- 172.21.15.76:0/449326729 >> 172.21.15.76:0/449326729 conn(0x7f445c09c0b0 msgr2=0x7f445c1b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:44:57.083 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.082+0000 7f4462aa0700 1 -- 172.21.15.76:0/449326729 shutdown_connections 2024-04-19T23:44:57.083 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:44:57.082+0000 7f4462aa0700 1 -- 172.21.15.76:0/449326729 wait complete. 2024-04-19T23:44:57.092 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-19T23:44:57.673 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:57.673+0000 7fd4919da200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T23:44:57.748 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:57.749+0000 7fd4919da200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T23:44:57.883 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:57.883+0000 7fd4919da200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T23:44:58.059 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:58.059+0000 7fd4919da200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T23:44:58.132 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:58.132+0000 7fd4919da200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T23:44:58.210 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:58.211+0000 7fd4919da200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T23:44:58.289 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:58.289+0000 7fd4919da200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T23:44:58.383 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:58.383+0000 7fd4919da200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T23:44:58.579 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:58.579+0000 7fd4919da200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T23:44:58.793 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:58.794+0000 7fd4919da200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T23:44:58.950 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:58.951+0000 7fd4919da200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T23:44:59.020 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:59.021+0000 7fd4919da200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T23:44:59.759 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:59.759+0000 7fd4919da200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T23:44:59.924 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:44:59.924+0000 7fd4919da200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T23:45:00.081 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:45:00.081+0000 7fd4919da200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T23:45:00.314 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-04-19T23:45:00.314+0000 7f97718a37c0 -1 osd.0 0 log_to_monitors true 2024-04-19T23:45:00.400 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-04-19T23:45:00.401+0000 7f4b93be57c0 -1 osd.2 0 log_to_monitors true 2024-04-19T23:45:00.415 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-04-19T23:45:00.415+0000 7fa746d037c0 -1 osd.1 0 log_to_monitors true 2024-04-19T23:45:00.433 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-04-19T23:45:00.433+0000 7fe7d947e7c0 -1 osd.3 0 log_to_monitors true 2024-04-19T23:45:00.508 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:45:00.509+0000 7fd4919da200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T23:45:00.672 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:45:00.673+0000 7fd4919da200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T23:45:01.032 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:45:01.032+0000 7fd4919da200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T23:45:01.132 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:45:01.132+0000 7fd4919da200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T23:45:02.152 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-19T23:45:02.152+0000 7fd452dca700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-19T23:45:02.272 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-04-19T23:45:02.271+0000 7f9766c47700 -1 osd.0 0 waiting for initial osdmap 2024-04-19T23:45:02.283 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-04-19T23:45:02.283+0000 7f975d81f700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T23:45:03.496 DEBUG:teuthology.orchestra.run.smithi076:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T23:45:03.626 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.619+0000 7fd1565e8700 1 Processor -- start 2024-04-19T23:45:03.627 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.619+0000 7fd1565e8700 1 -- start start 2024-04-19T23:45:03.627 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.620+0000 7fd1565e8700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fd15012b060 0x7fd15012f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:03.627 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.620+0000 7fd1565e8700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15006de40 con 0x7fd15012a570 2024-04-19T23:45:03.627 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.620+0000 7fd1565e8700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15006dc10 con 0x7fd15012b060 2024-04-19T23:45:03.627 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.620+0000 7fd14f7fe700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fd15012b060 0x7fd15012f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:03.628 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.620+0000 7fd14ffff700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fd15012a570 0x7fd15012a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:54030/0 (socket says 172.21.15.76:54030) 2024-04-19T23:45:03.628 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.620+0000 7fd14ffff700 1 -- 172.21.15.76:0/3433041941 learned_addr learned my addr 172.21.15.76:0/3433041941 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:03.628 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.620+0000 7fd14f7fe700 1 -- 172.21.15.76:0/3433041941 >> v1:172.21.15.76:6789/0 conn(0x7fd15012a570 legacy=0x7fd15012a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:03.628 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.620+0000 7fd14f7fe700 1 -- 172.21.15.76:0/3433041941 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd150130de0 con 0x7fd15012b060 2024-04-19T23:45:03.628 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.620+0000 7fd14f7fe700 1 --2- 172.21.15.76:0/3433041941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd15012b060 0x7fd15012f890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd1380097c0 tx=0x7fd138009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb1a52f12e221da server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:03.628 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.621+0000 7fd14effd700 1 -- 172.21.15.76:0/3433041941 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd138004160 con 0x7fd15012b060 2024-04-19T23:45:03.629 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.621+0000 7fd14effd700 1 -- 172.21.15.76:0/3433041941 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1380042c0 con 0x7fd15012b060 2024-04-19T23:45:03.629 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.621+0000 7fd14effd700 1 -- 172.21.15.76:0/3433041941 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd138004580 con 0x7fd15012b060 2024-04-19T23:45:03.629 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.621+0000 7fd1565e8700 1 -- 172.21.15.76:0/3433041941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd15012b060 msgr2=0x7fd15012f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:03.629 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.621+0000 7fd1565e8700 1 --2- 172.21.15.76:0/3433041941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd15012b060 0x7fd15012f890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd1380097c0 tx=0x7fd138009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:03.629 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.621+0000 7fd1565e8700 1 -- 172.21.15.76:0/3433041941 shutdown_connections 2024-04-19T23:45:03.629 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.621+0000 7fd1565e8700 1 --2- 172.21.15.76:0/3433041941 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd15012b060 0x7fd15012f890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:03.630 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.621+0000 7fd1565e8700 1 -- 172.21.15.76:0/3433041941 >> 172.21.15.76:0/3433041941 conn(0x7fd1500998e0 msgr2=0x7fd150099cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:03.630 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.621+0000 7fd1565e8700 1 -- 172.21.15.76:0/3433041941 shutdown_connections 2024-04-19T23:45:03.630 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.621+0000 7fd1565e8700 1 -- 172.21.15.76:0/3433041941 wait complete. 2024-04-19T23:45:03.630 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.622+0000 7fd1565e8700 1 Processor -- start 2024-04-19T23:45:03.630 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.622+0000 7fd1565e8700 1 -- start start 2024-04-19T23:45:03.630 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd1565e8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd15012a570 0x7fd150093640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:03.630 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd1565e8700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15012f6a0 con 0x7fd15012a570 2024-04-19T23:45:03.631 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd14ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd15012a570 0x7fd150093640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:03.631 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd14ffff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd15012a570 0x7fd150093640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:41714/0 (socket says 172.21.15.76:41714) 2024-04-19T23:45:03.631 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd14ffff700 1 -- 172.21.15.76:0/4066313287 learned_addr learned my addr 172.21.15.76:0/4066313287 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:03.631 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd14ffff700 1 -- 172.21.15.76:0/4066313287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380094a0 con 0x7fd15012a570 2024-04-19T23:45:03.631 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd14ffff700 1 --2- 172.21.15.76:0/4066313287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd15012a570 0x7fd150093640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd14000c410 tx=0x7fd14000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:03.631 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd14cff9700 1 -- 172.21.15.76:0/4066313287 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd140005ca0 con 0x7fd15012a570 2024-04-19T23:45:03.632 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd14cff9700 1 -- 172.21.15.76:0/4066313287 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140005e00 con 0x7fd15012a570 2024-04-19T23:45:03.632 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd1565e8700 1 -- 172.21.15.76:0/4066313287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd150127e90 con 0x7fd15012a570 2024-04-19T23:45:03.632 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd14cff9700 1 -- 172.21.15.76:0/4066313287 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1400049c0 con 0x7fd15012a570 2024-04-19T23:45:03.632 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.623+0000 7fd1565e8700 1 -- 172.21.15.76:0/4066313287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1501230b0 con 0x7fd15012a570 2024-04-19T23:45:03.632 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.624+0000 7fd14cff9700 1 -- 172.21.15.76:0/4066313287 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 3) v1 ==== 44655+0+0 (secure 0 0 0) 0x7fd140004b20 con 0x7fd15012a570 2024-04-19T23:45:03.632 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.624+0000 7fd14cff9700 1 --2- 172.21.15.76:0/4066313287 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd1300375e0 0x7fd130039aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:03.632 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.624+0000 7fd14cff9700 1 -- 172.21.15.76:0/4066313287 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1903+0+0 (secure 0 0 0) 0x7fd140048f20 con 0x7fd15012a570 2024-04-19T23:45:03.633 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.624+0000 7fd1565e8700 1 -- 172.21.15.76:0/4066313287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd150122740 con 0x7fd15012a570 2024-04-19T23:45:03.633 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.624+0000 7fd14f7fe700 1 --2- 172.21.15.76:0/4066313287 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd1300375e0 0x7fd130039aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:03.633 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.625+0000 7fd14f7fe700 1 --2- 172.21.15.76:0/4066313287 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd1300375e0 0x7fd130039aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1380097c0 tx=0x7fd138008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:03.634 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.629+0000 7fd14cff9700 1 -- 172.21.15.76:0/4066313287 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7fd140011810 con 0x7fd15012a570 2024-04-19T23:45:03.821 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.821+0000 7fd1565e8700 1 -- 172.21.15.76:0/4066313287 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd150062510 con 0x7fd15012a570 2024-04-19T23:45:03.821 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.821+0000 7fd14cff9700 1 -- 172.21.15.76:0/4066313287 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4588 (secure 0 0 0) 0x7fd14003b030 con 0x7fd15012a570 2024-04-19T23:45:03.821 INFO:teuthology.misc.health.smithi076.stdout: 2024-04-19T23:45:03.821 INFO:teuthology.misc.health.smithi076.stdout:{"epoch":9,"fsid":"b5aadf88-3af0-412d-86c8-081593c483a2","created":"2024-04-19T23:44:55.042601+0000","modified":"2024-04-19T23:45:02.371745+0000","last_up_change":"2024-04-19T23:45:02.371745+0000","last_in_change":"2024-04-19T23:44:56.255933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb7b1ad0-ba98-4542-a23d-e070a35df21e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":39408},{"type":"v1","addr":"172.21.15.76:6801","nonce":39408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":39408},{"type":"v1","addr":"172.21.15.76:6803","nonce":39408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":39408},{"type":"v1","addr":"172.21.15.76:6807","nonce":39408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":39408},{"type":"v1","addr":"172.21.15.76:6805","nonce":39408}]},"public_addr":"172.21.15.76:6801/39408","cluster_addr":"172.21.15.76:6803/39408","heartbeat_back_addr":"172.21.15.76:6807/39408","heartbeat_front_addr":"172.21.15.76:6805/39408","state":["exists","up"]},{"osd":1,"uuid":"b7cede46-301b-45db-ad7d-7c10f1844893","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ba9112f9-ce2a-4f53-9345-9a7c4ca89189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d67c8a52-2656-4aba-adc0-a2ece8ee5d1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T23:45:03.824 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.823+0000 7fd1565e8700 1 -- 172.21.15.76:0/4066313287 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd1300375e0 msgr2=0x7fd130039aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:03.824 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.823+0000 7fd1565e8700 1 --2- 172.21.15.76:0/4066313287 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd1300375e0 0x7fd130039aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1380097c0 tx=0x7fd138008030 comp rx=0 tx=0).stop 2024-04-19T23:45:03.824 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.823+0000 7fd1565e8700 1 -- 172.21.15.76:0/4066313287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd15012a570 msgr2=0x7fd150093640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:03.824 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.823+0000 7fd1565e8700 1 --2- 172.21.15.76:0/4066313287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd15012a570 0x7fd150093640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd14000c410 tx=0x7fd14000c7d0 comp rx=0 tx=0).stop 2024-04-19T23:45:03.824 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.823+0000 7fd1565e8700 1 -- 172.21.15.76:0/4066313287 shutdown_connections 2024-04-19T23:45:03.824 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.823+0000 7fd1565e8700 1 --2- 172.21.15.76:0/4066313287 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd1300375e0 0x7fd130039aa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:03.824 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.823+0000 7fd1565e8700 1 --2- 172.21.15.76:0/4066313287 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd15012a570 0x7fd150093640 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:03.824 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.823+0000 7fd1565e8700 1 -- 172.21.15.76:0/4066313287 >> 172.21.15.76:0/4066313287 conn(0x7fd1500998e0 msgr2=0x7fd150098d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:03.824 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.823+0000 7fd1565e8700 1 -- 172.21.15.76:0/4066313287 shutdown_connections 2024-04-19T23:45:03.824 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:03.823+0000 7fd1565e8700 1 -- 172.21.15.76:0/4066313287 wait complete. 2024-04-19T23:45:03.834 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-04-19T23:45:03.967 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-04-19T23:45:03.968+0000 7f4b87786700 -1 osd.2 0 waiting for initial osdmap 2024-04-19T23:45:03.982 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-04-19T23:45:03.983+0000 7f4b7fb61700 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T23:45:04.005 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-04-19T23:45:04.005+0000 7fe7cd01f700 -1 osd.3 0 waiting for initial osdmap 2024-04-19T23:45:04.017 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-04-19T23:45:04.018+0000 7fe7c53fa700 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T23:45:04.041 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-04-19T23:45:04.042+0000 7fa73a8a4700 -1 osd.1 0 waiting for initial osdmap 2024-04-19T23:45:04.053 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-04-19T23:45:04.055+0000 7fa732c7f700 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T23:45:10.238 DEBUG:teuthology.orchestra.run.smithi076:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T23:45:10.367 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.365+0000 7f2131995700 1 Processor -- start 2024-04-19T23:45:10.367 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.365+0000 7f2131995700 1 -- start start 2024-04-19T23:45:10.367 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.365+0000 7f2131995700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f212c094e20 0x7f212c12f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:10.367 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.365+0000 7f2131995700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212c06c810 con 0x7f212c12a020 2024-04-19T23:45:10.367 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.365+0000 7f2131995700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c06d560 con 0x7f212c094e20 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.365+0000 7f212affd700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f212c12a020 0x7f212c12a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48858/0 (socket says 172.21.15.76:48858) 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.365+0000 7f212affd700 1 -- 172.21.15.76:0/2768218675 learned_addr learned my addr 172.21.15.76:0/2768218675 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.365+0000 7f212a7fc700 1 --2- 172.21.15.76:0/2768218675 >> v2:172.21.15.76:3300/0 conn(0x7f212c094e20 0x7f212c12f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.366+0000 7f2129ffb700 1 -- 172.21.15.76:0/2768218675 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015388675 0 0) 0x7f212c06c810 con 0x7f212c12a020 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.366+0000 7f2129ffb700 1 -- 172.21.15.76:0/2768218675 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21140035b0 con 0x7f212c12a020 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.366+0000 7f212a7fc700 1 -- 172.21.15.76:0/2768218675 >> v1:172.21.15.76:6789/0 conn(0x7f212c12a020 legacy=0x7f212c12a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.366+0000 7f212a7fc700 1 -- 172.21.15.76:0/2768218675 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c095770 con 0x7f212c094e20 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.366+0000 7f212a7fc700 1 --2- 172.21.15.76:0/2768218675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f212c094e20 0x7f212c12f200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f211c0097c0 tx=0x7f211c009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d009e1d0b16c5da7 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.366+0000 7f2129ffb700 1 -- 172.21.15.76:0/2768218675 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f211c004160 con 0x7f212c094e20 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.366+0000 7f2129ffb700 1 -- 172.21.15.76:0/2768218675 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c0042c0 con 0x7f212c094e20 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.366+0000 7f2129ffb700 1 -- 172.21.15.76:0/2768218675 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f211c004560 con 0x7f212c094e20 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.367+0000 7f2131995700 1 -- 172.21.15.76:0/2768218675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f212c094e20 msgr2=0x7f212c12f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.367+0000 7f2131995700 1 --2- 172.21.15.76:0/2768218675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f212c094e20 0x7f212c12f200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f211c0097c0 tx=0x7f211c009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.367+0000 7f2131995700 1 -- 172.21.15.76:0/2768218675 shutdown_connections 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.367+0000 7f2131995700 1 --2- 172.21.15.76:0/2768218675 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f212c094e20 0x7f212c12f200 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:10.368 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.367+0000 7f2131995700 1 -- 172.21.15.76:0/2768218675 >> 172.21.15.76:0/2768218675 conn(0x7f212c09c080 msgr2=0x7f212c09c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:10.369 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.367+0000 7f2131995700 1 -- 172.21.15.76:0/2768218675 shutdown_connections 2024-04-19T23:45:10.369 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.367+0000 7f2131995700 1 -- 172.21.15.76:0/2768218675 wait complete. 2024-04-19T23:45:10.371 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.367+0000 7f2131995700 1 Processor -- start 2024-04-19T23:45:10.371 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.368+0000 7f2131995700 1 -- start start 2024-04-19T23:45:10.371 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.368+0000 7f2131995700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f212c094e20 0x7f212c122ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:10.371 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.368+0000 7f2131995700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c125b30 con 0x7f212c094e20 2024-04-19T23:45:10.371 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.368+0000 7f212affd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f212c094e20 0x7f212c122ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:10.371 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.368+0000 7f212affd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f212c094e20 0x7f212c122ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49628/0 (socket says 172.21.15.76:49628) 2024-04-19T23:45:10.371 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.368+0000 7f212affd700 1 -- 172.21.15.76:0/2783248417 learned_addr learned my addr 172.21.15.76:0/2783248417 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:10.371 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.369+0000 7f212affd700 1 -- 172.21.15.76:0/2783248417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c0094a0 con 0x7f212c094e20 2024-04-19T23:45:10.371 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.369+0000 7f212affd700 1 --2- 172.21.15.76:0/2783248417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f212c094e20 0x7f212c122ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f212000c3a0 tx=0x7f212000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:10.371 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.369+0000 7f2113fff700 1 -- 172.21.15.76:0/2783248417 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2120005b70 con 0x7f212c094e20 2024-04-19T23:45:10.371 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.369+0000 7f2113fff700 1 -- 172.21.15.76:0/2783248417 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2120005cd0 con 0x7f212c094e20 2024-04-19T23:45:10.372 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.369+0000 7f2113fff700 1 -- 172.21.15.76:0/2783248417 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21200070d0 con 0x7f212c094e20 2024-04-19T23:45:10.372 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.369+0000 7f2131995700 1 -- 172.21.15.76:0/2783248417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c1245b0 con 0x7f212c094e20 2024-04-19T23:45:10.372 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.369+0000 7f2131995700 1 -- 172.21.15.76:0/2783248417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c123fd0 con 0x7f212c094e20 2024-04-19T23:45:10.372 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.370+0000 7f2113fff700 1 -- 172.21.15.76:0/2783248417 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f2120007230 con 0x7f212c094e20 2024-04-19T23:45:10.372 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.370+0000 7f2113fff700 1 --2- 172.21.15.76:0/2783248417 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2118037790 0x7f2118039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:10.372 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.370+0000 7f2131995700 1 -- 172.21.15.76:0/2783248417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c12f3d0 con 0x7f212c094e20 2024-04-19T23:45:10.372 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.370+0000 7f2113fff700 1 -- 172.21.15.76:0/2783248417 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f2120049000 con 0x7f212c094e20 2024-04-19T23:45:10.372 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.370+0000 7f212a7fc700 1 --2- 172.21.15.76:0/2783248417 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2118037790 0x7f2118039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:10.372 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.371+0000 7f212a7fc700 1 --2- 172.21.15.76:0/2783248417 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2118037790 0x7f2118039c50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f212c095270 tx=0x7f211c013040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:10.375 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.375+0000 7f2113fff700 1 -- 172.21.15.76:0/2783248417 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f212c12f3d0 con 0x7f212c094e20 2024-04-19T23:45:10.566 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.566+0000 7f2131995700 1 -- 172.21.15.76:0/2783248417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f212c123fd0 con 0x7f212c094e20 2024-04-19T23:45:10.566 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.566+0000 7f2113fff700 1 -- 172.21.15.76:0/2783248417 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7716 (secure 0 0 0) 0x7f212c123fd0 con 0x7f212c094e20 2024-04-19T23:45:10.567 INFO:teuthology.misc.health.smithi076.stdout: 2024-04-19T23:45:10.567 INFO:teuthology.misc.health.smithi076.stdout:{"epoch":14,"fsid":"b5aadf88-3af0-412d-86c8-081593c483a2","created":"2024-04-19T23:44:55.042601+0000","modified":"2024-04-19T23:45:08.165223+0000","last_up_change":"2024-04-19T23:45:04.156942+0000","last_in_change":"2024-04-19T23:44:56.255933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T23:45:05.189599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb7b1ad0-ba98-4542-a23d-e070a35df21e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":39408},{"type":"v1","addr":"172.21.15.76:6801","nonce":39408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":39408},{"type":"v1","addr":"172.21.15.76:6803","nonce":39408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":39408},{"type":"v1","addr":"172.21.15.76:6807","nonce":39408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":39408},{"type":"v1","addr":"172.21.15.76:6805","nonce":39408}]},"public_addr":"172.21.15.76:6801/39408","cluster_addr":"172.21.15.76:6803/39408","heartbeat_back_addr":"172.21.15.76:6807/39408","heartbeat_front_addr":"172.21.15.76:6805/39408","state":["exists","up"]},{"osd":1,"uuid":"b7cede46-301b-45db-ad7d-7c10f1844893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":41833},{"type":"v1","addr":"172.21.15.155:6801","nonce":41833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":41833},{"type":"v1","addr":"172.21.15.155:6803","nonce":41833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":41833},{"type":"v1","addr":"172.21.15.155:6807","nonce":41833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":41833},{"type":"v1","addr":"172.21.15.155:6805","nonce":41833}]},"public_addr":"172.21.15.155:6801/41833","cluster_addr":"172.21.15.155:6803/41833","heartbeat_back_addr":"172.21.15.155:6807/41833","heartbeat_front_addr":"172.21.15.155:6805/41833","state":["exists","up"]},{"osd":2,"uuid":"ba9112f9-ce2a-4f53-9345-9a7c4ca89189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":41834},{"type":"v1","addr":"172.21.15.155:6814","nonce":41834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":41834},{"type":"v1","addr":"172.21.15.155:6817","nonce":41834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":41834},{"type":"v1","addr":"172.21.15.155:6823","nonce":41834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":41834},{"type":"v1","addr":"172.21.15.155:6821","nonce":41834}]},"public_addr":"172.21.15.155:6814/41834","cluster_addr":"172.21.15.155:6817/41834","heartbeat_back_addr":"172.21.15.155:6823/41834","heartbeat_front_addr":"172.21.15.155:6821/41834","state":["exists","up"]},{"osd":3,"uuid":"d67c8a52-2656-4aba-adc0-a2ece8ee5d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":41835},{"type":"v1","addr":"172.21.15.155:6809","nonce":41835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":41835},{"type":"v1","addr":"172.21.15.155:6811","nonce":41835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":41835},{"type":"v1","addr":"172.21.15.155:6820","nonce":41835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":41835},{"type":"v1","addr":"172.21.15.155:6816","nonce":41835}]},"public_addr":"172.21.15.155:6809/41835","cluster_addr":"172.21.15.155:6811/41835","heartbeat_back_addr":"172.21.15.155:6820/41835","heartbeat_front_addr":"172.21.15.155:6816/41835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.317706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.455846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.412581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.421620+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T23:45:10.569 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.568+0000 7f2131995700 1 -- 172.21.15.76:0/2783248417 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2118037790 msgr2=0x7f2118039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:10.569 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.568+0000 7f2131995700 1 --2- 172.21.15.76:0/2783248417 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2118037790 0x7f2118039c50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f212c095270 tx=0x7f211c013040 comp rx=0 tx=0).stop 2024-04-19T23:45:10.569 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.568+0000 7f2131995700 1 -- 172.21.15.76:0/2783248417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f212c094e20 msgr2=0x7f212c122ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:10.569 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.568+0000 7f2131995700 1 --2- 172.21.15.76:0/2783248417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f212c094e20 0x7f212c122ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f212000c3a0 tx=0x7f212000c760 comp rx=0 tx=0).stop 2024-04-19T23:45:10.569 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.568+0000 7f2131995700 1 -- 172.21.15.76:0/2783248417 shutdown_connections 2024-04-19T23:45:10.569 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.568+0000 7f2131995700 1 --2- 172.21.15.76:0/2783248417 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2118037790 0x7f2118039c50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:10.569 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.568+0000 7f2131995700 1 --2- 172.21.15.76:0/2783248417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f212c094e20 0x7f212c122ee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:10.569 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.568+0000 7f2131995700 1 -- 172.21.15.76:0/2783248417 >> 172.21.15.76:0/2783248417 conn(0x7f212c09c080 msgr2=0x7f212c070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:10.570 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.569+0000 7f2131995700 1 -- 172.21.15.76:0/2783248417 shutdown_connections 2024-04-19T23:45:10.570 INFO:teuthology.misc.health.smithi076.stderr:2024-04-19T23:45:10.569+0000 7f2131995700 1 -- 172.21.15.76:0/2783248417 wait complete. 2024-04-19T23:45:10.579 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-19T23:45:10.579 INFO:tasks.ceph:Creating RBD pool 2024-04-19T23:45:10.580 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-19T23:45:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.699+0000 7f098d8f0700 1 Processor -- start 2024-04-19T23:45:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.699+0000 7f098d8f0700 1 -- start start 2024-04-19T23:45:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.699+0000 7f098d8f0700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f09880939f0 0x7f0988093dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.699+0000 7f098d8f0700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098806d980 con 0x7f0988094310 2024-04-19T23:45:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.699+0000 7f098d8f0700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0988095a50 con 0x7f09880939f0 2024-04-19T23:45:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.699+0000 7f0986ffd700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f09880939f0 0x7f0988093dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.699+0000 7f09867fc700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f0988094310 0x7f0988129e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48866/0 (socket says 172.21.15.76:48866) 2024-04-19T23:45:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.699+0000 7f09867fc700 1 -- 172.21.15.76:0/982259865 learned_addr learned my addr 172.21.15.76:0/982259865 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.700+0000 7f0986ffd700 1 -- 172.21.15.76:0/982259865 >> v1:172.21.15.76:6789/0 conn(0x7f0988094310 legacy=0x7f0988129e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.700+0000 7f0986ffd700 1 -- 172.21.15.76:0/982259865 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098806d590 con 0x7f09880939f0 2024-04-19T23:45:10.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.700+0000 7f0986ffd700 1 --2- 172.21.15.76:0/982259865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09880939f0 0x7f0988093dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f09780097c0 tx=0x7f0978009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91856e0558284a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:10.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.700+0000 7f0985ffb700 1 -- 172.21.15.76:0/982259865 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0978004160 con 0x7f09880939f0 2024-04-19T23:45:10.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.700+0000 7f0985ffb700 1 -- 172.21.15.76:0/982259865 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09780042c0 con 0x7f09880939f0 2024-04-19T23:45:10.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.700+0000 7f0985ffb700 1 -- 172.21.15.76:0/982259865 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0978004580 con 0x7f09880939f0 2024-04-19T23:45:10.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.700+0000 7f098d8f0700 1 -- 172.21.15.76:0/982259865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09880939f0 msgr2=0x7f0988093dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:10.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.700+0000 7f098d8f0700 1 --2- 172.21.15.76:0/982259865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09880939f0 0x7f0988093dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f09780097c0 tx=0x7f0978009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:10.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.700+0000 7f098d8f0700 1 -- 172.21.15.76:0/982259865 shutdown_connections 2024-04-19T23:45:10.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.700+0000 7f098d8f0700 1 --2- 172.21.15.76:0/982259865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09880939f0 0x7f0988093dd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:10.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.700+0000 7f098d8f0700 1 -- 172.21.15.76:0/982259865 >> 172.21.15.76:0/982259865 conn(0x7f0988099b60 msgr2=0x7f0988099f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:10.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.701+0000 7f098d8f0700 1 -- 172.21.15.76:0/982259865 shutdown_connections 2024-04-19T23:45:10.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.701+0000 7f098d8f0700 1 -- 172.21.15.76:0/982259865 wait complete. 2024-04-19T23:45:10.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.701+0000 7f098d8f0700 1 Processor -- start 2024-04-19T23:45:10.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.701+0000 7f098d8f0700 1 -- start start 2024-04-19T23:45:10.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.702+0000 7f098d8f0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09880939f0 0x7f09881bbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.702+0000 7f098d8f0700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09881a9ed0 con 0x7f09880939f0 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.702+0000 7f0986ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09880939f0 0x7f09881bbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.702+0000 7f0986ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09880939f0 0x7f09881bbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49638/0 (socket says 172.21.15.76:49638) 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.702+0000 7f0986ffd700 1 -- 172.21.15.76:0/2183925414 learned_addr learned my addr 172.21.15.76:0/2183925414 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.702+0000 7f0986ffd700 1 -- 172.21.15.76:0/2183925414 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09780094a0 con 0x7f09880939f0 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.702+0000 7f0986ffd700 1 --2- 172.21.15.76:0/2183925414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09880939f0 0x7f09881bbaa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0978009b10 tx=0x7f0978004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.702+0000 7f096ffff700 1 -- 172.21.15.76:0/2183925414 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f097801d070 con 0x7f09880939f0 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.702+0000 7f096ffff700 1 -- 172.21.15.76:0/2183925414 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978010600 con 0x7f09880939f0 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.702+0000 7f096ffff700 1 -- 172.21.15.76:0/2183925414 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09780108c0 con 0x7f09880939f0 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.702+0000 7f098d8f0700 1 -- 172.21.15.76:0/2183925414 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09880920e0 con 0x7f09880939f0 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.703+0000 7f098d8f0700 1 -- 172.21.15.76:0/2183925414 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09881aa110 con 0x7f09880939f0 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.703+0000 7f096ffff700 1 -- 172.21.15.76:0/2183925414 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f0978021070 con 0x7f09880939f0 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.703+0000 7f098d8f0700 1 -- 172.21.15.76:0/2183925414 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098806f560 con 0x7f09880939f0 2024-04-19T23:45:10.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.703+0000 7f096ffff700 1 --2- 172.21.15.76:0/2183925414 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0974037790 0x7f0974039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:10.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.703+0000 7f096ffff700 1 -- 172.21.15.76:0/2183925414 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f097804b0f0 con 0x7f09880939f0 2024-04-19T23:45:10.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.704+0000 7f09867fc700 1 --2- 172.21.15.76:0/2183925414 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0974037790 0x7f0974039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:10.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.704+0000 7f09867fc700 1 --2- 172.21.15.76:0/2183925414 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0974037790 0x7f0974039c50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f097c000f60 tx=0x7f097c007b10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:10.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.708+0000 7f096ffff700 1 -- 172.21.15.76:0/2183925414 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f097800fb80 con 0x7f09880939f0 2024-04-19T23:45:10.898 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:10.898+0000 7f098d8f0700 1 -- 172.21.15.76:0/2183925414 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f098809cb70 con 0x7f09880939f0 2024-04-19T23:45:11.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.179+0000 7f096ffff700 1 -- 172.21.15.76:0/2183925414 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f0978028070 con 0x7f09880939f0 2024-04-19T23:45:11.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.182+0000 7f098d8f0700 1 -- 172.21.15.76:0/2183925414 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0974037790 msgr2=0x7f0974039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:11.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.182+0000 7f098d8f0700 1 --2- 172.21.15.76:0/2183925414 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0974037790 0x7f0974039c50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f097c000f60 tx=0x7f097c007b10 comp rx=0 tx=0).stop 2024-04-19T23:45:11.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.182+0000 7f098d8f0700 1 -- 172.21.15.76:0/2183925414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09880939f0 msgr2=0x7f09881bbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:11.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.182+0000 7f098d8f0700 1 --2- 172.21.15.76:0/2183925414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09880939f0 0x7f09881bbaa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0978009b10 tx=0x7f0978004750 comp rx=0 tx=0).stop 2024-04-19T23:45:11.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.182+0000 7f098d8f0700 1 -- 172.21.15.76:0/2183925414 shutdown_connections 2024-04-19T23:45:11.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.182+0000 7f098d8f0700 1 --2- 172.21.15.76:0/2183925414 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0974037790 0x7f0974039c50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:11.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.182+0000 7f098d8f0700 1 --2- 172.21.15.76:0/2183925414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f09880939f0 0x7f09881bbaa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:11.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.182+0000 7f098d8f0700 1 -- 172.21.15.76:0/2183925414 >> 172.21.15.76:0/2183925414 conn(0x7f0988099b60 msgr2=0x7f098808afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:11.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.182+0000 7f098d8f0700 1 -- 172.21.15.76:0/2183925414 shutdown_connections 2024-04-19T23:45:11.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.182+0000 7f098d8f0700 1 -- 172.21.15.76:0/2183925414 wait complete. 2024-04-19T23:45:11.183 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'rbd' created 2024-04-19T23:45:11.195 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-19T23:45:11.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.316+0000 7fd332836700 1 Processor -- start 2024-04-19T23:45:11.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.316+0000 7fd332836700 1 -- start start 2024-04-19T23:45:11.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.316+0000 7fd332836700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fd32c093440 0x7fd32c093820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:11.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.316+0000 7fd332836700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c097180 con 0x7fd32c121d30 2024-04-19T23:45:11.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.316+0000 7fd332836700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c06ee20 con 0x7fd32c093440 2024-04-19T23:45:11.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.316+0000 7fd32bfff700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fd32c093440 0x7fd32c093820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:11.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.316+0000 7fd32b7fe700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fd32c121d30 0x7fd32c122190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48874/0 (socket says 172.21.15.76:48874) 2024-04-19T23:45:11.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.316+0000 7fd32b7fe700 1 -- 172.21.15.76:0/4136886905 learned_addr learned my addr 172.21.15.76:0/4136886905 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:11.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd32bfff700 1 -- 172.21.15.76:0/4136886905 >> v1:172.21.15.76:6789/0 conn(0x7fd32c121d30 legacy=0x7fd32c122190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:11.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd32bfff700 1 -- 172.21.15.76:0/4136886905 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c072830 con 0x7fd32c093440 2024-04-19T23:45:11.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd32affd700 1 -- 172.21.15.76:0/4136886905 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947908310 0 0) 0x7fd32c097180 con 0x7fd32c121d30 2024-04-19T23:45:11.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd32bfff700 1 --2- 172.21.15.76:0/4136886905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd32c093440 0x7fd32c093820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0097c0 tx=0x7fd31c009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756cf2d631c3b633 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:11.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd32affd700 1 -- 172.21.15.76:0/4136886905 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd31c004160 con 0x7fd32c093440 2024-04-19T23:45:11.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd32affd700 1 -- 172.21.15.76:0/4136886905 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c0042c0 con 0x7fd32c093440 2024-04-19T23:45:11.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd32affd700 1 -- 172.21.15.76:0/4136886905 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd31c004580 con 0x7fd32c093440 2024-04-19T23:45:11.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd332836700 1 -- 172.21.15.76:0/4136886905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd32c093440 msgr2=0x7fd32c093820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:11.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd332836700 1 --2- 172.21.15.76:0/4136886905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd32c093440 0x7fd32c093820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0097c0 tx=0x7fd31c009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:11.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd332836700 1 -- 172.21.15.76:0/4136886905 shutdown_connections 2024-04-19T23:45:11.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd332836700 1 --2- 172.21.15.76:0/4136886905 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd32c093440 0x7fd32c093820 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:11.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd332836700 1 -- 172.21.15.76:0/4136886905 >> 172.21.15.76:0/4136886905 conn(0x7fd32c09d090 msgr2=0x7fd32c09d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:11.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd332836700 1 -- 172.21.15.76:0/4136886905 shutdown_connections 2024-04-19T23:45:11.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.317+0000 7fd332836700 1 -- 172.21.15.76:0/4136886905 wait complete. 2024-04-19T23:45:11.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.318+0000 7fd332836700 1 Processor -- start 2024-04-19T23:45:11.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.318+0000 7fd332836700 1 -- start start 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd332836700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd32c093440 0x7fd32c1ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd332836700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c1b0650 con 0x7fd32c093440 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd32bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd32c093440 0x7fd32c1ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd32bfff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd32c093440 0x7fd32c1ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49666/0 (socket says 172.21.15.76:49666) 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd32bfff700 1 -- 172.21.15.76:0/1534414703 learned_addr learned my addr 172.21.15.76:0/1534414703 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd32bfff700 1 -- 172.21.15.76:0/1534414703 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c0094a0 con 0x7fd32c093440 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd32bfff700 1 --2- 172.21.15.76:0/1534414703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd32c093440 0x7fd32c1ae230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009b10 tx=0x7fd31c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd328ff9700 1 -- 172.21.15.76:0/1534414703 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd31c011630 con 0x7fd32c093440 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd328ff9700 1 -- 172.21.15.76:0/1534414703 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c011790 con 0x7fd32c093440 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd328ff9700 1 -- 172.21.15.76:0/1534414703 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd31c011a70 con 0x7fd32c093440 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd332836700 1 -- 172.21.15.76:0/1534414703 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32c128ca0 con 0x7fd32c093440 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.319+0000 7fd332836700 1 -- 172.21.15.76:0/1534414703 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c1284d0 con 0x7fd32c093440 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.320+0000 7fd328ff9700 1 -- 172.21.15.76:0/1534414703 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7fd31c011c20 con 0x7fd32c093440 2024-04-19T23:45:11.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.320+0000 7fd332836700 1 -- 172.21.15.76:0/1534414703 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c1b08c0 con 0x7fd32c093440 2024-04-19T23:45:11.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.320+0000 7fd328ff9700 1 --2- 172.21.15.76:0/1534414703 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd318037760 0x7fd318039c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:11.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.320+0000 7fd328ff9700 1 -- 172.21.15.76:0/1534414703 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3471+0+0 (secure 0 0 0) 0x7fd31c04b9b0 con 0x7fd32c093440 2024-04-19T23:45:11.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.321+0000 7fd32b7fe700 1 --2- 172.21.15.76:0/1534414703 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd318037760 0x7fd318039c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:11.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.321+0000 7fd32b7fe700 1 --2- 172.21.15.76:0/1534414703 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd318037760 0x7fd318039c20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd320000c00 tx=0x7fd320007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:11.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.325+0000 7fd328ff9700 1 -- 172.21.15.76:0/1534414703 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7fd32c1b08c0 con 0x7fd32c093440 2024-04-19T23:45:11.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:11.516+0000 7fd332836700 1 -- 172.21.15.76:0/1534414703 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd32c1b08c0 con 0x7fd32c093440 2024-04-19T23:45:12.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.179+0000 7fd328ff9700 1 -- 172.21.15.76:0/1534414703 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd32c1b08c0 con 0x7fd32c093440 2024-04-19T23:45:12.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.182+0000 7fd332836700 1 -- 172.21.15.76:0/1534414703 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd318037760 msgr2=0x7fd318039c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:12.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.182+0000 7fd332836700 1 --2- 172.21.15.76:0/1534414703 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd318037760 0x7fd318039c20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd320000c00 tx=0x7fd320007b50 comp rx=0 tx=0).stop 2024-04-19T23:45:12.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.182+0000 7fd332836700 1 -- 172.21.15.76:0/1534414703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd32c093440 msgr2=0x7fd32c1ae230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:12.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.182+0000 7fd332836700 1 --2- 172.21.15.76:0/1534414703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd32c093440 0x7fd32c1ae230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009b10 tx=0x7fd31c0047c0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.182+0000 7fd332836700 1 -- 172.21.15.76:0/1534414703 shutdown_connections 2024-04-19T23:45:12.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.182+0000 7fd332836700 1 --2- 172.21.15.76:0/1534414703 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd318037760 0x7fd318039c20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.182+0000 7fd332836700 1 --2- 172.21.15.76:0/1534414703 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd32c093440 0x7fd32c1ae230 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.182+0000 7fd332836700 1 -- 172.21.15.76:0/1534414703 >> 172.21.15.76:0/1534414703 conn(0x7fd32c09d090 msgr2=0x7fd32c099770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:12.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.183+0000 7fd332836700 1 -- 172.21.15.76:0/1534414703 shutdown_connections 2024-04-19T23:45:12.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.183+0000 7fd332836700 1 -- 172.21.15.76:0/1534414703 wait complete. 2024-04-19T23:45:12.184 INFO:teuthology.orchestra.run.smithi076.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-19T23:45:12.195 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-19T23:45:12.196 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-19T23:45:12.196 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-19T23:45:12.196 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-19T23:45:12.196 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.317+0000 7f51e7143700 1 Processor -- start 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.317+0000 7f51e7143700 1 -- start start 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.317+0000 7f51e7143700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f51e0097070 0x7f51e0096240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.317+0000 7f51e7143700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e0094e60 con 0x7f51e0095750 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.317+0000 7f51e7143700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e00977e0 con 0x7f51e0097070 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.317+0000 7f51dffff700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f51e0097070 0x7f51e0096240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.317+0000 7f51dffff700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f51e0097070 0x7f51e0096240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49674/0 (socket says 172.21.15.76:49674) 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.317+0000 7f51e4edf700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f51e0095750 0x7f51e0095b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48886/0 (socket says 172.21.15.76:48886) 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.317+0000 7f51dffff700 1 -- 172.21.15.76:0/214846055 learned_addr learned my addr 172.21.15.76:0/214846055 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51dffff700 1 -- 172.21.15.76:0/214846055 >> v1:172.21.15.76:6789/0 conn(0x7f51e0095750 legacy=0x7f51e0095b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51dffff700 1 -- 172.21.15.76:0/214846055 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e0096780 con 0x7f51e0097070 2024-04-19T23:45:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51dffff700 1 --2- 172.21.15.76:0/214846055 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f51e0097070 0x7f51e0096240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009870 tx=0x7f51cc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ba545d750b052d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51df7fe700 1 -- 172.21.15.76:0/214846055 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51cc004160 con 0x7f51e0097070 2024-04-19T23:45:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51df7fe700 1 -- 172.21.15.76:0/214846055 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc0042c0 con 0x7f51e0097070 2024-04-19T23:45:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51df7fe700 1 -- 172.21.15.76:0/214846055 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51cc004580 con 0x7f51e0097070 2024-04-19T23:45:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51e7143700 1 -- 172.21.15.76:0/214846055 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f51e0097070 msgr2=0x7f51e0096240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51e7143700 1 --2- 172.21.15.76:0/214846055 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f51e0097070 0x7f51e0096240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009870 tx=0x7f51cc009b80 comp rx=0 tx=0).stop 2024-04-19T23:45:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51e7143700 1 -- 172.21.15.76:0/214846055 shutdown_connections 2024-04-19T23:45:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51e7143700 1 --2- 172.21.15.76:0/214846055 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f51e0097070 0x7f51e0096240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51e7143700 1 -- 172.21.15.76:0/214846055 >> 172.21.15.76:0/214846055 conn(0x7f51e009be70 msgr2=0x7f51e009c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51e7143700 1 -- 172.21.15.76:0/214846055 shutdown_connections 2024-04-19T23:45:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.318+0000 7f51e7143700 1 -- 172.21.15.76:0/214846055 wait complete. 2024-04-19T23:45:12.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.319+0000 7f51e7143700 1 Processor -- start 2024-04-19T23:45:12.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.319+0000 7f51e7143700 1 -- start start 2024-04-19T23:45:12.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51e7143700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f51e0095750 0x7f51e01c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:12.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51e7143700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0122ff0 con 0x7f51e0095750 2024-04-19T23:45:12.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51e4edf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f51e0095750 0x7f51e01c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:12.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51e4edf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f51e0095750 0x7f51e01c25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49690/0 (socket says 172.21.15.76:49690) 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51e4edf700 1 -- 172.21.15.76:0/165302345 learned_addr learned my addr 172.21.15.76:0/165302345 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51e4edf700 1 -- 172.21.15.76:0/165302345 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc009550 con 0x7f51e0095750 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51e4edf700 1 --2- 172.21.15.76:0/165302345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f51e0095750 0x7f51e01c25e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c410 tx=0x7f51d400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51dd7fa700 1 -- 172.21.15.76:0/165302345 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51d4005be0 con 0x7f51e0095750 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51dd7fa700 1 -- 172.21.15.76:0/165302345 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d4005d40 con 0x7f51e0095750 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51dd7fa700 1 -- 172.21.15.76:0/165302345 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51d40070d0 con 0x7f51e0095750 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51e7143700 1 -- 172.21.15.76:0/165302345 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e0123500 con 0x7f51e0095750 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.320+0000 7f51e7143700 1 -- 172.21.15.76:0/165302345 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e0124450 con 0x7f51e0095750 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.321+0000 7f51e7143700 1 -- 172.21.15.76:0/165302345 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e0123cd0 con 0x7f51e0095750 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.322+0000 7f51dd7fa700 1 -- 172.21.15.76:0/165302345 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f51d4007230 con 0x7f51e0095750 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.322+0000 7f51dd7fa700 1 --2- 172.21.15.76:0/165302345 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f51c4037790 0x7f51c4039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.322+0000 7f51dd7fa700 1 -- 172.21.15.76:0/165302345 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f51d4049840 con 0x7f51e0095750 2024-04-19T23:45:12.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.322+0000 7f51dffff700 1 --2- 172.21.15.76:0/165302345 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f51c4037790 0x7f51c4039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:12.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.323+0000 7f51dffff700 1 --2- 172.21.15.76:0/165302345 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f51c4037790 0x7f51c4039c50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f51cc000c00 tx=0x7f51cc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:12.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.326+0000 7f51dd7fa700 1 -- 172.21.15.76:0/165302345 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f51d4019d20 con 0x7f51e0095750 2024-04-19T23:45:12.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.571+0000 7f51e7143700 1 -- 172.21.15.76:0/165302345 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f51e0062510 con 0x7f51e0095750 2024-04-19T23:45:12.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.572+0000 7f51dd7fa700 1 -- 172.21.15.76:0/165302345 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+86132 (secure 0 0 0) 0x7f51d40192c0 con 0x7f51e0095750 2024-04-19T23:45:12.574 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:45:12.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.575+0000 7f51e7143700 1 -- 172.21.15.76:0/165302345 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f51c4037790 msgr2=0x7f51c4039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:12.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.575+0000 7f51e7143700 1 --2- 172.21.15.76:0/165302345 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f51c4037790 0x7f51c4039c50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f51cc000c00 tx=0x7f51cc008030 comp rx=0 tx=0).stop 2024-04-19T23:45:12.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.575+0000 7f51e7143700 1 -- 172.21.15.76:0/165302345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f51e0095750 msgr2=0x7f51e01c25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:12.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.575+0000 7f51e7143700 1 --2- 172.21.15.76:0/165302345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f51e0095750 0x7f51e01c25e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c410 tx=0x7f51d400c7d0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.575+0000 7f51e7143700 1 -- 172.21.15.76:0/165302345 shutdown_connections 2024-04-19T23:45:12.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.575+0000 7f51e7143700 1 --2- 172.21.15.76:0/165302345 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f51c4037790 0x7f51c4039c50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.575+0000 7f51e7143700 1 --2- 172.21.15.76:0/165302345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f51e0095750 0x7f51e01c25e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.575+0000 7f51e7143700 1 -- 172.21.15.76:0/165302345 >> 172.21.15.76:0/165302345 conn(0x7f51e009be70 msgr2=0x7f51e0070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:12.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.575+0000 7f51e7143700 1 -- 172.21.15.76:0/165302345 shutdown_connections 2024-04-19T23:45:12.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.575+0000 7f51e7143700 1 -- 172.21.15.76:0/165302345 wait complete. 2024-04-19T23:45:12.587 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":41459},{"type":"v1","addr":"172.21.15.155:6825","nonce":41459}]},"active_addr":"172.21.15.155:6825/41459","active_change":"2024-04-19T23:45:01.146034+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":489801454}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":3039509995}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1469781632}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1951928641}]}]} 2024-04-19T23:45:12.593 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-19T23:45:12.593 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-19T23:45:12.594 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T23:45:12.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.712+0000 7f9608375700 1 Processor -- start 2024-04-19T23:45:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.712+0000 7f9608375700 1 -- start start 2024-04-19T23:45:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.712+0000 7f9608375700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f9600129590 0x7f9600129970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.712+0000 7f9608375700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9600097a00 con 0x7f9600129eb0 2024-04-19T23:45:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.712+0000 7f9608375700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9600067300 con 0x7f9600129590 2024-04-19T23:45:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.712+0000 7f9606111700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f9600129590 0x7f9600129970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.712+0000 7f9605910700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f9600129eb0 0x7f960012a610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48888/0 (socket says 172.21.15.76:48888) 2024-04-19T23:45:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.712+0000 7f9605910700 1 -- 172.21.15.76:0/4025930742 learned_addr learned my addr 172.21.15.76:0/4025930742 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.712+0000 7f960510f700 1 -- 172.21.15.76:0/4025930742 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532502169 0 0) 0x7f9600097a00 con 0x7f9600129eb0 2024-04-19T23:45:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f960510f700 1 -- 172.21.15.76:0/4025930742 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95ec0035b0 con 0x7f9600129eb0 2024-04-19T23:45:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f9606111700 1 -- 172.21.15.76:0/4025930742 >> v1:172.21.15.76:6789/0 conn(0x7f9600129eb0 legacy=0x7f960012a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:12.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f9606111700 1 -- 172.21.15.76:0/4025930742 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600097f40 con 0x7f9600129590 2024-04-19T23:45:12.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f9606111700 1 --2- 172.21.15.76:0/4025930742 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9600129590 0x7f9600129970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0097c0 tx=0x7f95fc009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5817768f7c20ef server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:12.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f960510f700 1 -- 172.21.15.76:0/4025930742 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95fc004160 con 0x7f9600129590 2024-04-19T23:45:12.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f960510f700 1 -- 172.21.15.76:0/4025930742 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc0042c0 con 0x7f9600129590 2024-04-19T23:45:12.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f960510f700 1 -- 172.21.15.76:0/4025930742 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95fc004580 con 0x7f9600129590 2024-04-19T23:45:12.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f9608375700 1 -- 172.21.15.76:0/4025930742 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9600129590 msgr2=0x7f9600129970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:12.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f9608375700 1 --2- 172.21.15.76:0/4025930742 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9600129590 0x7f9600129970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0097c0 tx=0x7f95fc009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f9608375700 1 -- 172.21.15.76:0/4025930742 shutdown_connections 2024-04-19T23:45:12.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f9608375700 1 --2- 172.21.15.76:0/4025930742 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9600129590 0x7f9600129970 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f9608375700 1 -- 172.21.15.76:0/4025930742 >> 172.21.15.76:0/4025930742 conn(0x7f960009be70 msgr2=0x7f960009c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:12.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f9608375700 1 -- 172.21.15.76:0/4025930742 shutdown_connections 2024-04-19T23:45:12.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.713+0000 7f9608375700 1 -- 172.21.15.76:0/4025930742 wait complete. 2024-04-19T23:45:12.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.714+0000 7f9608375700 1 Processor -- start 2024-04-19T23:45:12.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.714+0000 7f9608375700 1 -- start start 2024-04-19T23:45:12.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f9608375700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9600129590 0x7f9600127b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:12.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f9608375700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960006f4b0 con 0x7f9600129590 2024-04-19T23:45:12.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f9606111700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9600129590 0x7f9600127b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f9606111700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9600129590 0x7f9600127b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49702/0 (socket says 172.21.15.76:49702) 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f9606111700 1 -- 172.21.15.76:0/760454098 learned_addr learned my addr 172.21.15.76:0/760454098 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f9606111700 1 -- 172.21.15.76:0/760454098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc0094a0 con 0x7f9600129590 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f9606111700 1 --2- 172.21.15.76:0/760454098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9600129590 0x7f9600127b00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009b10 tx=0x7f95fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f95f6ffd700 1 -- 172.21.15.76:0/760454098 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95fc003df0 con 0x7f9600129590 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f95f6ffd700 1 -- 172.21.15.76:0/760454098 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc01e070 con 0x7f9600129590 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f9608375700 1 -- 172.21.15.76:0/760454098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96001264f0 con 0x7f9600129590 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f95f6ffd700 1 -- 172.21.15.76:0/760454098 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95fc0117a0 con 0x7f9600129590 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.715+0000 7f9608375700 1 -- 172.21.15.76:0/760454098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96001277f0 con 0x7f9600129590 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.716+0000 7f95f6ffd700 1 -- 172.21.15.76:0/760454098 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f95fc011a20 con 0x7f9600129590 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.716+0000 7f9608375700 1 -- 172.21.15.76:0/760454098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9600062510 con 0x7f9600129590 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.716+0000 7f95f6ffd700 1 --2- 172.21.15.76:0/760454098 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f95e4037730 0x7f95e4039bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.716+0000 7f95f6ffd700 1 -- 172.21.15.76:0/760454098 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f95fc04b230 con 0x7f9600129590 2024-04-19T23:45:12.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.717+0000 7f9605910700 1 --2- 172.21.15.76:0/760454098 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f95e4037730 0x7f95e4039bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:12.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.717+0000 7f9605910700 1 --2- 172.21.15.76:0/760454098 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f95e4037730 0x7f95e4039bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f95f0000f60 tx=0x7f95f00010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:12.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.721+0000 7f95f6ffd700 1 -- 172.21.15.76:0/760454098 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f95fc010c00 con 0x7f9600129590 2024-04-19T23:45:12.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.914+0000 7f9608375700 1 -- 172.21.15.76:0/760454098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f960009d040 con 0x7f9600129590 2024-04-19T23:45:12.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.915+0000 7f95f6ffd700 1 -- 172.21.15.76:0/760454098 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9464 (secure 0 0 0) 0x7f95fc0107f0 con 0x7f9600129590 2024-04-19T23:45:12.915 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:45:12.915 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":16,"fsid":"b5aadf88-3af0-412d-86c8-081593c483a2","created":"2024-04-19T23:44:55.042601+0000","modified":"2024-04-19T23:45:12.178623+0000","last_up_change":"2024-04-19T23:45:04.156942+0000","last_in_change":"2024-04-19T23:44:56.255933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T23:45:05.189599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T23:45:10.916548+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb7b1ad0-ba98-4542-a23d-e070a35df21e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":39408},{"type":"v1","addr":"172.21.15.76:6801","nonce":39408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":39408},{"type":"v1","addr":"172.21.15.76:6803","nonce":39408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":39408},{"type":"v1","addr":"172.21.15.76:6807","nonce":39408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":39408},{"type":"v1","addr":"172.21.15.76:6805","nonce":39408}]},"public_addr":"172.21.15.76:6801/39408","cluster_addr":"172.21.15.76:6803/39408","heartbeat_back_addr":"172.21.15.76:6807/39408","heartbeat_front_addr":"172.21.15.76:6805/39408","state":["exists","up"]},{"osd":1,"uuid":"b7cede46-301b-45db-ad7d-7c10f1844893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":41833},{"type":"v1","addr":"172.21.15.155:6801","nonce":41833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":41833},{"type":"v1","addr":"172.21.15.155:6803","nonce":41833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":41833},{"type":"v1","addr":"172.21.15.155:6807","nonce":41833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":41833},{"type":"v1","addr":"172.21.15.155:6805","nonce":41833}]},"public_addr":"172.21.15.155:6801/41833","cluster_addr":"172.21.15.155:6803/41833","heartbeat_back_addr":"172.21.15.155:6807/41833","heartbeat_front_addr":"172.21.15.155:6805/41833","state":["exists","up"]},{"osd":2,"uuid":"ba9112f9-ce2a-4f53-9345-9a7c4ca89189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":41834},{"type":"v1","addr":"172.21.15.155:6814","nonce":41834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":41834},{"type":"v1","addr":"172.21.15.155:6817","nonce":41834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":41834},{"type":"v1","addr":"172.21.15.155:6823","nonce":41834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":41834},{"type":"v1","addr":"172.21.15.155:6821","nonce":41834}]},"public_addr":"172.21.15.155:6814/41834","cluster_addr":"172.21.15.155:6817/41834","heartbeat_back_addr":"172.21.15.155:6823/41834","heartbeat_front_addr":"172.21.15.155:6821/41834","state":["exists","up"]},{"osd":3,"uuid":"d67c8a52-2656-4aba-adc0-a2ece8ee5d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":41835},{"type":"v1","addr":"172.21.15.155:6809","nonce":41835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":41835},{"type":"v1","addr":"172.21.15.155:6811","nonce":41835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":41835},{"type":"v1","addr":"172.21.15.155:6820","nonce":41835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":41835},{"type":"v1","addr":"172.21.15.155:6816","nonce":41835}]},"public_addr":"172.21.15.155:6809/41835","cluster_addr":"172.21.15.155:6811/41835","heartbeat_back_addr":"172.21.15.155:6820/41835","heartbeat_front_addr":"172.21.15.155:6816/41835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.317706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.455846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.412581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.421620+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T23:45:12.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.917+0000 7f9608375700 1 -- 172.21.15.76:0/760454098 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f95e4037730 msgr2=0x7f95e4039bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:12.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.917+0000 7f9608375700 1 --2- 172.21.15.76:0/760454098 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f95e4037730 0x7f95e4039bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f95f0000f60 tx=0x7f95f00010a0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.917+0000 7f9608375700 1 -- 172.21.15.76:0/760454098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9600129590 msgr2=0x7f9600127b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:12.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.917+0000 7f9608375700 1 --2- 172.21.15.76:0/760454098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9600129590 0x7f9600127b00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009b10 tx=0x7f95fc004750 comp rx=0 tx=0).stop 2024-04-19T23:45:12.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.917+0000 7f9608375700 1 -- 172.21.15.76:0/760454098 shutdown_connections 2024-04-19T23:45:12.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.917+0000 7f9608375700 1 --2- 172.21.15.76:0/760454098 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f95e4037730 0x7f95e4039bf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.917+0000 7f9608375700 1 --2- 172.21.15.76:0/760454098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9600129590 0x7f9600127b00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:12.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.917+0000 7f9608375700 1 -- 172.21.15.76:0/760454098 >> 172.21.15.76:0/760454098 conn(0x7f960009be70 msgr2=0x7f96000994a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:12.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.917+0000 7f9608375700 1 -- 172.21.15.76:0/760454098 shutdown_connections 2024-04-19T23:45:12.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:12.917+0000 7f9608375700 1 -- 172.21.15.76:0/760454098 wait complete. 2024-04-19T23:45:12.929 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-19T23:45:12.929 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T23:45:13.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.048+0000 7fb7dceec700 1 Processor -- start 2024-04-19T23:45:13.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.048+0000 7fb7dceec700 1 -- start start 2024-04-19T23:45:13.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.048+0000 7fb7dceec700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb7d80944c0 0x7fb7d80948a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.048+0000 7fb7dceec700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d8098260 con 0x7fb7d812b830 2024-04-19T23:45:13.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.048+0000 7fb7dceec700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d806b750 con 0x7fb7d80944c0 2024-04-19T23:45:13.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7d659c700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb7d80944c0 0x7fb7d80948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7d5d9b700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fb7d812b830 0x7fb7d812bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48898/0 (socket says 172.21.15.76:48898) 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7d5d9b700 1 -- 172.21.15.76:0/1135651852 learned_addr learned my addr 172.21.15.76:0/1135651852 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7d659c700 1 -- 172.21.15.76:0/1135651852 >> v1:172.21.15.76:6789/0 conn(0x7fb7d812b830 legacy=0x7fb7d812bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7d659c700 1 -- 172.21.15.76:0/1135651852 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d809b170 con 0x7fb7d80944c0 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7d559a700 1 -- 172.21.15.76:0/1135651852 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597381911 0 0) 0x7fb7d8098260 con 0x7fb7d812b830 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7d659c700 1 --2- 172.21.15.76:0/1135651852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7d80944c0 0x7fb7d80948a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80097c0 tx=0x7fb7c8009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549c84f90d4b385d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7d559a700 1 -- 172.21.15.76:0/1135651852 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c8004160 con 0x7fb7d80944c0 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7d559a700 1 -- 172.21.15.76:0/1135651852 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c80042c0 con 0x7fb7d80944c0 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7d559a700 1 -- 172.21.15.76:0/1135651852 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c8004580 con 0x7fb7d80944c0 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7dceec700 1 -- 172.21.15.76:0/1135651852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7d80944c0 msgr2=0x7fb7d80948a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.049+0000 7fb7dceec700 1 --2- 172.21.15.76:0/1135651852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7d80944c0 0x7fb7d80948a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80097c0 tx=0x7fb7c8009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.050+0000 7fb7dceec700 1 -- 172.21.15.76:0/1135651852 shutdown_connections 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.050+0000 7fb7dceec700 1 --2- 172.21.15.76:0/1135651852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7d80944c0 0x7fb7d80948a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.050+0000 7fb7dceec700 1 -- 172.21.15.76:0/1135651852 >> 172.21.15.76:0/1135651852 conn(0x7fb7d809e350 msgr2=0x7fb7d809a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.050+0000 7fb7dceec700 1 -- 172.21.15.76:0/1135651852 shutdown_connections 2024-04-19T23:45:13.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.050+0000 7fb7dceec700 1 -- 172.21.15.76:0/1135651852 wait complete. 2024-04-19T23:45:13.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.051+0000 7fb7dceec700 1 Processor -- start 2024-04-19T23:45:13.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.051+0000 7fb7dceec700 1 -- start start 2024-04-19T23:45:13.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.051+0000 7fb7dceec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7d80944c0 0x7fb7d81bec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.051+0000 7fb7dceec700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d81be860 con 0x7fb7d80944c0 2024-04-19T23:45:13.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.051+0000 7fb7d659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7d80944c0 0x7fb7d81bec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.051+0000 7fb7d659c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7d80944c0 0x7fb7d81bec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49714/0 (socket says 172.21.15.76:49714) 2024-04-19T23:45:13.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.051+0000 7fb7d659c700 1 -- 172.21.15.76:0/3718149525 learned_addr learned my addr 172.21.15.76:0/3718149525 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.051+0000 7fb7d659c700 1 -- 172.21.15.76:0/3718149525 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c80094a0 con 0x7fb7d80944c0 2024-04-19T23:45:13.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.051+0000 7fb7d659c700 1 --2- 172.21.15.76:0/3718149525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7d80944c0 0x7fb7d81bec90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009b10 tx=0x7fb7c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.052+0000 7fb7c6ffd700 1 -- 172.21.15.76:0/3718149525 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c8003df0 con 0x7fb7d80944c0 2024-04-19T23:45:13.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.052+0000 7fb7c6ffd700 1 -- 172.21.15.76:0/3718149525 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c801e070 con 0x7fb7d80944c0 2024-04-19T23:45:13.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.052+0000 7fb7dceec700 1 -- 172.21.15.76:0/3718149525 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d8072140 con 0x7fb7d80944c0 2024-04-19T23:45:13.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.052+0000 7fb7c6ffd700 1 -- 172.21.15.76:0/3718149525 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7c8011760 con 0x7fb7d80944c0 2024-04-19T23:45:13.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.052+0000 7fb7dceec700 1 -- 172.21.15.76:0/3718149525 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d80899c0 con 0x7fb7d80944c0 2024-04-19T23:45:13.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.052+0000 7fb7c6ffd700 1 -- 172.21.15.76:0/3718149525 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7fb7c80119e0 con 0x7fb7d80944c0 2024-04-19T23:45:13.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.052+0000 7fb7dceec700 1 -- 172.21.15.76:0/3718149525 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d80890f0 con 0x7fb7d80944c0 2024-04-19T23:45:13.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.052+0000 7fb7c6ffd700 1 --2- 172.21.15.76:0/3718149525 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fb7b8037730 0x7fb7b8039bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.053+0000 7fb7c6ffd700 1 -- 172.21.15.76:0/3718149525 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fb7c804b3d0 con 0x7fb7d80944c0 2024-04-19T23:45:13.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.053+0000 7fb7d5d9b700 1 --2- 172.21.15.76:0/3718149525 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fb7b8037730 0x7fb7b8039bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.053+0000 7fb7d5d9b700 1 --2- 172.21.15.76:0/3718149525 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fb7b8037730 0x7fb7b8039bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc000c00 tx=0x7fb7cc007a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.057+0000 7fb7c6ffd700 1 -- 172.21.15.76:0/3718149525 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7fb7c8010740 con 0x7fb7d80944c0 2024-04-19T23:45:13.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.250+0000 7fb7dceec700 1 -- 172.21.15.76:0/3718149525 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7d8062510 con 0x7fb7d80944c0 2024-04-19T23:45:13.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.250+0000 7fb7c6ffd700 1 -- 172.21.15.76:0/3718149525 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+9451 (secure 0 0 0) 0x7fb7c8010380 con 0x7fb7d80944c0 2024-04-19T23:45:13.251 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:45:13.251 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":17,"fsid":"b5aadf88-3af0-412d-86c8-081593c483a2","created":"2024-04-19T23:44:55.042601+0000","modified":"2024-04-19T23:45:13.182564+0000","last_up_change":"2024-04-19T23:45:04.156942+0000","last_in_change":"2024-04-19T23:44:56.255933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T23:45:05.189599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T23:45:10.916548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb7b1ad0-ba98-4542-a23d-e070a35df21e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":39408},{"type":"v1","addr":"172.21.15.76:6801","nonce":39408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":39408},{"type":"v1","addr":"172.21.15.76:6803","nonce":39408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":39408},{"type":"v1","addr":"172.21.15.76:6807","nonce":39408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":39408},{"type":"v1","addr":"172.21.15.76:6805","nonce":39408}]},"public_addr":"172.21.15.76:6801/39408","cluster_addr":"172.21.15.76:6803/39408","heartbeat_back_addr":"172.21.15.76:6807/39408","heartbeat_front_addr":"172.21.15.76:6805/39408","state":["exists","up"]},{"osd":1,"uuid":"b7cede46-301b-45db-ad7d-7c10f1844893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":41833},{"type":"v1","addr":"172.21.15.155:6801","nonce":41833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":41833},{"type":"v1","addr":"172.21.15.155:6803","nonce":41833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":41833},{"type":"v1","addr":"172.21.15.155:6807","nonce":41833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":41833},{"type":"v1","addr":"172.21.15.155:6805","nonce":41833}]},"public_addr":"172.21.15.155:6801/41833","cluster_addr":"172.21.15.155:6803/41833","heartbeat_back_addr":"172.21.15.155:6807/41833","heartbeat_front_addr":"172.21.15.155:6805/41833","state":["exists","up"]},{"osd":2,"uuid":"ba9112f9-ce2a-4f53-9345-9a7c4ca89189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":41834},{"type":"v1","addr":"172.21.15.155:6814","nonce":41834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":41834},{"type":"v1","addr":"172.21.15.155:6817","nonce":41834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":41834},{"type":"v1","addr":"172.21.15.155:6823","nonce":41834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":41834},{"type":"v1","addr":"172.21.15.155:6821","nonce":41834}]},"public_addr":"172.21.15.155:6814/41834","cluster_addr":"172.21.15.155:6817/41834","heartbeat_back_addr":"172.21.15.155:6823/41834","heartbeat_front_addr":"172.21.15.155:6821/41834","state":["exists","up"]},{"osd":3,"uuid":"d67c8a52-2656-4aba-adc0-a2ece8ee5d1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":41835},{"type":"v1","addr":"172.21.15.155:6809","nonce":41835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":41835},{"type":"v1","addr":"172.21.15.155:6811","nonce":41835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":41835},{"type":"v1","addr":"172.21.15.155:6820","nonce":41835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":41835},{"type":"v1","addr":"172.21.15.155:6816","nonce":41835}]},"public_addr":"172.21.15.155:6809/41835","cluster_addr":"172.21.15.155:6811/41835","heartbeat_back_addr":"172.21.15.155:6820/41835","heartbeat_front_addr":"172.21.15.155:6816/41835","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.317706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.455846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.412581+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T23:45:01.421620+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T23:45:13.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.252+0000 7fb7dceec700 1 -- 172.21.15.76:0/3718149525 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fb7b8037730 msgr2=0x7fb7b8039bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.252+0000 7fb7dceec700 1 --2- 172.21.15.76:0/3718149525 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fb7b8037730 0x7fb7b8039bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc000c00 tx=0x7fb7cc007a00 comp rx=0 tx=0).stop 2024-04-19T23:45:13.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.252+0000 7fb7dceec700 1 -- 172.21.15.76:0/3718149525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7d80944c0 msgr2=0x7fb7d81bec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.252+0000 7fb7dceec700 1 --2- 172.21.15.76:0/3718149525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7d80944c0 0x7fb7d81bec90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009b10 tx=0x7fb7c8004750 comp rx=0 tx=0).stop 2024-04-19T23:45:13.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.253+0000 7fb7dceec700 1 -- 172.21.15.76:0/3718149525 shutdown_connections 2024-04-19T23:45:13.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.253+0000 7fb7dceec700 1 --2- 172.21.15.76:0/3718149525 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fb7b8037730 0x7fb7b8039bf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.253+0000 7fb7dceec700 1 --2- 172.21.15.76:0/3718149525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7d80944c0 0x7fb7d81bec90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.253+0000 7fb7dceec700 1 -- 172.21.15.76:0/3718149525 >> 172.21.15.76:0/3718149525 conn(0x7fb7d809e350 msgr2=0x7fb7d8095290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.253+0000 7fb7dceec700 1 -- 172.21.15.76:0/3718149525 shutdown_connections 2024-04-19T23:45:13.254 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.253+0000 7fb7dceec700 1 -- 172.21.15.76:0/3718149525 wait complete. 2024-04-19T23:45:13.265 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-19T23:45:13.265 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-19T23:45:13.266 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-19T23:45:13.266 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-19T23:45:13.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f0232b01700 1 Processor -- start 2024-04-19T23:45:13.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f751f180700 1 Processor -- start 2024-04-19T23:45:13.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f0232b01700 1 -- start start 2024-04-19T23:45:13.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f751f180700 1 -- start start 2024-04-19T23:45:13.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f0232b01700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f022c06e820 0x7f022c132fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f0232b01700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c094e70 con 0x7f022c06dd30 2024-04-19T23:45:13.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f0232b01700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022c09dc50 con 0x7f022c06e820 2024-04-19T23:45:13.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f751f180700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f7518130c60 0x7f7518133050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f751f180700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7518099a20 con 0x7f7518097ae0 2024-04-19T23:45:13.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f751f180700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7518098cb0 con 0x7f7518130c60 2024-04-19T23:45:13.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f022bfff700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f022c06e820 0x7f022c132fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f023089d700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f022c06dd30 0x7f022c06e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48904/0 (socket says 172.21.15.76:48904) 2024-04-19T23:45:13.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f023089d700 1 -- 172.21.15.76:0/189866078 learned_addr learned my addr 172.21.15.76:0/189866078 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:13.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f7517fff700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f7518130c60 0x7f7518133050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f7517fff700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f7518130c60 0x7f7518133050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49730/0 (socket says 172.21.15.76:49730) 2024-04-19T23:45:13.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.395+0000 7f7517fff700 1 -- 172.21.15.76:0/1263032500 learned_addr learned my addr 172.21.15.76:0/1263032500 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f7517fff700 1 -- 172.21.15.76:0/1263032500 >> v1:172.21.15.76:6789/0 conn(0x7f7518097ae0 legacy=0x7f7518097ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f7517fff700 1 -- 172.21.15.76:0/1263032500 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518099f60 con 0x7f7518130c60 2024-04-19T23:45:13.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f022bfff700 1 -- 172.21.15.76:0/189866078 >> v1:172.21.15.76:6789/0 conn(0x7f022c06dd30 legacy=0x7f022c06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f022bfff700 1 -- 172.21.15.76:0/189866078 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c070210 con 0x7f022c06e820 2024-04-19T23:45:13.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f7517fff700 1 --2- 172.21.15.76:0/1263032500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7518130c60 0x7f7518133050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7504009870 tx=0x7f7504009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34f232ad3e1f08c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f022bfff700 1 --2- 172.21.15.76:0/189866078 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f022c06e820 0x7f022c132fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02180097c0 tx=0x7f0218009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fe2681292e2dce server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f75177fe700 1 -- 172.21.15.76:0/1263032500 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7504004160 con 0x7f7518130c60 2024-04-19T23:45:13.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f75177fe700 1 -- 172.21.15.76:0/1263032500 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75040042c0 con 0x7f7518130c60 2024-04-19T23:45:13.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f75177fe700 1 -- 172.21.15.76:0/1263032500 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7504004580 con 0x7f7518130c60 2024-04-19T23:45:13.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f022b7fe700 1 -- 172.21.15.76:0/189866078 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0218004160 con 0x7f022c06e820 2024-04-19T23:45:13.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f022b7fe700 1 -- 172.21.15.76:0/189866078 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02180042c0 con 0x7f022c06e820 2024-04-19T23:45:13.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.396+0000 7f022b7fe700 1 -- 172.21.15.76:0/189866078 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0218004580 con 0x7f022c06e820 2024-04-19T23:45:13.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f751f180700 1 -- 172.21.15.76:0/1263032500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7518130c60 msgr2=0x7f7518133050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f751f180700 1 --2- 172.21.15.76:0/1263032500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7518130c60 0x7f7518133050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7504009870 tx=0x7f7504009b80 comp rx=0 tx=0).stop 2024-04-19T23:45:13.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f0232b01700 1 -- 172.21.15.76:0/189866078 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f022c06e820 msgr2=0x7f022c132fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f0232b01700 1 --2- 172.21.15.76:0/189866078 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f022c06e820 0x7f022c132fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02180097c0 tx=0x7f0218009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f751f180700 1 -- 172.21.15.76:0/1263032500 shutdown_connections 2024-04-19T23:45:13.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f751f180700 1 --2- 172.21.15.76:0/1263032500 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7518130c60 0x7f7518133050 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f751f180700 1 -- 172.21.15.76:0/1263032500 >> 172.21.15.76:0/1263032500 conn(0x7f751809e0e0 msgr2=0x7f751809e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f0232b01700 1 -- 172.21.15.76:0/189866078 shutdown_connections 2024-04-19T23:45:13.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f0232b01700 1 --2- 172.21.15.76:0/189866078 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f022c06e820 0x7f022c132fa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f0232b01700 1 -- 172.21.15.76:0/189866078 >> 172.21.15.76:0/189866078 conn(0x7f022c09c120 msgr2=0x7f022c09c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f751f180700 1 -- 172.21.15.76:0/1263032500 shutdown_connections 2024-04-19T23:45:13.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f0232b01700 1 -- 172.21.15.76:0/189866078 shutdown_connections 2024-04-19T23:45:13.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f0232b01700 1 -- 172.21.15.76:0/189866078 wait complete. 2024-04-19T23:45:13.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.397+0000 7f751f180700 1 -- 172.21.15.76:0/1263032500 wait complete. 2024-04-19T23:45:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.398+0000 7f0232b01700 1 Processor -- start 2024-04-19T23:45:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.398+0000 7f751f180700 1 Processor -- start 2024-04-19T23:45:13.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.398+0000 7f0232b01700 1 -- start start 2024-04-19T23:45:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.398+0000 7f0232b01700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f022c06dd30 0x7f022c1c2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.398+0000 7f0232b01700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1250b0 con 0x7f022c06dd30 2024-04-19T23:45:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.398+0000 7f751f180700 1 -- start start 2024-04-19T23:45:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.398+0000 7f751f180700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7518097ae0 0x7f751812d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.398+0000 7f751f180700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751806e150 con 0x7f7518097ae0 2024-04-19T23:45:13.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f023089d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f022c06dd30 0x7f022c1c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f023089d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f022c06dd30 0x7f022c1c2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49746/0 (socket says 172.21.15.76:49746) 2024-04-19T23:45:13.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f023089d700 1 -- 172.21.15.76:0/516790679 learned_addr learned my addr 172.21.15.76:0/516790679 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f751cf1c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7518097ae0 0x7f751812d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f751cf1c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7518097ae0 0x7f751812d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49760/0 (socket says 172.21.15.76:49760) 2024-04-19T23:45:13.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f751cf1c700 1 -- 172.21.15.76:0/3696358704 learned_addr learned my addr 172.21.15.76:0/3696358704 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f023089d700 1 -- 172.21.15.76:0/516790679 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02180094a0 con 0x7f022c06dd30 2024-04-19T23:45:13.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f751cf1c700 1 -- 172.21.15.76:0/3696358704 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7504009550 con 0x7f7518097ae0 2024-04-19T23:45:13.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f023089d700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f022c06dd30 0x7f022c1c2410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f022000c3b0 tx=0x7f022000c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f751cf1c700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7518097ae0 0x7f751812d290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c460 tx=0x7f750c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f02297fa700 1 -- 172.21.15.76:0/516790679 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0220005b70 con 0x7f022c06dd30 2024-04-19T23:45:13.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f02297fa700 1 -- 172.21.15.76:0/516790679 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0220005cd0 con 0x7f022c06dd30 2024-04-19T23:45:13.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f0232b01700 1 -- 172.21.15.76:0/516790679 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c06f470 con 0x7f022c06dd30 2024-04-19T23:45:13.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f02297fa700 1 -- 172.21.15.76:0/516790679 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0220004870 con 0x7f022c06dd30 2024-04-19T23:45:13.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f0232b01700 1 -- 172.21.15.76:0/516790679 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c093590 con 0x7f022c06dd30 2024-04-19T23:45:13.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f75157fa700 1 -- 172.21.15.76:0/3696358704 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f750c005200 con 0x7f7518097ae0 2024-04-19T23:45:13.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f75157fa700 1 -- 172.21.15.76:0/3696358704 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c005360 con 0x7f7518097ae0 2024-04-19T23:45:13.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f751f180700 1 -- 172.21.15.76:0/3696358704 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751806f1e0 con 0x7f7518097ae0 2024-04-19T23:45:13.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.399+0000 7f751f180700 1 -- 172.21.15.76:0/3696358704 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751806eb60 con 0x7f7518097ae0 2024-04-19T23:45:13.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.400+0000 7f75157fa700 1 -- 172.21.15.76:0/3696358704 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f750c003680 con 0x7f7518097ae0 2024-04-19T23:45:13.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.400+0000 7f0232b01700 1 -- 172.21.15.76:0/516790679 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f022c06f2f0 con 0x7f022c06dd30 2024-04-19T23:45:13.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.401+0000 7f751f180700 1 -- 172.21.15.76:0/3696358704 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74f8000f00 con 0x7f7518097ae0 2024-04-19T23:45:13.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.401+0000 7f75157fa700 1 -- 172.21.15.76:0/3696358704 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f750c0037e0 con 0x7f7518097ae0 2024-04-19T23:45:13.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.401+0000 7f75157fa700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f74fc037830 0x7f74fc039cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.401+0000 7f75157fa700 1 -- 172.21.15.76:0/3696358704 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f750c049490 con 0x7f7518097ae0 2024-04-19T23:45:13.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.401+0000 7f75157fa700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x7f74fc03cfd0 0x7f74fc03f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.401+0000 7f75157fa700 1 -- 172.21.15.76:0/3696358704 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74fc03fae0 con 0x7f74fc03cfd0 2024-04-19T23:45:13.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.401+0000 7f75157fa700 1 -- 172.21.15.76:0/3696358704 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f750c04b970 con 0x7f7518097ae0 2024-04-19T23:45:13.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.401+0000 7f7517fff700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f74fc037830 0x7f74fc039cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.401+0000 7f02297fa700 1 -- 172.21.15.76:0/516790679 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f02200049d0 con 0x7f022c06dd30 2024-04-19T23:45:13.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.401+0000 7f751d71d700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x7f74fc03cfd0 0x7f74fc03f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.402+0000 7f02297fa700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0210037790 0x7f0210039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.402+0000 7f02297fa700 1 -- 172.21.15.76:0/516790679 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f022004a120 con 0x7f022c06dd30 2024-04-19T23:45:13.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.402+0000 7f02297fa700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x7f021003ceb0 0x7f021003f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.402+0000 7f02297fa700 1 -- 172.21.15.76:0/516790679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f021003f9c0 con 0x7f021003ceb0 2024-04-19T23:45:13.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.402+0000 7f02297fa700 1 -- 172.21.15.76:0/516790679 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f022004a520 con 0x7f022c06dd30 2024-04-19T23:45:13.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.402+0000 7f022bfff700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0210037790 0x7f0210039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.402+0000 7f023109e700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x7f021003ceb0 0x7f021003f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.402+0000 7f751d71d700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x7f74fc03cfd0 0x7f74fc03f410 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.402+0000 7f7517fff700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f74fc037830 0x7f74fc039cf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7504009bc0 tx=0x7f7504008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.402+0000 7f023109e700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x7f021003ceb0 0x7f021003f2f0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.402+0000 7f022bfff700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0210037790 0x7f0210039c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f02180090b0 tx=0x7f0218008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.403+0000 7f75157fa700 1 -- 172.21.15.76:0/3696358704 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f74fc03fae0 con 0x7f74fc03cfd0 2024-04-19T23:45:13.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.403+0000 7f02297fa700 1 -- 172.21.15.76:0/516790679 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f021003f9c0 con 0x7f021003ceb0 2024-04-19T23:45:13.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.405+0000 7f3cb0178700 1 Processor -- start 2024-04-19T23:45:13.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.406+0000 7f3cb0178700 1 -- start start 2024-04-19T23:45:13.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.406+0000 7f3cb0178700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f3ca812d9b0 0x7f3ca812fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.406+0000 7f3cb0178700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca8090a00 con 0x7f3ca81278b0 2024-04-19T23:45:13.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.406+0000 7f3cb0178700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca8090340 con 0x7f3ca812d9b0 2024-04-19T23:45:13.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.406+0000 7f3cad713700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f3ca812d9b0 0x7f3ca812fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.406+0000 7f3cadf14700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f3ca81278b0 0x7f3ca8127c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48934/0 (socket says 172.21.15.76:48934) 2024-04-19T23:45:13.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.407+0000 7f3cadf14700 1 -- 172.21.15.76:0/3641559554 learned_addr learned my addr 172.21.15.76:0/3641559554 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:13.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.407+0000 7f3cad713700 1 -- 172.21.15.76:0/3641559554 >> v1:172.21.15.76:6789/0 conn(0x7f3ca81278b0 legacy=0x7f3ca8127c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.407+0000 7f3cad713700 1 -- 172.21.15.76:0/3641559554 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca804ebb0 con 0x7f3ca812d9b0 2024-04-19T23:45:13.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.407+0000 7f3cad713700 1 --2- 172.21.15.76:0/3641559554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ca812d9b0 0x7f3ca812fda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c980097c0 tx=0x7f3c98009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573aeda65ea645b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.407+0000 7f3cacf12700 1 -- 172.21.15.76:0/3641559554 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c98004160 con 0x7f3ca812d9b0 2024-04-19T23:45:13.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.407+0000 7f3cacf12700 1 -- 172.21.15.76:0/3641559554 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c980042c0 con 0x7f3ca812d9b0 2024-04-19T23:45:13.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.407+0000 7f3cacf12700 1 -- 172.21.15.76:0/3641559554 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c98004580 con 0x7f3ca812d9b0 2024-04-19T23:45:13.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7fc099b33700 1 Processor -- start 2024-04-19T23:45:13.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7f3cb0178700 1 -- 172.21.15.76:0/3641559554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ca812d9b0 msgr2=0x7f3ca812fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7f3cb0178700 1 --2- 172.21.15.76:0/3641559554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ca812d9b0 0x7f3ca812fda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c980097c0 tx=0x7f3c98009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7f3cb0178700 1 -- 172.21.15.76:0/3641559554 shutdown_connections 2024-04-19T23:45:13.422 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7f3cb0178700 1 --2- 172.21.15.76:0/3641559554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ca812d9b0 0x7f3ca812fda0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7f3cb0178700 1 -- 172.21.15.76:0/3641559554 >> 172.21.15.76:0/3641559554 conn(0x7f3ca809a870 msgr2=0x7f3ca809ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7fc099b33700 1 -- start start 2024-04-19T23:45:13.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7fc099b33700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fc09406de70 0x7fc09406e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7fc099b33700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0940701d0 con 0x7fc09406e790 2024-04-19T23:45:13.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7fc099b33700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09406cd30 con 0x7fc09406de70 2024-04-19T23:45:13.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7f3cb0178700 1 -- 172.21.15.76:0/3641559554 shutdown_connections 2024-04-19T23:45:13.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7f3cb0178700 1 -- 172.21.15.76:0/3641559554 wait complete. 2024-04-19T23:45:13.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7fc0937fe700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fc09406de70 0x7fc09406e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7fc0937fe700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fc09406de70 0x7fc09406e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49786/0 (socket says 172.21.15.76:49786) 2024-04-19T23:45:13.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7fc0937fe700 1 -- 172.21.15.76:0/378172279 learned_addr learned my addr 172.21.15.76:0/378172279 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.408+0000 7fc092ffd700 1 --1- 172.21.15.76:0/378172279 >> v1:172.21.15.76:6789/0 conn(0x7fc09406e790 0x7fc0940704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48944/0 (socket says 172.21.15.76:48944) 2024-04-19T23:45:13.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.409+0000 7fc0937fe700 1 -- 172.21.15.76:0/378172279 >> v1:172.21.15.76:6789/0 conn(0x7fc09406e790 legacy=0x7fc0940704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.409+0000 7fc0937fe700 1 -- 172.21.15.76:0/378172279 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09406f970 con 0x7fc09406de70 2024-04-19T23:45:13.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.409+0000 7fc0937fe700 1 --2- 172.21.15.76:0/378172279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc09406de70 0x7fc09406e250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc084007360 tx=0x7fc084007670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17169c983eaba6eb server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.409+0000 7fc0927fc700 1 -- 172.21.15.76:0/378172279 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc08400a4b0 con 0x7fc09406de70 2024-04-19T23:45:13.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.409+0000 7fc0927fc700 1 -- 172.21.15.76:0/378172279 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400a610 con 0x7fc09406de70 2024-04-19T23:45:13.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.409+0000 7fc0927fc700 1 -- 172.21.15.76:0/378172279 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc084004030 con 0x7fc09406de70 2024-04-19T23:45:13.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.409+0000 7f3cb0178700 1 Processor -- start 2024-04-19T23:45:13.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7f3cb0178700 1 -- start start 2024-04-19T23:45:13.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7fc099b33700 1 -- 172.21.15.76:0/378172279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc09406de70 msgr2=0x7fc09406e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7fc099b33700 1 --2- 172.21.15.76:0/378172279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc09406de70 0x7fc09406e250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc084007360 tx=0x7fc084007670 comp rx=0 tx=0).stop 2024-04-19T23:45:13.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7f3cb0178700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ca81278b0 0x7f3ca806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7f3cb0178700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca81215b0 con 0x7f3ca81278b0 2024-04-19T23:45:13.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7fc099b33700 1 -- 172.21.15.76:0/378172279 shutdown_connections 2024-04-19T23:45:13.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7fc099b33700 1 --2- 172.21.15.76:0/378172279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc09406de70 0x7fc09406e250 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7fc099b33700 1 -- 172.21.15.76:0/378172279 >> 172.21.15.76:0/378172279 conn(0x7fc094099c40 msgr2=0x7fc09409a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7f3cadf14700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ca81278b0 0x7f3ca806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7fc099b33700 1 -- 172.21.15.76:0/378172279 shutdown_connections 2024-04-19T23:45:13.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7f3cadf14700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ca81278b0 0x7f3ca806fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49796/0 (socket says 172.21.15.76:49796) 2024-04-19T23:45:13.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7f3cadf14700 1 -- 172.21.15.76:0/2564810949 learned_addr learned my addr 172.21.15.76:0/2564810949 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7f3cadf14700 1 -- 172.21.15.76:0/2564810949 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c980094a0 con 0x7f3ca81278b0 2024-04-19T23:45:13.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.410+0000 7fc099b33700 1 -- 172.21.15.76:0/378172279 wait complete. 2024-04-19T23:45:13.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.411+0000 7f3cadf14700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ca81278b0 0x7f3ca806fde0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c410 tx=0x7f3ca400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.411+0000 7f3c9e7fc700 1 -- 172.21.15.76:0/2564810949 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ca4005ca0 con 0x7f3ca81278b0 2024-04-19T23:45:13.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.411+0000 7f3c9e7fc700 1 -- 172.21.15.76:0/2564810949 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca4005e00 con 0x7f3ca81278b0 2024-04-19T23:45:13.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.411+0000 7f3c9e7fc700 1 -- 172.21.15.76:0/2564810949 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ca40049c0 con 0x7f3ca81278b0 2024-04-19T23:45:13.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.411+0000 7f3cb0178700 1 -- 172.21.15.76:0/2564810949 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca8072aa0 con 0x7f3ca81278b0 2024-04-19T23:45:13.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.411+0000 7f3cb0178700 1 -- 172.21.15.76:0/2564810949 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca81219f0 con 0x7f3ca81278b0 2024-04-19T23:45:13.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.411+0000 7fc099b33700 1 Processor -- start 2024-04-19T23:45:13.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.412+0000 7fc099b33700 1 -- start start 2024-04-19T23:45:13.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.412+0000 7f3cb0178700 1 -- 172.21.15.76:0/2564810949 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ca809ba50 con 0x7f3ca81278b0 2024-04-19T23:45:13.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.412+0000 7fc099b33700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc09406de70 0x7fc0941c1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.412+0000 7fc099b33700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0941a9f70 con 0x7fc09406de70 2024-04-19T23:45:13.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.412+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc09406de70 0x7fc0941c1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.412+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc09406de70 0x7fc0941c1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49810/0 (socket says 172.21.15.76:49810) 2024-04-19T23:45:13.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.412+0000 7fc0937fe700 1 -- 172.21.15.76:0/2068928006 learned_addr learned my addr 172.21.15.76:0/2068928006 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.412+0000 7f3c9e7fc700 1 -- 172.21.15.76:0/2564810949 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f3ca4004b20 con 0x7f3ca81278b0 2024-04-19T23:45:13.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7fc0937fe700 1 -- 172.21.15.76:0/2068928006 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084007040 con 0x7fc09406de70 2024-04-19T23:45:13.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7f3c9e7fc700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f3c8c037790 0x7f3c8c039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7f3c9e7fc700 1 -- 172.21.15.76:0/2564810949 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f3ca40498a0 con 0x7f3ca81278b0 2024-04-19T23:45:13.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7f3c9e7fc700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x7f3c8c03ceb0 0x7f3c8c03f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7f3c9e7fc700 1 -- 172.21.15.76:0/2564810949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c8c03f9c0 con 0x7f3c8c03ceb0 2024-04-19T23:45:13.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7f3c9e7fc700 1 -- 172.21.15.76:0/2564810949 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ca4011d70 con 0x7f3ca81278b0 2024-04-19T23:45:13.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7fc0937fe700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc09406de70 0x7fc0941c1e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc08400a9b0 tx=0x7fc084004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7f3cad713700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f3c8c037790 0x7f3c8c039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7f3cae715700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x7f3c8c03ceb0 0x7f3c8c03f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7fc07bfff700 1 -- 172.21.15.76:0/2068928006 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc08400e030 con 0x7fc09406de70 2024-04-19T23:45:13.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7fc07bfff700 1 -- 172.21.15.76:0/2068928006 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc084003a60 con 0x7fc09406de70 2024-04-19T23:45:13.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7fc099b33700 1 -- 172.21.15.76:0/2068928006 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0941a9c40 con 0x7fc09406de70 2024-04-19T23:45:13.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7fc07bfff700 1 -- 172.21.15.76:0/2068928006 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc084003d00 con 0x7fc09406de70 2024-04-19T23:45:13.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.413+0000 7fc099b33700 1 -- 172.21.15.76:0/2068928006 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0941a7b50 con 0x7fc09406de70 2024-04-19T23:45:13.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.414+0000 7f3cae715700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x7f3c8c03ceb0 0x7f3c8c03f2f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.414+0000 7f3cad713700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f3c8c037790 0x7f3c8c039c50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3c980097c0 tx=0x7f3c98008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.414+0000 7fc099b33700 1 -- 172.21.15.76:0/2068928006 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc09406f640 con 0x7fc09406de70 2024-04-19T23:45:13.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.414+0000 7f3c9e7fc700 1 -- 172.21.15.76:0/2564810949 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f3c8c03f9c0 con 0x7f3c8c03ceb0 2024-04-19T23:45:13.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.415+0000 7fc07bfff700 1 -- 172.21.15.76:0/2068928006 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7fc084019050 con 0x7fc09406de70 2024-04-19T23:45:13.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.415+0000 7fc07bfff700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fc080037780 0x7fc080039c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.415+0000 7fc07bfff700 1 -- 172.21.15.76:0/2068928006 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fc08404bea0 con 0x7fc09406de70 2024-04-19T23:45:13.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.415+0000 7fc07bfff700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x7fc08003cea0 0x7fc08003f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.415+0000 7fc07bfff700 1 -- 172.21.15.76:0/2068928006 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc08003f9b0 con 0x7fc08003cea0 2024-04-19T23:45:13.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.415+0000 7fc07bfff700 1 -- 172.21.15.76:0/2068928006 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc08404c2a0 con 0x7fc09406de70 2024-04-19T23:45:13.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.415+0000 7fc093fff700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x7fc08003cea0 0x7fc08003f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.415+0000 7fc092ffd700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fc080037780 0x7fc080039c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.416+0000 7fc093fff700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x7fc08003cea0 0x7fc08003f2e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.416+0000 7fc092ffd700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fc080037780 0x7fc080039c40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc09406f110 tx=0x7fc088007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.416+0000 7fc07bfff700 1 -- 172.21.15.76:0/2068928006 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fc08003f9b0 con 0x7fc08003cea0 2024-04-19T23:45:13.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.422+0000 7f0232b01700 1 -- 172.21.15.76:0/516790679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f022c06ea60 con 0x7f021003ceb0 2024-04-19T23:45:13.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.422+0000 7f02297fa700 1 -- 172.21.15.76:0/516790679 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f022c06ea60 con 0x7f021003ceb0 2024-04-19T23:45:13.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 -- 172.21.15.76:0/516790679 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x7f021003ceb0 msgr2=0x7f021003f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x7f021003ceb0 0x7f021003f2f0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 -- 172.21.15.76:0/516790679 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0210037790 msgr2=0x7f0210039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0210037790 0x7f0210039c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f02180090b0 tx=0x7f0218008030 comp rx=0 tx=0).stop 2024-04-19T23:45:13.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 -- 172.21.15.76:0/516790679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f022c06dd30 msgr2=0x7f022c1c2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f022c06dd30 0x7f022c1c2410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f022000c3b0 tx=0x7f022000c770 comp rx=0 tx=0).stop 2024-04-19T23:45:13.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 -- 172.21.15.76:0/516790679 shutdown_connections 2024-04-19T23:45:13.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x7f021003ceb0 0x7f021003f2f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f022c06dd30 0x7f022c1c2410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 --2- 172.21.15.76:0/516790679 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f0210037790 0x7f0210039c50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 -- 172.21.15.76:0/516790679 >> 172.21.15.76:0/516790679 conn(0x7f022c09c120 msgr2=0x7f022c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 -- 172.21.15.76:0/516790679 shutdown_connections 2024-04-19T23:45:13.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.423+0000 7f0232b01700 1 -- 172.21.15.76:0/516790679 wait complete. 2024-04-19T23:45:13.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.432+0000 7fc099b33700 1 -- 172.21.15.76:0/2068928006 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc0941a9dd0 con 0x7fc08003cea0 2024-04-19T23:45:13.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.432+0000 7f751f180700 1 -- 172.21.15.76:0/3696358704 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f74f8002bd0 con 0x7f74fc03cfd0 2024-04-19T23:45:13.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc07bfff700 1 -- 172.21.15.76:0/2068928006 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc08c011040 con 0x7fc08003cea0 2024-04-19T23:45:13.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7f75157fa700 1 -- 172.21.15.76:0/3696358704 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f74f8002bd0 con 0x7f74fc03cfd0 2024-04-19T23:45:13.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc099b33700 1 -- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x7fc08003cea0 msgr2=0x7fc08003f2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc099b33700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x7fc08003cea0 0x7fc08003f2e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc099b33700 1 -- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fc080037780 msgr2=0x7fc080039c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc099b33700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fc080037780 0x7fc080039c40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc09406f110 tx=0x7fc088007ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc099b33700 1 -- 172.21.15.76:0/2068928006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc09406de70 msgr2=0x7fc0941c1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc099b33700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc09406de70 0x7fc0941c1e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc08400a9b0 tx=0x7fc084004750 comp rx=0 tx=0).stop 2024-04-19T23:45:13.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc099b33700 1 -- 172.21.15.76:0/2068928006 shutdown_connections 2024-04-19T23:45:13.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc099b33700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x7fc08003cea0 0x7fc08003f2e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc099b33700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc09406de70 0x7fc0941c1e40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc099b33700 1 --2- 172.21.15.76:0/2068928006 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fc080037780 0x7fc080039c40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7fc099b33700 1 -- 172.21.15.76:0/2068928006 >> 172.21.15.76:0/2068928006 conn(0x7fc094099c40 msgr2=0x7fc09408f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7f751f180700 1 -- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x7f74fc03cfd0 msgr2=0x7f74fc03f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7f751f180700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x7f74fc03cfd0 0x7f74fc03f410 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7f751f180700 1 -- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f74fc037830 msgr2=0x7f74fc039cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7f751f180700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f74fc037830 0x7f74fc039cf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7504009bc0 tx=0x7f7504008030 comp rx=0 tx=0).stop 2024-04-19T23:45:13.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7f751f180700 1 -- 172.21.15.76:0/3696358704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7518097ae0 msgr2=0x7f751812d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.433+0000 7f751f180700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7518097ae0 0x7f751812d290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c460 tx=0x7f750c00c820 comp rx=0 tx=0).stop 2024-04-19T23:45:13.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.434+0000 7f751f180700 1 -- 172.21.15.76:0/3696358704 shutdown_connections 2024-04-19T23:45:13.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.434+0000 7f751f180700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x7f74fc03cfd0 0x7f74fc03f410 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.434+0000 7f751f180700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7518097ae0 0x7f751812d290 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.434+0000 7f751f180700 1 --2- 172.21.15.76:0/3696358704 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f74fc037830 0x7f74fc039cf0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.434+0000 7f751f180700 1 -- 172.21.15.76:0/3696358704 >> 172.21.15.76:0/3696358704 conn(0x7f751809e0e0 msgr2=0x7f7518094770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.434+0000 7fc099b33700 1 -- 172.21.15.76:0/2068928006 shutdown_connections 2024-04-19T23:45:13.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.434+0000 7f751f180700 1 -- 172.21.15.76:0/3696358704 shutdown_connections 2024-04-19T23:45:13.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.434+0000 7fc099b33700 1 -- 172.21.15.76:0/2068928006 wait complete. 2024-04-19T23:45:13.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.434+0000 7f751f180700 1 -- 172.21.15.76:0/3696358704 wait complete. 2024-04-19T23:45:13.447 INFO:teuthology.orchestra.run.smithi076.stdout:38654705669 2024-04-19T23:45:13.447 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T23:45:13.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.440+0000 7f3cb0178700 1 -- 172.21.15.76:0/2564810949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ca8072520 con 0x7f3c8c03ceb0 2024-04-19T23:45:13.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3c9e7fc700 1 -- 172.21.15.76:0/2564810949 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3ca8072520 con 0x7f3c8c03ceb0 2024-04-19T23:45:13.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 -- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x7f3c8c03ceb0 msgr2=0x7f3c8c03f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x7f3c8c03ceb0 0x7f3c8c03f2f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 -- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f3c8c037790 msgr2=0x7f3c8c039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f3c8c037790 0x7f3c8c039c50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3c980097c0 tx=0x7f3c98008030 comp rx=0 tx=0).stop 2024-04-19T23:45:13.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 -- 172.21.15.76:0/2564810949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ca81278b0 msgr2=0x7f3ca806fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ca81278b0 0x7f3ca806fde0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c410 tx=0x7f3ca400c7d0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 -- 172.21.15.76:0/2564810949 shutdown_connections 2024-04-19T23:45:13.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x7f3c8c03ceb0 0x7f3c8c03f2f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3ca81278b0 0x7f3ca806fde0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 --2- 172.21.15.76:0/2564810949 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f3c8c037790 0x7f3c8c039c50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 -- 172.21.15.76:0/2564810949 >> 172.21.15.76:0/2564810949 conn(0x7f3ca809a870 msgr2=0x7f3ca812b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 -- 172.21.15.76:0/2564810949 shutdown_connections 2024-04-19T23:45:13.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.441+0000 7f3cb0178700 1 -- 172.21.15.76:0/2564810949 wait complete. 2024-04-19T23:45:13.451 INFO:teuthology.orchestra.run.smithi076.stdout:42949672964 2024-04-19T23:45:13.452 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T23:45:13.452 INFO:teuthology.orchestra.run.smithi076.stdout:42949672964 2024-04-19T23:45:13.453 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-19T23:45:13.454 INFO:teuthology.orchestra.run.smithi076.stdout:42949672964 2024-04-19T23:45:13.454 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T23:45:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.606+0000 7fa71d523700 1 Processor -- start 2024-04-19T23:45:13.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.606+0000 7fa71d523700 1 -- start start 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.606+0000 7fa71d523700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa71812d010 0x7fa71812f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.606+0000 7fa71d523700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa718129d00 con 0x7fa71812a250 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.606+0000 7fa71d523700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa718095900 con 0x7fa71812d010 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.607+0000 7fa7167fc700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa71812d010 0x7fa71812f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.607+0000 7fa7167fc700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa71812d010 0x7fa71812f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49826/0 (socket says 172.21.15.76:49826) 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.607+0000 7fa7167fc700 1 -- 172.21.15.76:0/2985219324 learned_addr learned my addr 172.21.15.76:0/2985219324 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.607+0000 7fa7167fc700 1 -- 172.21.15.76:0/2985219324 >> v1:172.21.15.76:6789/0 conn(0x7fa71812a250 legacy=0x7fa71812a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.607+0000 7fa7167fc700 1 -- 172.21.15.76:0/2985219324 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718095c50 con 0x7fa71812d010 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.607+0000 7fa7167fc700 1 --2- 172.21.15.76:0/2985219324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa71812d010 0x7fa71812f400 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00bb10 tx=0x7fa70c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7811727f22a41ac3 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.607+0000 7fa715ffb700 1 -- 172.21.15.76:0/2985219324 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa70c00db50 con 0x7fa71812d010 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.607+0000 7fa715ffb700 1 -- 172.21.15.76:0/2985219324 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70c00dcb0 con 0x7fa71812d010 2024-04-19T23:45:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.607+0000 7fa715ffb700 1 -- 172.21.15.76:0/2985219324 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa70c004030 con 0x7fa71812d010 2024-04-19T23:45:13.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.608+0000 7fa71d523700 1 -- 172.21.15.76:0/2985219324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa71812d010 msgr2=0x7fa71812f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.608+0000 7fa71d523700 1 --2- 172.21.15.76:0/2985219324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa71812d010 0x7fa71812f400 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00bb10 tx=0x7fa70c00be20 comp rx=0 tx=0).stop 2024-04-19T23:45:13.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.608+0000 7fa71d523700 1 -- 172.21.15.76:0/2985219324 shutdown_connections 2024-04-19T23:45:13.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.608+0000 7fa71d523700 1 --2- 172.21.15.76:0/2985219324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa71812d010 0x7fa71812f400 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.608+0000 7fa71d523700 1 -- 172.21.15.76:0/2985219324 >> 172.21.15.76:0/2985219324 conn(0x7fa71809a870 msgr2=0x7fa71809ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.608+0000 7fa71d523700 1 -- 172.21.15.76:0/2985219324 shutdown_connections 2024-04-19T23:45:13.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.608+0000 7fa71d523700 1 -- 172.21.15.76:0/2985219324 wait complete. 2024-04-19T23:45:13.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.609+0000 7fa71d523700 1 Processor -- start 2024-04-19T23:45:13.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.609+0000 7fa71d523700 1 -- start start 2024-04-19T23:45:13.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.610+0000 7fa71d523700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa71812a250 0x7fa7181c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.610+0000 7fa71d523700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa718125010 con 0x7fa71812a250 2024-04-19T23:45:13.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.610+0000 7fa716ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa71812a250 0x7fa7181c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.610+0000 7fa716ffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa71812a250 0x7fa7181c2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49834/0 (socket says 172.21.15.76:49834) 2024-04-19T23:45:13.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.610+0000 7fa716ffd700 1 -- 172.21.15.76:0/3961295663 learned_addr learned my addr 172.21.15.76:0/3961295663 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.611+0000 7fa716ffd700 1 -- 172.21.15.76:0/3961295663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c00b7f0 con 0x7fa71812a250 2024-04-19T23:45:13.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.611+0000 7fa716ffd700 1 --2- 172.21.15.76:0/3961295663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa71812a250 0x7fa7181c2470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa70800c410 tx=0x7fa70800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.611+0000 7fa6ff7fe700 1 -- 172.21.15.76:0/3961295663 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa708005200 con 0x7fa71812a250 2024-04-19T23:45:13.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.611+0000 7fa6ff7fe700 1 -- 172.21.15.76:0/3961295663 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa708005380 con 0x7fa71812a250 2024-04-19T23:45:13.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.611+0000 7fa6ff7fe700 1 -- 172.21.15.76:0/3961295663 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa708006860 con 0x7fa71812a250 2024-04-19T23:45:13.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.611+0000 7fa71d523700 1 -- 172.21.15.76:0/3961295663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa718126120 con 0x7fa71812a250 2024-04-19T23:45:13.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.611+0000 7fa71d523700 1 -- 172.21.15.76:0/3961295663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa718125a20 con 0x7fa71812a250 2024-04-19T23:45:13.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.612+0000 7fa6ff7fe700 1 -- 172.21.15.76:0/3961295663 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7fa708003680 con 0x7fa71812a250 2024-04-19T23:45:13.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.612+0000 7fa71d523700 1 -- 172.21.15.76:0/3961295663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa718062510 con 0x7fa71812a250 2024-04-19T23:45:13.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.612+0000 7fa6ff7fe700 1 --2- 172.21.15.76:0/3961295663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fa704037790 0x7fa704039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.613+0000 7fa6ff7fe700 1 -- 172.21.15.76:0/3961295663 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fa708052350 con 0x7fa71812a250 2024-04-19T23:45:13.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.613+0000 7fa7167fc700 1 --2- 172.21.15.76:0/3961295663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fa704037790 0x7fa704039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.613+0000 7fa7167fc700 1 --2- 172.21.15.76:0/3961295663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fa704037790 0x7fa704039c50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00be60 tx=0x7fa70c014000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.617+0000 7fa6ff7fe700 1 -- 172.21.15.76:0/3961295663 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7fa70804f060 con 0x7fa71812a250 2024-04-19T23:45:13.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.622+0000 7fd83e0e3700 1 Processor -- start 2024-04-19T23:45:13.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.622+0000 7fd83e0e3700 1 -- start start 2024-04-19T23:45:13.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.622+0000 7fd83e0e3700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fd838096040 0x7fd838132f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.622+0000 7fd83e0e3700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd838094cd0 con 0x7fd838095550 2024-04-19T23:45:13.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.622+0000 7fd83e0e3700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd838097c20 con 0x7fd838096040 2024-04-19T23:45:13.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.623+0000 7fd8377fe700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fd838095550 0x7fd838095930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48962/0 (socket says 172.21.15.76:48962) 2024-04-19T23:45:13.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.623+0000 7fd8377fe700 1 -- 172.21.15.76:0/4153983168 learned_addr learned my addr 172.21.15.76:0/4153983168 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:13.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.623+0000 7fd836ffd700 1 --2- 172.21.15.76:0/4153983168 >> v2:172.21.15.76:3300/0 conn(0x7fd838096040 0x7fd838132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.623+0000 7fd8367fc700 1 -- 172.21.15.76:0/4153983168 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500368933 0 0) 0x7fd838094cd0 con 0x7fd838095550 2024-04-19T23:45:13.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.623+0000 7fd8367fc700 1 -- 172.21.15.76:0/4153983168 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8200035b0 con 0x7fd838095550 2024-04-19T23:45:13.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.623+0000 7fd836ffd700 1 -- 172.21.15.76:0/4153983168 >> v1:172.21.15.76:6789/0 conn(0x7fd838095550 legacy=0x7fd838095930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.623+0000 7fd836ffd700 1 -- 172.21.15.76:0/4153983168 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83809db80 con 0x7fd838096040 2024-04-19T23:45:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.623+0000 7fd836ffd700 1 --2- 172.21.15.76:0/4153983168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd838096040 0x7fd838132f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0097c0 tx=0x7fd82c009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7237352d442d650e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.623+0000 7fd8367fc700 1 -- 172.21.15.76:0/4153983168 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd82c004160 con 0x7fd838096040 2024-04-19T23:45:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.623+0000 7fd8367fc700 1 -- 172.21.15.76:0/4153983168 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c0042c0 con 0x7fd838096040 2024-04-19T23:45:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.623+0000 7fd8367fc700 1 -- 172.21.15.76:0/4153983168 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd82c004580 con 0x7fd838096040 2024-04-19T23:45:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.624+0000 7fd83e0e3700 1 -- 172.21.15.76:0/4153983168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd838096040 msgr2=0x7fd838132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.624+0000 7fd83e0e3700 1 --2- 172.21.15.76:0/4153983168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd838096040 0x7fd838132f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0097c0 tx=0x7fd82c009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.624+0000 7fd83e0e3700 1 -- 172.21.15.76:0/4153983168 shutdown_connections 2024-04-19T23:45:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.624+0000 7fd83e0e3700 1 --2- 172.21.15.76:0/4153983168 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd838096040 0x7fd838132f30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.624+0000 7fd83e0e3700 1 -- 172.21.15.76:0/4153983168 >> 172.21.15.76:0/4153983168 conn(0x7fd83809be70 msgr2=0x7fd83809c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.624+0000 7fd83e0e3700 1 -- 172.21.15.76:0/4153983168 shutdown_connections 2024-04-19T23:45:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.624+0000 7fd83e0e3700 1 -- 172.21.15.76:0/4153983168 wait complete. 2024-04-19T23:45:13.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.625+0000 7f6393a1b700 1 Processor -- start 2024-04-19T23:45:13.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.625+0000 7fd83e0e3700 1 Processor -- start 2024-04-19T23:45:13.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.625+0000 7f6393a1b700 1 -- start start 2024-04-19T23:45:13.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.626+0000 7fd83e0e3700 1 -- start start 2024-04-19T23:45:13.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.625+0000 7f6393a1b700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f638c132400 0x7f638c1327e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.625+0000 7f6393a1b700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c096eb0 con 0x7f638c094590 2024-04-19T23:45:13.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.626+0000 7f6393a1b700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c06cc20 con 0x7f638c132400 2024-04-19T23:45:13.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.626+0000 7fd83e0e3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd838095550 0x7fd8381be850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.626+0000 7fd83e0e3700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838094220 con 0x7fd838095550 2024-04-19T23:45:13.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.626+0000 7f63917b7700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f638c132400 0x7f638c1327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.626+0000 7f6390fb6700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f638c094590 0x7f638c0949f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48972/0 (socket says 172.21.15.76:48972) 2024-04-19T23:45:13.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.626+0000 7f6390fb6700 1 -- 172.21.15.76:0/820779842 learned_addr learned my addr 172.21.15.76:0/820779842 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:13.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.626+0000 7fd8377fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd838095550 0x7fd8381be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.626+0000 7fd8377fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd838095550 0x7fd8381be850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49858/0 (socket says 172.21.15.76:49858) 2024-04-19T23:45:13.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.626+0000 7fd8377fe700 1 -- 172.21.15.76:0/3828037510 learned_addr learned my addr 172.21.15.76:0/3828037510 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7f63917b7700 1 -- 172.21.15.76:0/820779842 >> v1:172.21.15.76:6789/0 conn(0x7f638c094590 legacy=0x7f638c0949f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7f63917b7700 1 -- 172.21.15.76:0/820779842 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c04ebb0 con 0x7f638c132400 2024-04-19T23:45:13.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7fd8377fe700 1 -- 172.21.15.76:0/3828037510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c0094a0 con 0x7fd838095550 2024-04-19T23:45:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7fd8377fe700 1 --2- 172.21.15.76:0/3828037510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd838095550 0x7fd8381be850 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd82800c450 tx=0x7fd82800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7f63917b7700 1 --2- 172.21.15.76:0/820779842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638c132400 0x7f638c1327e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f63880097c0 tx=0x7f6388009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a03ea48a62af19 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7fd81ffff700 1 -- 172.21.15.76:0/3828037510 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd828005ca0 con 0x7fd838095550 2024-04-19T23:45:13.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7fd81ffff700 1 -- 172.21.15.76:0/3828037510 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd828005e00 con 0x7fd838095550 2024-04-19T23:45:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7fd81ffff700 1 -- 172.21.15.76:0/3828037510 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd828007200 con 0x7fd838095550 2024-04-19T23:45:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7f6383fff700 1 -- 172.21.15.76:0/820779842 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6388004160 con 0x7f638c132400 2024-04-19T23:45:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7fd83e0e3700 1 -- 172.21.15.76:0/3828037510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd838124b20 con 0x7fd838095550 2024-04-19T23:45:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7f6383fff700 1 -- 172.21.15.76:0/820779842 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63880042c0 con 0x7f638c132400 2024-04-19T23:45:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7fd83e0e3700 1 -- 172.21.15.76:0/3828037510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd838124e30 con 0x7fd838095550 2024-04-19T23:45:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.627+0000 7f6383fff700 1 -- 172.21.15.76:0/820779842 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6388004580 con 0x7f638c132400 2024-04-19T23:45:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.628+0000 7fd81ffff700 1 -- 172.21.15.76:0/3828037510 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7fd828007360 con 0x7fd838095550 2024-04-19T23:45:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.628+0000 7fd81ffff700 1 --2- 172.21.15.76:0/3828037510 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd824037780 0x7fd824039c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.628+0000 7fd81ffff700 1 -- 172.21.15.76:0/3828037510 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fd828049410 con 0x7fd838095550 2024-04-19T23:45:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.628+0000 7f6393a1b700 1 -- 172.21.15.76:0/820779842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638c132400 msgr2=0x7f638c1327e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.628+0000 7f6393a1b700 1 --2- 172.21.15.76:0/820779842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638c132400 0x7f638c1327e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f63880097c0 tx=0x7f6388009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.628+0000 7f6393a1b700 1 -- 172.21.15.76:0/820779842 shutdown_connections 2024-04-19T23:45:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.628+0000 7f6393a1b700 1 --2- 172.21.15.76:0/820779842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638c132400 0x7f638c1327e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.628+0000 7f6393a1b700 1 -- 172.21.15.76:0/820779842 >> 172.21.15.76:0/820779842 conn(0x7f638c09d020 msgr2=0x7f638c09d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.628+0000 7fd83e0e3700 1 -- 172.21.15.76:0/3828037510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8381245f0 con 0x7fd838095550 2024-04-19T23:45:13.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.628+0000 7fd836ffd700 1 --2- 172.21.15.76:0/3828037510 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd824037780 0x7fd824039c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.629+0000 7f6393a1b700 1 -- 172.21.15.76:0/820779842 shutdown_connections 2024-04-19T23:45:13.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.629+0000 7f6393a1b700 1 -- 172.21.15.76:0/820779842 wait complete. 2024-04-19T23:45:13.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.629+0000 7fd836ffd700 1 --2- 172.21.15.76:0/3828037510 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd824037780 0x7fd824039c40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0090b0 tx=0x7fd82c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.630+0000 7f6393a1b700 1 Processor -- start 2024-04-19T23:45:13.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.630+0000 7f6393a1b700 1 -- start start 2024-04-19T23:45:13.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.630+0000 7f6393a1b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638c094590 0x7f638c1c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.630+0000 7f6393a1b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0989d0 con 0x7f638c094590 2024-04-19T23:45:13.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.631+0000 7f63917b7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638c094590 0x7f638c1c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.631+0000 7f63917b7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638c094590 0x7f638c1c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49874/0 (socket says 172.21.15.76:49874) 2024-04-19T23:45:13.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.631+0000 7f63917b7700 1 -- 172.21.15.76:0/2502141797 learned_addr learned my addr 172.21.15.76:0/2502141797 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.631+0000 7f63917b7700 1 -- 172.21.15.76:0/2502141797 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63880094a0 con 0x7f638c094590 2024-04-19T23:45:13.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.631+0000 7f63917b7700 1 --2- 172.21.15.76:0/2502141797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638c094590 0x7f638c1c6870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f638c06cd60 tx=0x7f6388004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.634+0000 7f6381ffb700 1 -- 172.21.15.76:0/2502141797 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6388003df0 con 0x7f638c094590 2024-04-19T23:45:13.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.634+0000 7fd81ffff700 1 -- 172.21.15.76:0/3828037510 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7fd828017020 con 0x7fd838095550 2024-04-19T23:45:13.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.634+0000 7f6381ffb700 1 -- 172.21.15.76:0/2502141797 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638801e070 con 0x7f638c094590 2024-04-19T23:45:13.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.634+0000 7f6381ffb700 1 -- 172.21.15.76:0/2502141797 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6388011780 con 0x7f638c094590 2024-04-19T23:45:13.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.634+0000 7f6393a1b700 1 -- 172.21.15.76:0/2502141797 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c071020 con 0x7f638c094590 2024-04-19T23:45:13.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.634+0000 7f6393a1b700 1 -- 172.21.15.76:0/2502141797 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c1ba6a0 con 0x7f638c094590 2024-04-19T23:45:13.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.635+0000 7f6381ffb700 1 -- 172.21.15.76:0/2502141797 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f63880118e0 con 0x7f638c094590 2024-04-19T23:45:13.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.636+0000 7f6393a1b700 1 -- 172.21.15.76:0/2502141797 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c070e80 con 0x7f638c094590 2024-04-19T23:45:13.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.636+0000 7f6381ffb700 1 --2- 172.21.15.76:0/2502141797 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f63700377d0 0x7f6370039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.636+0000 7f6381ffb700 1 -- 172.21.15.76:0/2502141797 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f638804f120 con 0x7f638c094590 2024-04-19T23:45:13.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.639+0000 7f6390fb6700 1 --2- 172.21.15.76:0/2502141797 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f63700377d0 0x7f6370039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.639+0000 7f6390fb6700 1 --2- 172.21.15.76:0/2502141797 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f63700377d0 0x7f6370039c90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f637c000f60 tx=0x7f637c007b10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.641+0000 7f6381ffb700 1 -- 172.21.15.76:0/2502141797 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f638c070e80 con 0x7f638c094590 2024-04-19T23:45:13.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.644+0000 7f6399e77700 1 Processor -- start 2024-04-19T23:45:13.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.644+0000 7f6399e77700 1 -- start start 2024-04-19T23:45:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.645+0000 7f6399e77700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f639412ea60 0x7f6394130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.645+0000 7f6399e77700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6394070260 con 0x7f63940943c0 2024-04-19T23:45:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.645+0000 7f6399e77700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639409dc50 con 0x7f639412ea60 2024-04-19T23:45:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.645+0000 7f6392ffd700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f639412ea60 0x7f6394130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.645+0000 7f63937fe700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f63940943c0 0x7f63940947a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48982/0 (socket says 172.21.15.76:48982) 2024-04-19T23:45:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.645+0000 7f63937fe700 1 -- 172.21.15.76:0/3888743788 learned_addr learned my addr 172.21.15.76:0/3888743788 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.645+0000 7f6392ffd700 1 -- 172.21.15.76:0/3888743788 >> v1:172.21.15.76:6789/0 conn(0x7f63940943c0 legacy=0x7f63940947a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.645+0000 7f63927fc700 1 -- 172.21.15.76:0/3888743788 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462230069 0 0) 0x7f6394070260 con 0x7f63940943c0 2024-04-19T23:45:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.645+0000 7f6392ffd700 1 -- 172.21.15.76:0/3888743788 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63940677a0 con 0x7f639412ea60 2024-04-19T23:45:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.646+0000 7f6392ffd700 1 --2- 172.21.15.76:0/3888743788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f639412ea60 0x7f6394130e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f63880097c0 tx=0x7f6388009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9f5c48de4cc44f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.646+0000 7f63927fc700 1 -- 172.21.15.76:0/3888743788 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6388004160 con 0x7f639412ea60 2024-04-19T23:45:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.646+0000 7f63927fc700 1 -- 172.21.15.76:0/3888743788 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63880042c0 con 0x7f639412ea60 2024-04-19T23:45:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.646+0000 7f63927fc700 1 -- 172.21.15.76:0/3888743788 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6388004580 con 0x7f639412ea60 2024-04-19T23:45:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.646+0000 7f6399e77700 1 -- 172.21.15.76:0/3888743788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f639412ea60 msgr2=0x7f6394130e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.646+0000 7f6399e77700 1 --2- 172.21.15.76:0/3888743788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f639412ea60 0x7f6394130e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f63880097c0 tx=0x7f6388009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.646+0000 7f6399e77700 1 -- 172.21.15.76:0/3888743788 shutdown_connections 2024-04-19T23:45:13.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.646+0000 7f6399e77700 1 --2- 172.21.15.76:0/3888743788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f639412ea60 0x7f6394130e50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.646+0000 7f6399e77700 1 -- 172.21.15.76:0/3888743788 >> 172.21.15.76:0/3888743788 conn(0x7f639409c120 msgr2=0x7f639409c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.646+0000 7f6399e77700 1 -- 172.21.15.76:0/3888743788 shutdown_connections 2024-04-19T23:45:13.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.646+0000 7f6399e77700 1 -- 172.21.15.76:0/3888743788 wait complete. 2024-04-19T23:45:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.647+0000 7f6399e77700 1 Processor -- start 2024-04-19T23:45:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.647+0000 7f6399e77700 1 -- start start 2024-04-19T23:45:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.648+0000 7f6399e77700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f63940943c0 0x7f63941c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.648+0000 7f6399e77700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639412e450 con 0x7f63940943c0 2024-04-19T23:45:13.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.648+0000 7f63937fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f63940943c0 0x7f63941c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.648+0000 7f63937fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f63940943c0 0x7f63941c1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49884/0 (socket says 172.21.15.76:49884) 2024-04-19T23:45:13.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.648+0000 7f63937fe700 1 -- 172.21.15.76:0/3337222758 learned_addr learned my addr 172.21.15.76:0/3337222758 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:13.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.648+0000 7f63937fe700 1 -- 172.21.15.76:0/3337222758 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63880094a0 con 0x7f63940943c0 2024-04-19T23:45:13.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.648+0000 7f63937fe700 1 --2- 172.21.15.76:0/3337222758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f63940943c0 0x7f63941c1ea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f638400c4a0 tx=0x7f638400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.648+0000 7f637bfff700 1 -- 172.21.15.76:0/3337222758 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6384004bb0 con 0x7f63940943c0 2024-04-19T23:45:13.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.649+0000 7f6399e77700 1 -- 172.21.15.76:0/3337222758 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639408a2c0 con 0x7f63940943c0 2024-04-19T23:45:13.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.649+0000 7f6399e77700 1 -- 172.21.15.76:0/3337222758 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6394089680 con 0x7f63940943c0 2024-04-19T23:45:13.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.649+0000 7f637bfff700 1 -- 172.21.15.76:0/3337222758 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6384004d10 con 0x7f63940943c0 2024-04-19T23:45:13.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.649+0000 7f637bfff700 1 -- 172.21.15.76:0/3337222758 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63840070d0 con 0x7f63940943c0 2024-04-19T23:45:13.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.649+0000 7f637bfff700 1 -- 172.21.15.76:0/3337222758 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f63840072e0 con 0x7f63940943c0 2024-04-19T23:45:13.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.650+0000 7f637bfff700 1 --2- 172.21.15.76:0/3337222758 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f6380037790 0x7f6380039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:13.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.650+0000 7f637bfff700 1 -- 172.21.15.76:0/3337222758 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6384049c50 con 0x7f63940943c0 2024-04-19T23:45:13.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.650+0000 7f6399e77700 1 -- 172.21.15.76:0/3337222758 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63740050d0 con 0x7f63940943c0 2024-04-19T23:45:13.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.650+0000 7f6392ffd700 1 --2- 172.21.15.76:0/3337222758 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f6380037790 0x7f6380039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:13.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.650+0000 7f6392ffd700 1 --2- 172.21.15.76:0/3337222758 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f6380037790 0x7f6380039c50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f63880090b0 tx=0x7f6388008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:13.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.655+0000 7f637bfff700 1 -- 172.21.15.76:0/3337222758 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f63840102c0 con 0x7f63940943c0 2024-04-19T23:45:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.840+0000 7fa71d523700 1 -- 172.21.15.76:0/3961295663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa71806bcd0 con 0x7fa71812a250 2024-04-19T23:45:13.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.840+0000 7fa6ff7fe700 1 -- 172.21.15.76:0/3961295663 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa70804f030 con 0x7fa71812a250 2024-04-19T23:45:13.841 INFO:teuthology.orchestra.run.smithi076.stdout:38654705667 2024-04-19T23:45:13.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.841+0000 7f6393a1b700 1 -- 172.21.15.76:0/2502141797 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f638c070e80 con 0x7f638c094590 2024-04-19T23:45:13.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.842+0000 7f6381ffb700 1 -- 172.21.15.76:0/2502141797 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f638c070e80 con 0x7f638c094590 2024-04-19T23:45:13.842 INFO:teuthology.orchestra.run.smithi076.stdout:42949672963 2024-04-19T23:45:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.842+0000 7fa71d523700 1 -- 172.21.15.76:0/3961295663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fa704037790 msgr2=0x7fa704039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.842+0000 7fa71d523700 1 --2- 172.21.15.76:0/3961295663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fa704037790 0x7fa704039c50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00be60 tx=0x7fa70c014000 comp rx=0 tx=0).stop 2024-04-19T23:45:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.842+0000 7fa71d523700 1 -- 172.21.15.76:0/3961295663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa71812a250 msgr2=0x7fa7181c2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.842+0000 7fa71d523700 1 --2- 172.21.15.76:0/3961295663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa71812a250 0x7fa7181c2470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa70800c410 tx=0x7fa70800c7d0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.842+0000 7fa71d523700 1 -- 172.21.15.76:0/3961295663 shutdown_connections 2024-04-19T23:45:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.842+0000 7fa71d523700 1 --2- 172.21.15.76:0/3961295663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fa704037790 0x7fa704039c50 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00be60 tx=0x7fa70c014000 comp rx=0 tx=0).stop 2024-04-19T23:45:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.842+0000 7fa71d523700 1 --2- 172.21.15.76:0/3961295663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa71812a250 0x7fa7181c2470 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.842+0000 7fa71d523700 1 -- 172.21.15.76:0/3961295663 >> 172.21.15.76:0/3961295663 conn(0x7fa71809a870 msgr2=0x7fa71812add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.843+0000 7fa71d523700 1 -- 172.21.15.76:0/3961295663 shutdown_connections 2024-04-19T23:45:13.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.843+0000 7fa71d523700 1 -- 172.21.15.76:0/3961295663 wait complete. 2024-04-19T23:45:13.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.844+0000 7f6393a1b700 1 -- 172.21.15.76:0/2502141797 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f63700377d0 msgr2=0x7f6370039c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.844+0000 7f6393a1b700 1 --2- 172.21.15.76:0/2502141797 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f63700377d0 0x7f6370039c90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f637c000f60 tx=0x7f637c007b10 comp rx=0 tx=0).stop 2024-04-19T23:45:13.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.844+0000 7f6393a1b700 1 -- 172.21.15.76:0/2502141797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638c094590 msgr2=0x7f638c1c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.844+0000 7f6393a1b700 1 --2- 172.21.15.76:0/2502141797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638c094590 0x7f638c1c6870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f638c06cd60 tx=0x7f6388004750 comp rx=0 tx=0).stop 2024-04-19T23:45:13.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.844+0000 7f6393a1b700 1 -- 172.21.15.76:0/2502141797 shutdown_connections 2024-04-19T23:45:13.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.844+0000 7f6393a1b700 1 --2- 172.21.15.76:0/2502141797 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f63700377d0 0x7f6370039c90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.844+0000 7f6393a1b700 1 --2- 172.21.15.76:0/2502141797 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638c094590 0x7f638c1c6870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.844+0000 7f6393a1b700 1 -- 172.21.15.76:0/2502141797 >> 172.21.15.76:0/2502141797 conn(0x7f638c09d020 msgr2=0x7f638c095e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.844+0000 7f6393a1b700 1 -- 172.21.15.76:0/2502141797 shutdown_connections 2024-04-19T23:45:13.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.844+0000 7f6393a1b700 1 -- 172.21.15.76:0/2502141797 wait complete. 2024-04-19T23:45:13.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2024-04-19T23:45:13.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.856+0000 7f6399e77700 1 -- 172.21.15.76:0/3337222758 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6374005380 con 0x7f63940943c0 2024-04-19T23:45:13.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.856+0000 7f637bfff700 1 -- 172.21.15.76:0/3337222758 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f638401bb30 con 0x7f63940943c0 2024-04-19T23:45:13.857 INFO:teuthology.orchestra.run.smithi076.stdout:42949672963 2024-04-19T23:45:13.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.856+0000 7fd83e0e3700 1 -- 172.21.15.76:0/3828037510 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd838062510 con 0x7fd838095550 2024-04-19T23:45:13.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.857+0000 7fd81ffff700 1 -- 172.21.15.76:0/3828037510 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd82801b3b0 con 0x7fd838095550 2024-04-19T23:45:13.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.1 2024-04-19T23:45:13.858 INFO:teuthology.orchestra.run.smithi076.stdout:42949672963 2024-04-19T23:45:13.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.858+0000 7f6399e77700 1 -- 172.21.15.76:0/3337222758 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f6380037790 msgr2=0x7f6380039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.858+0000 7f6399e77700 1 --2- 172.21.15.76:0/3337222758 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f6380037790 0x7f6380039c50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f63880090b0 tx=0x7f6388008030 comp rx=0 tx=0).stop 2024-04-19T23:45:13.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.858+0000 7f6399e77700 1 -- 172.21.15.76:0/3337222758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f63940943c0 msgr2=0x7f63941c1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.858+0000 7f6399e77700 1 --2- 172.21.15.76:0/3337222758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f63940943c0 0x7f63941c1ea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f638400c4a0 tx=0x7f638400c860 comp rx=0 tx=0).stop 2024-04-19T23:45:13.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.858+0000 7f6399e77700 1 -- 172.21.15.76:0/3337222758 shutdown_connections 2024-04-19T23:45:13.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.858+0000 7f6399e77700 1 --2- 172.21.15.76:0/3337222758 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f6380037790 0x7f6380039c50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.858+0000 7f6399e77700 1 --2- 172.21.15.76:0/3337222758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f63940943c0 0x7f63941c1ea0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.858+0000 7f6399e77700 1 -- 172.21.15.76:0/3337222758 >> 172.21.15.76:0/3337222758 conn(0x7f639409c120 msgr2=0x7f639412b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7f6399e77700 1 -- 172.21.15.76:0/3337222758 shutdown_connections 2024-04-19T23:45:13.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7f6399e77700 1 -- 172.21.15.76:0/3337222758 wait complete. 2024-04-19T23:45:13.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7fd83e0e3700 1 -- 172.21.15.76:0/3828037510 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd824037780 msgr2=0x7fd824039c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7fd83e0e3700 1 --2- 172.21.15.76:0/3828037510 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd824037780 0x7fd824039c40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0090b0 tx=0x7fd82c008030 comp rx=0 tx=0).stop 2024-04-19T23:45:13.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7fd83e0e3700 1 -- 172.21.15.76:0/3828037510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd838095550 msgr2=0x7fd8381be850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:13.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7fd83e0e3700 1 --2- 172.21.15.76:0/3828037510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd838095550 0x7fd8381be850 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd82800c450 tx=0x7fd82800c810 comp rx=0 tx=0).stop 2024-04-19T23:45:13.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7fd83e0e3700 1 -- 172.21.15.76:0/3828037510 shutdown_connections 2024-04-19T23:45:13.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7fd83e0e3700 1 --2- 172.21.15.76:0/3828037510 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7fd824037780 0x7fd824039c40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7fd83e0e3700 1 --2- 172.21.15.76:0/3828037510 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd838095550 0x7fd8381be850 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:13.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7fd83e0e3700 1 -- 172.21.15.76:0/3828037510 >> 172.21.15.76:0/3828037510 conn(0x7fd83809be70 msgr2=0x7fd838070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:13.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7fd83e0e3700 1 -- 172.21.15.76:0/3828037510 shutdown_connections 2024-04-19T23:45:13.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:13.859+0000 7fd83e0e3700 1 -- 172.21.15.76:0/3828037510 wait complete. 2024-04-19T23:45:13.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.2 2024-04-19T23:45:13.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.3 2024-04-19T23:45:14.857 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T23:45:14.859 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T23:45:14.873 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T23:45:14.873 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-19T23:45:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.006+0000 7f4e588ee700 1 Processor -- start 2024-04-19T23:45:15.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.006+0000 7f4e588ee700 1 -- start start 2024-04-19T23:45:15.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.006+0000 7efe5ef8d700 1 Processor -- start 2024-04-19T23:45:15.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.006+0000 7efe5ef8d700 1 -- start start 2024-04-19T23:45:15.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.006+0000 7f4e588ee700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f4e5412b200 0x7f4e5412fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.006+0000 7f4e588ee700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540970b0 con 0x7f4e5412a710 2024-04-19T23:45:15.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.006+0000 7f4e588ee700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5409db40 con 0x7f4e5412b200 2024-04-19T23:45:15.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.006+0000 7efe5ef8d700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7efe58130c60 0x7efe58133050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.006+0000 7efe5ef8d700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe58099a20 con 0x7efe58097ae0 2024-04-19T23:45:15.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.006+0000 7efe5ef8d700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe58098cb0 con 0x7efe58130c60 2024-04-19T23:45:15.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.007+0000 7efe5cd29700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7efe58097ae0 0x7efe58097ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:48996/0 (socket says 172.21.15.76:48996) 2024-04-19T23:45:15.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.007+0000 7efe5cd29700 1 -- 172.21.15.76:0/2640635971 learned_addr learned my addr 172.21.15.76:0/2640635971 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:15.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.007+0000 7f4e51d9b700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f4e5412b200 0x7f4e5412fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.007+0000 7f4e51d9b700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f4e5412b200 0x7f4e5412fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49904/0 (socket says 172.21.15.76:49904) 2024-04-19T23:45:15.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.007+0000 7f4e51d9b700 1 -- 172.21.15.76:0/2587285887 learned_addr learned my addr 172.21.15.76:0/2587285887 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:15.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.007+0000 7f4e51d9b700 1 -- 172.21.15.76:0/2587285887 >> v1:172.21.15.76:6789/0 conn(0x7f4e5412a710 legacy=0x7f4e5412aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-19T23:45:15.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.007+0000 7f4e51d9b700 1 -- 172.21.15.76:0/2587285887 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e54096960 con 0x7f4e5412b200 2024-04-19T23:45:15.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.007+0000 7efe577fe700 1 -- 172.21.15.76:0/2640635971 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315931921 0 0) 0x7efe58099a20 con 0x7efe58097ae0 2024-04-19T23:45:15.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.007+0000 7efe577fe700 1 -- 172.21.15.76:0/2640635971 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe480035b0 con 0x7efe58097ae0 2024-04-19T23:45:15.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.007+0000 7f4e51d9b700 1 --2- 172.21.15.76:0/2587285887 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4e5412b200 0x7f4e5412fa30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009870 tx=0x7f4e48009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfcbaedbeb8a2de server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe57fff700 1 --2- 172.21.15.76:0/2640635971 >> v2:172.21.15.76:3300/0 conn(0x7efe58130c60 0x7efe58133050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe577fe700 1 -- 172.21.15.76:0/2640635971 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481844446 0 0) 0x7efe480035b0 con 0x7efe58097ae0 2024-04-19T23:45:15.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7f4e5159a700 1 -- 172.21.15.76:0/2587285887 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e48004160 con 0x7f4e5412b200 2024-04-19T23:45:15.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7f4e5159a700 1 -- 172.21.15.76:0/2587285887 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e480042c0 con 0x7f4e5412b200 2024-04-19T23:45:15.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7f4e5159a700 1 -- 172.21.15.76:0/2587285887 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e48004580 con 0x7f4e5412b200 2024-04-19T23:45:15.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe577fe700 1 -- 172.21.15.76:0/2640635971 >> v2:172.21.15.76:3300/0 conn(0x7efe58130c60 msgr2=0x7efe58133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-19T23:45:15.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe577fe700 1 --2- 172.21.15.76:0/2640635971 >> v2:172.21.15.76:3300/0 conn(0x7efe58130c60 0x7efe58133050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe577fe700 1 -- 172.21.15.76:0/2640635971 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58099f60 con 0x7efe58097ae0 2024-04-19T23:45:15.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe577fe700 1 -- 172.21.15.76:0/2640635971 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2246541106 0 0) 0x7efe4c0015a0 con 0x7efe58097ae0 2024-04-19T23:45:15.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe577fe700 1 -- 172.21.15.76:0/2640635971 >> v1:172.21.15.76:6789/0 conn(0x7efe58097ae0 legacy=0x7efe58097ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe577fe700 1 --2- 172.21.15.76:0/2640635971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 0x7efe48003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe577fe700 1 -- 172.21.15.76:0/2640635971 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe58098cb0 con 0x7efe48003a00 2024-04-19T23:45:15.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe5cd29700 1 --2- 172.21.15.76:0/2640635971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 0x7efe48003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe5cd29700 1 -- 172.21.15.76:0/2640635971 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58099f60 con 0x7efe48003a00 2024-04-19T23:45:15.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.008+0000 7efe5cd29700 1 --2- 172.21.15.76:0/2640635971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 0x7efe48003e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c210 tx=0x7efe48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b8e31417a79903 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7f4e588ee700 1 -- 172.21.15.76:0/2587285887 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4e5412b200 msgr2=0x7f4e5412fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7f4e588ee700 1 --2- 172.21.15.76:0/2587285887 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4e5412b200 0x7f4e5412fa30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009870 tx=0x7f4e48009b80 comp rx=0 tx=0).stop 2024-04-19T23:45:15.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7efe577fe700 1 -- 172.21.15.76:0/2640635971 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe4c00cbc0 con 0x7efe48003a00 2024-04-19T23:45:15.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7efe577fe700 1 -- 172.21.15.76:0/2640635971 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c00cd20 con 0x7efe48003a00 2024-04-19T23:45:15.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7efe577fe700 1 -- 172.21.15.76:0/2640635971 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe4c005960 con 0x7efe48003a00 2024-04-19T23:45:15.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2640635971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 msgr2=0x7efe48003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7efe5ef8d700 1 --2- 172.21.15.76:0/2640635971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 0x7efe48003e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c210 tx=0x7efe48005880 comp rx=0 tx=0).stop 2024-04-19T23:45:15.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7f4e588ee700 1 -- 172.21.15.76:0/2587285887 shutdown_connections 2024-04-19T23:45:15.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7f4e588ee700 1 --2- 172.21.15.76:0/2587285887 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4e5412b200 0x7f4e5412fa30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7f4e588ee700 1 -- 172.21.15.76:0/2587285887 >> 172.21.15.76:0/2587285887 conn(0x7f4e5409d020 msgr2=0x7f4e5409d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2640635971 shutdown_connections 2024-04-19T23:45:15.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7efe5ef8d700 1 --2- 172.21.15.76:0/2640635971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 0x7efe48003e00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7efe5ef8d700 1 --2- 172.21.15.76:0/2640635971 >> v2:172.21.15.76:3300/0 conn(0x7efe58130c60 0x7efe58133050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2640635971 >> 172.21.15.76:0/2640635971 conn(0x7efe5809e0e0 msgr2=0x7efe5809e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7f4e588ee700 1 -- 172.21.15.76:0/2587285887 shutdown_connections 2024-04-19T23:45:15.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2640635971 shutdown_connections 2024-04-19T23:45:15.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.009+0000 7f4e588ee700 1 -- 172.21.15.76:0/2587285887 wait complete. 2024-04-19T23:45:15.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.011+0000 7f4e588ee700 1 Processor -- start 2024-04-19T23:45:15.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.011+0000 7f4e588ee700 1 -- start start 2024-04-19T23:45:15.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.011+0000 7f4e588ee700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4e5412a710 0x7f4e54124300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.011+0000 7f4e588ee700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54127920 con 0x7f4e5412a710 2024-04-19T23:45:15.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.011+0000 7f4e5259c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4e5412a710 0x7f4e54124300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.011+0000 7f4e5259c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4e5412a710 0x7f4e54124300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49916/0 (socket says 172.21.15.76:49916) 2024-04-19T23:45:15.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.011+0000 7f4e5259c700 1 -- 172.21.15.76:0/2127042546 learned_addr learned my addr 172.21.15.76:0/2127042546 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:15.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.011+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2640635971 wait complete. 2024-04-19T23:45:15.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.012+0000 7efe5ef8d700 1 Processor -- start 2024-04-19T23:45:15.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.012+0000 7f4e5259c700 1 -- 172.21.15.76:0/2127042546 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48009550 con 0x7f4e5412a710 2024-04-19T23:45:15.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.012+0000 7f4e5259c700 1 --2- 172.21.15.76:0/2127042546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4e5412a710 0x7f4e54124300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400b420 tx=0x7f4e4400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.012+0000 7efe5ef8d700 1 -- start start 2024-04-19T23:45:15.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.012+0000 7efe5ef8d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 0x7efe58095bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.012+0000 7efe5ef8d700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5806de50 con 0x7efe48003a00 2024-04-19T23:45:15.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.012+0000 7efe5cd29700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 0x7efe58095bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.012+0000 7efe5cd29700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 0x7efe58095bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49928/0 (socket says 172.21.15.76:49928) 2024-04-19T23:45:15.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.012+0000 7efe5cd29700 1 -- 172.21.15.76:0/2911109235 learned_addr learned my addr 172.21.15.76:0/2911109235 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:15.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.013+0000 7efe5cd29700 1 -- 172.21.15.76:0/2911109235 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5806ee50 con 0x7efe48003a00 2024-04-19T23:45:15.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.013+0000 7efe5cd29700 1 --2- 172.21.15.76:0/2911109235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 0x7efe58095bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efe4c011000 tx=0x7efe4c001860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.013+0000 7f4e42ffd700 1 -- 172.21.15.76:0/2127042546 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e44004150 con 0x7f4e5412a710 2024-04-19T23:45:15.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.013+0000 7f4e42ffd700 1 -- 172.21.15.76:0/2127042546 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e440042d0 con 0x7f4e5412a710 2024-04-19T23:45:15.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.013+0000 7f4e588ee700 1 -- 172.21.15.76:0/2127042546 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e541275f0 con 0x7f4e5412a710 2024-04-19T23:45:15.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.013+0000 7f4e42ffd700 1 -- 172.21.15.76:0/2127042546 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e44003680 con 0x7f4e5412a710 2024-04-19T23:45:15.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.013+0000 7f4e588ee700 1 -- 172.21.15.76:0/2127042546 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e54125460 con 0x7f4e5412a710 2024-04-19T23:45:15.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.013+0000 7efe557fa700 1 -- 172.21.15.76:0/2911109235 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe4c00ce90 con 0x7efe48003a00 2024-04-19T23:45:15.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.014+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2911109235 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5806d560 con 0x7efe48003a00 2024-04-19T23:45:15.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.014+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2911109235 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5806e8c0 con 0x7efe48003a00 2024-04-19T23:45:15.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.014+0000 7efe557fa700 1 -- 172.21.15.76:0/2911109235 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c006110 con 0x7efe48003a00 2024-04-19T23:45:15.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.014+0000 7efe557fa700 1 -- 172.21.15.76:0/2911109235 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe4c0063b0 con 0x7efe48003a00 2024-04-19T23:45:15.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.015+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2911109235 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe380050d0 con 0x7efe48003a00 2024-04-19T23:45:15.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.015+0000 7efe557fa700 1 -- 172.21.15.76:0/2911109235 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7efe4c019070 con 0x7efe48003a00 2024-04-19T23:45:15.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.014+0000 7f4e588ee700 1 -- 172.21.15.76:0/2127042546 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e54126840 con 0x7f4e5412a710 2024-04-19T23:45:15.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.015+0000 7f4e42ffd700 1 -- 172.21.15.76:0/2127042546 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f4e440037e0 con 0x7f4e5412a710 2024-04-19T23:45:15.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.015+0000 7f4e42ffd700 1 --2- 172.21.15.76:0/2127042546 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f4e340377e0 0x7f4e34039ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.015+0000 7f4e42ffd700 1 -- 172.21.15.76:0/2127042546 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f4e44049de0 con 0x7f4e5412a710 2024-04-19T23:45:15.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.015+0000 7efe557fa700 1 --2- 172.21.15.76:0/2911109235 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efe3c037740 0x7efe3c039c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.015+0000 7efe557fa700 1 -- 172.21.15.76:0/2911109235 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7efe4c04bcc0 con 0x7efe48003a00 2024-04-19T23:45:15.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.015+0000 7f4e51d9b700 1 --2- 172.21.15.76:0/2127042546 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f4e340377e0 0x7f4e34039ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.015+0000 7efe57fff700 1 --2- 172.21.15.76:0/2911109235 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efe3c037740 0x7efe3c039c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.016+0000 7f4e51d9b700 1 --2- 172.21.15.76:0/2127042546 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f4e340377e0 0x7f4e34039ca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4e48000c00 tx=0x7f4e48008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.016+0000 7efe57fff700 1 --2- 172.21.15.76:0/2911109235 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efe3c037740 0x7efe3c039c00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efe44009750 tx=0x7efe44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.024+0000 7efe557fa700 1 -- 172.21.15.76:0/2911109235 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7efe4c0273c0 con 0x7efe48003a00 2024-04-19T23:45:15.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.032+0000 7f4e42ffd700 1 -- 172.21.15.76:0/2127042546 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f4e440212f0 con 0x7f4e5412a710 2024-04-19T23:45:15.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.050+0000 7f8eaface700 1 Processor -- start 2024-04-19T23:45:15.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.050+0000 7f8eaface700 1 -- start start 2024-04-19T23:45:15.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.050+0000 7f248d066700 1 Processor -- start 2024-04-19T23:45:15.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.050+0000 7f248d066700 1 -- start start 2024-04-19T23:45:15.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f8eaface700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8ea8095960 0x7f8ea8095d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f8eaface700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea809b780 con 0x7f8ea8096280 2024-04-19T23:45:15.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f8eaface700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea809d2b0 con 0x7f8ea8095960 2024-04-19T23:45:15.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f8ead86a700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8ea8095960 0x7f8ea8095d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f8ead86a700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8ea8095960 0x7f8ea8095d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49942/0 (socket says 172.21.15.76:49942) 2024-04-19T23:45:15.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f8ead069700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f8ea8096280 0x7f8ea808f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:49018/0 (socket says 172.21.15.76:49018) 2024-04-19T23:45:15.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f8ead86a700 1 -- 172.21.15.76:0/1424844222 learned_addr learned my addr 172.21.15.76:0/1424844222 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:15.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f248d066700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f248806ab70 0x7f2488128ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f248d066700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248804ebb0 con 0x7f2488128b00 2024-04-19T23:45:15.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f248d066700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2488092a50 con 0x7f248806ab70 2024-04-19T23:45:15.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f2486d9d700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f2488128b00 0x7f2488094850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:49022/0 (socket says 172.21.15.76:49022) 2024-04-19T23:45:15.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f2486d9d700 1 -- 172.21.15.76:0/1536834121 learned_addr learned my addr 172.21.15.76:0/1536834121 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:15.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f8eac868700 1 -- 172.21.15.76:0/1424844222 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299006799 0 0) 0x7f8ea809b780 con 0x7f8ea8096280 2024-04-19T23:45:15.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f8eac868700 1 -- 172.21.15.76:0/1424844222 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e940035b0 con 0x7f8ea8096280 2024-04-19T23:45:15.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f8ead86a700 1 -- 172.21.15.76:0/1424844222 >> v1:172.21.15.76:6789/0 conn(0x7f8ea8096280 legacy=0x7f8ea808f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.051+0000 7f8ead86a700 1 -- 172.21.15.76:0/1424844222 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea806aff0 con 0x7f8ea8095960 2024-04-19T23:45:15.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f248659c700 1 --2- 172.21.15.76:0/1536834121 >> v2:172.21.15.76:3300/0 conn(0x7f248806ab70 0x7f2488128ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f2485d9b700 1 -- 172.21.15.76:0/1536834121 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165825895 0 0) 0x7f248804ebb0 con 0x7f2488128b00 2024-04-19T23:45:15.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f2485d9b700 1 -- 172.21.15.76:0/1536834121 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24700079c0 con 0x7f2488128b00 2024-04-19T23:45:15.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f248659c700 1 -- 172.21.15.76:0/1536834121 >> v1:172.21.15.76:6789/0 conn(0x7f2488128b00 legacy=0x7f2488094850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f248659c700 1 -- 172.21.15.76:0/1536834121 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2488092cf0 con 0x7f248806ab70 2024-04-19T23:45:15.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f8ead86a700 1 --2- 172.21.15.76:0/1424844222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea8095960 0x7f8ea8095d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009870 tx=0x7f8ea4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eef20a7aed67e7b server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f248659c700 1 --2- 172.21.15.76:0/1536834121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f248806ab70 0x7f2488128ee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f247c0097c0 tx=0x7f247c009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87325de15a9b9c42 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f8eac868700 1 -- 172.21.15.76:0/1424844222 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ea4004160 con 0x7f8ea8095960 2024-04-19T23:45:15.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f8eac868700 1 -- 172.21.15.76:0/1424844222 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40042c0 con 0x7f8ea8095960 2024-04-19T23:45:15.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f8eac868700 1 -- 172.21.15.76:0/1424844222 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ea4004580 con 0x7f8ea8095960 2024-04-19T23:45:15.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f2485d9b700 1 -- 172.21.15.76:0/1536834121 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24780015a0 con 0x7f248806ab70 2024-04-19T23:45:15.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f2485d9b700 1 -- 172.21.15.76:0/1536834121 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c004030 con 0x7f248806ab70 2024-04-19T23:45:15.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.052+0000 7f2485d9b700 1 -- 172.21.15.76:0/1536834121 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f247c0042d0 con 0x7f248806ab70 2024-04-19T23:45:15.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f8eaface700 1 -- 172.21.15.76:0/1424844222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea8095960 msgr2=0x7f8ea8095d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f8eaface700 1 --2- 172.21.15.76:0/1424844222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea8095960 0x7f8ea8095d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009870 tx=0x7f8ea4009b80 comp rx=0 tx=0).stop 2024-04-19T23:45:15.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f8eaface700 1 -- 172.21.15.76:0/1424844222 shutdown_connections 2024-04-19T23:45:15.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f8eaface700 1 --2- 172.21.15.76:0/1424844222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea8095960 0x7f8ea8095d40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f8eaface700 1 -- 172.21.15.76:0/1424844222 >> 172.21.15.76:0/1424844222 conn(0x7f8ea809a870 msgr2=0x7f8ea809ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f248d066700 1 -- 172.21.15.76:0/1536834121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f248806ab70 msgr2=0x7f2488128ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f248d066700 1 --2- 172.21.15.76:0/1536834121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f248806ab70 0x7f2488128ee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f247c0097c0 tx=0x7f247c009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f248d066700 1 -- 172.21.15.76:0/1536834121 shutdown_connections 2024-04-19T23:45:15.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f248d066700 1 --2- 172.21.15.76:0/1536834121 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f248806ab70 0x7f2488128ee0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f248d066700 1 -- 172.21.15.76:0/1536834121 >> 172.21.15.76:0/1536834121 conn(0x7f248809a870 msgr2=0x7f248809ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f8eaface700 1 -- 172.21.15.76:0/1424844222 shutdown_connections 2024-04-19T23:45:15.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f8eaface700 1 -- 172.21.15.76:0/1424844222 wait complete. 2024-04-19T23:45:15.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f248d066700 1 -- 172.21.15.76:0/1536834121 shutdown_connections 2024-04-19T23:45:15.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.053+0000 7f248d066700 1 -- 172.21.15.76:0/1536834121 wait complete. 2024-04-19T23:45:15.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.054+0000 7f8eaface700 1 Processor -- start 2024-04-19T23:45:15.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.054+0000 7f8eaface700 1 -- start start 2024-04-19T23:45:15.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.054+0000 7f248d066700 1 Processor -- start 2024-04-19T23:45:15.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f248d066700 1 -- start start 2024-04-19T23:45:15.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f8eaface700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea8095960 0x7f8ea81218d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f8eaface700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8124910 con 0x7f8ea8095960 2024-04-19T23:45:15.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f8ead86a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea8095960 0x7f8ea81218d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f8ead86a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea8095960 0x7f8ea81218d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49960/0 (socket says 172.21.15.76:49960) 2024-04-19T23:45:15.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f8ead86a700 1 -- 172.21.15.76:0/3477145962 learned_addr learned my addr 172.21.15.76:0/3477145962 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:15.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f248d066700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f248806ab70 0x7f248806f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f248d066700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24880715e0 con 0x7f248806ab70 2024-04-19T23:45:15.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f2486d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f248806ab70 0x7f248806f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f2486d9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f248806ab70 0x7f248806f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49962/0 (socket says 172.21.15.76:49962) 2024-04-19T23:45:15.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f2486d9d700 1 -- 172.21.15.76:0/3966116989 learned_addr learned my addr 172.21.15.76:0/3966116989 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:15.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f8ead86a700 1 -- 172.21.15.76:0/3477145962 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4009550 con 0x7f8ea8095960 2024-04-19T23:45:15.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.055+0000 7f8ead86a700 1 --2- 172.21.15.76:0/3477145962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea8095960 0x7f8ea81218d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009bc0 tx=0x7f8ea4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.056+0000 7f2486d9d700 1 -- 172.21.15.76:0/3966116989 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0094a0 con 0x7f248806ab70 2024-04-19T23:45:15.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.056+0000 7f8e9e7fc700 1 -- 172.21.15.76:0/3477145962 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ea401f070 con 0x7f8ea8095960 2024-04-19T23:45:15.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.056+0000 7f8e9e7fc700 1 -- 172.21.15.76:0/3477145962 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea400f7f0 con 0x7f8ea8095960 2024-04-19T23:45:15.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.056+0000 7f8eaface700 1 -- 172.21.15.76:0/3477145962 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea81240e0 con 0x7f8ea8095960 2024-04-19T23:45:15.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.056+0000 7f8e9e7fc700 1 -- 172.21.15.76:0/3477145962 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ea400fad0 con 0x7f8ea8095960 2024-04-19T23:45:15.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.056+0000 7f2486d9d700 1 --2- 172.21.15.76:0/3966116989 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f248806ab70 0x7f248806f4b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f247800c700 tx=0x7f247800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.056+0000 7f8eaface700 1 -- 172.21.15.76:0/3477145962 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea8123b60 con 0x7f8ea8095960 2024-04-19T23:45:15.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.057+0000 7f246f7fe700 1 -- 172.21.15.76:0/3966116989 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2478004bb0 con 0x7f248806ab70 2024-04-19T23:45:15.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.057+0000 7f8e9e7fc700 1 -- 172.21.15.76:0/3477145962 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f8ea400fc30 con 0x7f8ea8095960 2024-04-19T23:45:15.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.057+0000 7f246f7fe700 1 -- 172.21.15.76:0/3966116989 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2478004d10 con 0x7f248806ab70 2024-04-19T23:45:15.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.057+0000 7f246f7fe700 1 -- 172.21.15.76:0/3966116989 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24780070d0 con 0x7f248806ab70 2024-04-19T23:45:15.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.057+0000 7f8eaface700 1 -- 172.21.15.76:0/3477145962 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea8124700 con 0x7f8ea8095960 2024-04-19T23:45:15.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.057+0000 7f8e9e7fc700 1 --2- 172.21.15.76:0/3477145962 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f8e8c0377d0 0x7f8e8c039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.057+0000 7f8e9e7fc700 1 -- 172.21.15.76:0/3477145962 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f8ea404d680 con 0x7f8ea8095960 2024-04-19T23:45:15.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.057+0000 7f8ead069700 1 --2- 172.21.15.76:0/3477145962 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f8e8c0377d0 0x7f8e8c039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.058+0000 7f8ead069700 1 --2- 172.21.15.76:0/3477145962 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f8e8c0377d0 0x7f8e8c039c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8e980016b0 tx=0x7f8e980079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.059+0000 7f248d066700 1 -- 172.21.15.76:0/3966116989 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2488071e10 con 0x7f248806ab70 2024-04-19T23:45:15.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.059+0000 7f248d066700 1 -- 172.21.15.76:0/3966116989 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2488072cc0 con 0x7f248806ab70 2024-04-19T23:45:15.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.060+0000 7f248d066700 1 -- 172.21.15.76:0/3966116989 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2488071430 con 0x7f248806ab70 2024-04-19T23:45:15.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.063+0000 7f8e9e7fc700 1 -- 172.21.15.76:0/3477145962 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f8ea4022780 con 0x7f8ea8095960 2024-04-19T23:45:15.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.063+0000 7f246f7fe700 1 -- 172.21.15.76:0/3966116989 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f2478007250 con 0x7f248806ab70 2024-04-19T23:45:15.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.064+0000 7f246f7fe700 1 --2- 172.21.15.76:0/3966116989 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2474037790 0x7f2474039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.064+0000 7f246f7fe700 1 -- 172.21.15.76:0/3966116989 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f247804a520 con 0x7f248806ab70 2024-04-19T23:45:15.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.064+0000 7f248659c700 1 --2- 172.21.15.76:0/3966116989 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2474037790 0x7f2474039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.064+0000 7f248659c700 1 --2- 172.21.15.76:0/3966116989 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2474037790 0x7f2474039c50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f247c009b10 tx=0x7f247c008000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.068+0000 7f246f7fe700 1 -- 172.21.15.76:0/3966116989 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f2478007500 con 0x7f248806ab70 2024-04-19T23:45:15.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.233+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2911109235 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe38005650 con 0x7efe48003a00 2024-04-19T23:45:15.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.233+0000 7efe557fa700 1 -- 172.21.15.76:0/2911109235 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe4c017020 con 0x7efe48003a00 2024-04-19T23:45:15.233 INFO:teuthology.orchestra.run.smithi076.stdout:38654705669 2024-04-19T23:45:15.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.235+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2911109235 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efe3c037740 msgr2=0x7efe3c039c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.235+0000 7efe5ef8d700 1 --2- 172.21.15.76:0/2911109235 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efe3c037740 0x7efe3c039c00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efe44009750 tx=0x7efe44008040 comp rx=0 tx=0).stop 2024-04-19T23:45:15.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.235+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2911109235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 msgr2=0x7efe58095bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.235+0000 7efe5ef8d700 1 --2- 172.21.15.76:0/2911109235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 0x7efe58095bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efe4c011000 tx=0x7efe4c001860 comp rx=0 tx=0).stop 2024-04-19T23:45:15.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.236+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2911109235 shutdown_connections 2024-04-19T23:45:15.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.236+0000 7efe5ef8d700 1 --2- 172.21.15.76:0/2911109235 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efe3c037740 0x7efe3c039c00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.236+0000 7efe5ef8d700 1 --2- 172.21.15.76:0/2911109235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe48003a00 0x7efe58095bf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.236+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2911109235 >> 172.21.15.76:0/2911109235 conn(0x7efe5809e0e0 msgr2=0x7efe580926b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.236+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2911109235 shutdown_connections 2024-04-19T23:45:15.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.236+0000 7efe5ef8d700 1 -- 172.21.15.76:0/2911109235 wait complete. 2024-04-19T23:45:15.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-04-19T23:45:15.247 DEBUG:teuthology.parallel:result is None 2024-04-19T23:45:15.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.260+0000 7f4e588ee700 1 -- 172.21.15.76:0/2127042546 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e54062510 con 0x7f4e5412a710 2024-04-19T23:45:15.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.260+0000 7f4e42ffd700 1 -- 172.21.15.76:0/2127042546 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e44018b10 con 0x7f4e5412a710 2024-04-19T23:45:15.259 INFO:teuthology.orchestra.run.smithi076.stdout:42949672965 2024-04-19T23:45:15.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.262+0000 7f4e588ee700 1 -- 172.21.15.76:0/2127042546 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f4e340377e0 msgr2=0x7f4e34039ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.262+0000 7f4e588ee700 1 --2- 172.21.15.76:0/2127042546 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f4e340377e0 0x7f4e34039ca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4e48000c00 tx=0x7f4e48008030 comp rx=0 tx=0).stop 2024-04-19T23:45:15.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.262+0000 7f4e588ee700 1 -- 172.21.15.76:0/2127042546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4e5412a710 msgr2=0x7f4e54124300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.262+0000 7f4e588ee700 1 --2- 172.21.15.76:0/2127042546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4e5412a710 0x7f4e54124300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400b420 tx=0x7f4e4400b7e0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.262+0000 7f4e588ee700 1 -- 172.21.15.76:0/2127042546 shutdown_connections 2024-04-19T23:45:15.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.262+0000 7f4e588ee700 1 --2- 172.21.15.76:0/2127042546 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f4e340377e0 0x7f4e34039ca0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.262+0000 7f4e588ee700 1 --2- 172.21.15.76:0/2127042546 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4e5412a710 0x7f4e54124300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.262+0000 7f4e588ee700 1 -- 172.21.15.76:0/2127042546 >> 172.21.15.76:0/2127042546 conn(0x7f4e5409d020 msgr2=0x7f4e541b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.262+0000 7f4e588ee700 1 -- 172.21.15.76:0/2127042546 shutdown_connections 2024-04-19T23:45:15.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.262+0000 7f4e588ee700 1 -- 172.21.15.76:0/2127042546 wait complete. 2024-04-19T23:45:15.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672965 for osd.1 2024-04-19T23:45:15.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.274+0000 7f248d066700 1 -- 172.21.15.76:0/3966116989 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f24880975d0 con 0x7f248806ab70 2024-04-19T23:45:15.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.274+0000 7f246f7fe700 1 -- 172.21.15.76:0/3966116989 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2478011e80 con 0x7f248806ab70 2024-04-19T23:45:15.274 DEBUG:teuthology.parallel:result is None 2024-04-19T23:45:15.274 INFO:teuthology.orchestra.run.smithi076.stdout:42949672965 2024-04-19T23:45:15.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.276+0000 7f248d066700 1 -- 172.21.15.76:0/3966116989 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2474037790 msgr2=0x7f2474039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.276+0000 7f248d066700 1 --2- 172.21.15.76:0/3966116989 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2474037790 0x7f2474039c50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f247c009b10 tx=0x7f247c008000 comp rx=0 tx=0).stop 2024-04-19T23:45:15.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.276+0000 7f248d066700 1 -- 172.21.15.76:0/3966116989 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f248806ab70 msgr2=0x7f248806f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.276+0000 7f248d066700 1 --2- 172.21.15.76:0/3966116989 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f248806ab70 0x7f248806f4b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f247800c700 tx=0x7f247800cac0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.276+0000 7f248d066700 1 -- 172.21.15.76:0/3966116989 shutdown_connections 2024-04-19T23:45:15.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.276+0000 7f248d066700 1 --2- 172.21.15.76:0/3966116989 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f2474037790 0x7f2474039c50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.276+0000 7f248d066700 1 --2- 172.21.15.76:0/3966116989 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f248806ab70 0x7f248806f4b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.276+0000 7f248d066700 1 -- 172.21.15.76:0/3966116989 >> 172.21.15.76:0/3966116989 conn(0x7f248809a870 msgr2=0x7f24881b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.276+0000 7f248d066700 1 -- 172.21.15.76:0/3966116989 shutdown_connections 2024-04-19T23:45:15.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.276+0000 7f248d066700 1 -- 172.21.15.76:0/3966116989 wait complete. 2024-04-19T23:45:15.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.286+0000 7f8eaface700 1 -- 172.21.15.76:0/3477145962 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ea8062510 con 0x7f8ea8095960 2024-04-19T23:45:15.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.286+0000 7f8e9e7fc700 1 -- 172.21.15.76:0/3477145962 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ea40183a0 con 0x7f8ea8095960 2024-04-19T23:45:15.285 INFO:teuthology.orchestra.run.smithi076.stdout:42949672965 2024-04-19T23:45:15.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672965 for osd.2 2024-04-19T23:45:15.288 DEBUG:teuthology.parallel:result is None 2024-04-19T23:45:15.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.289+0000 7f8eaface700 1 -- 172.21.15.76:0/3477145962 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f8e8c0377d0 msgr2=0x7f8e8c039c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.289+0000 7f8eaface700 1 --2- 172.21.15.76:0/3477145962 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f8e8c0377d0 0x7f8e8c039c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8e980016b0 tx=0x7f8e980079c0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.289+0000 7f8eaface700 1 -- 172.21.15.76:0/3477145962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea8095960 msgr2=0x7f8ea81218d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.289+0000 7f8eaface700 1 --2- 172.21.15.76:0/3477145962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea8095960 0x7f8ea81218d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009bc0 tx=0x7f8ea4004750 comp rx=0 tx=0).stop 2024-04-19T23:45:15.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.289+0000 7f8eaface700 1 -- 172.21.15.76:0/3477145962 shutdown_connections 2024-04-19T23:45:15.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.289+0000 7f8eaface700 1 --2- 172.21.15.76:0/3477145962 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f8e8c0377d0 0x7f8e8c039c90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.289+0000 7f8eaface700 1 --2- 172.21.15.76:0/3477145962 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8ea8095960 0x7f8ea81218d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.289+0000 7f8eaface700 1 -- 172.21.15.76:0/3477145962 >> 172.21.15.76:0/3477145962 conn(0x7f8ea809a870 msgr2=0x7f8ea812a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.289+0000 7f8eaface700 1 -- 172.21.15.76:0/3477145962 shutdown_connections 2024-04-19T23:45:15.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.289+0000 7f8eaface700 1 -- 172.21.15.76:0/3477145962 wait complete. 2024-04-19T23:45:15.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672965 for osd.3 2024-04-19T23:45:15.300 DEBUG:teuthology.parallel:result is None 2024-04-19T23:45:15.300 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T23:45:15.300 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T23:45:15.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.460+0000 7efbf3967700 1 Processor -- start 2024-04-19T23:45:15.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.460+0000 7efbf3967700 1 -- start start 2024-04-19T23:45:15.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbf3967700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7efbec095550 0x7efbec095930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbf3967700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbec094cd0 con 0x7efbec095e70 2024-04-19T23:45:15.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbf3967700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbec097c20 con 0x7efbec095550 2024-04-19T23:45:15.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbf1703700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7efbec095550 0x7efbec095930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbf0f02700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7efbec095e70 0x7efbec131f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:49026/0 (socket says 172.21.15.76:49026) 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbf0f02700 1 -- 172.21.15.76:0/31175577 learned_addr learned my addr 172.21.15.76:0/31175577 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbf1703700 1 -- 172.21.15.76:0/31175577 >> v1:172.21.15.76:6789/0 conn(0x7efbec095e70 legacy=0x7efbec131f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbf1703700 1 -- 172.21.15.76:0/31175577 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec09db80 con 0x7efbec095550 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbf1703700 1 --2- 172.21.15.76:0/31175577 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbec095550 0x7efbec095930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efbdc0097c0 tx=0x7efbdc009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f919d5d239eb790 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbe3fff700 1 -- 172.21.15.76:0/31175577 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbdc004160 con 0x7efbec095550 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbe3fff700 1 -- 172.21.15.76:0/31175577 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbdc0042c0 con 0x7efbec095550 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.461+0000 7efbe3fff700 1 -- 172.21.15.76:0/31175577 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbdc004580 con 0x7efbec095550 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.462+0000 7efbf3967700 1 -- 172.21.15.76:0/31175577 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbec095550 msgr2=0x7efbec095930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.462+0000 7efbf3967700 1 --2- 172.21.15.76:0/31175577 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbec095550 0x7efbec095930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efbdc0097c0 tx=0x7efbdc009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.462+0000 7efbf3967700 1 -- 172.21.15.76:0/31175577 shutdown_connections 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.462+0000 7efbf3967700 1 --2- 172.21.15.76:0/31175577 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbec095550 0x7efbec095930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.462+0000 7efbf3967700 1 -- 172.21.15.76:0/31175577 >> 172.21.15.76:0/31175577 conn(0x7efbec09be70 msgr2=0x7efbec09c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.462+0000 7efbf3967700 1 -- 172.21.15.76:0/31175577 shutdown_connections 2024-04-19T23:45:15.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.462+0000 7efbf3967700 1 -- 172.21.15.76:0/31175577 wait complete. 2024-04-19T23:45:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.463+0000 7efbf3967700 1 Processor -- start 2024-04-19T23:45:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.463+0000 7efbf3967700 1 -- start start 2024-04-19T23:45:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.463+0000 7efbf3967700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbec095550 0x7efbec1a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.463+0000 7efbf3967700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbec1a9be0 con 0x7efbec095550 2024-04-19T23:45:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.463+0000 7efbf1703700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbec095550 0x7efbec1a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.463+0000 7efbf1703700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbec095550 0x7efbec1a7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49972/0 (socket says 172.21.15.76:49972) 2024-04-19T23:45:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.463+0000 7efbf1703700 1 -- 172.21.15.76:0/173585143 learned_addr learned my addr 172.21.15.76:0/173585143 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.463+0000 7efbf1703700 1 -- 172.21.15.76:0/173585143 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbdc0094a0 con 0x7efbec095550 2024-04-19T23:45:15.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.464+0000 7efbf1703700 1 --2- 172.21.15.76:0/173585143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbec095550 0x7efbec1a7b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efbec097d60 tx=0x7efbdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.464+0000 7efbe1ffb700 1 -- 172.21.15.76:0/173585143 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbdc003df0 con 0x7efbec095550 2024-04-19T23:45:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.464+0000 7efbe1ffb700 1 -- 172.21.15.76:0/173585143 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbdc01e070 con 0x7efbec095550 2024-04-19T23:45:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.464+0000 7efbe1ffb700 1 -- 172.21.15.76:0/173585143 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbdc011780 con 0x7efbec095550 2024-04-19T23:45:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.464+0000 7efbf3967700 1 -- 172.21.15.76:0/173585143 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbec1a9ef0 con 0x7efbec095550 2024-04-19T23:45:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.464+0000 7efbf3967700 1 -- 172.21.15.76:0/173585143 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbec093c80 con 0x7efbec095550 2024-04-19T23:45:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.465+0000 7efbe1ffb700 1 -- 172.21.15.76:0/173585143 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7efbdc0118e0 con 0x7efbec095550 2024-04-19T23:45:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.465+0000 7efbe1ffb700 1 --2- 172.21.15.76:0/173585143 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efbd0037780 0x7efbd0039c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.465+0000 7efbf3967700 1 -- 172.21.15.76:0/173585143 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbec062510 con 0x7efbec095550 2024-04-19T23:45:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.465+0000 7efbe1ffb700 1 -- 172.21.15.76:0/173585143 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7efbdc04b320 con 0x7efbec095550 2024-04-19T23:45:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.465+0000 7efbf0f02700 1 --2- 172.21.15.76:0/173585143 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efbd0037780 0x7efbd0039c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.466+0000 7efbf0f02700 1 --2- 172.21.15.76:0/173585143 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efbd0037780 0x7efbd0039c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efbe8000f60 tx=0x7efbe8007b10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.470+0000 7efbe1ffb700 1 -- 172.21.15.76:0/173585143 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7efbdc0109d0 con 0x7efbec095550 2024-04-19T23:45:15.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.658+0000 7efbf3967700 1 -- 172.21.15.76:0/173585143 --> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efbec1aa080 con 0x7efbd0037780 2024-04-19T23:45:15.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.659+0000 7efbe1ffb700 1 -- 172.21.15.76:0/173585143 <== mgr.4101 v2:172.21.15.155:6824/41459 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34562 (secure 0 0 0) 0x7efbe8001370 con 0x7efbd0037780 2024-04-19T23:45:15.659 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:45:15.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.662+0000 7efbf3967700 1 -- 172.21.15.76:0/173585143 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efbd0037780 msgr2=0x7efbd0039c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.662+0000 7efbf3967700 1 --2- 172.21.15.76:0/173585143 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efbd0037780 0x7efbd0039c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efbe8000f60 tx=0x7efbe8007b10 comp rx=0 tx=0).stop 2024-04-19T23:45:15.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.662+0000 7efbf3967700 1 -- 172.21.15.76:0/173585143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbec095550 msgr2=0x7efbec1a7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.662+0000 7efbf3967700 1 --2- 172.21.15.76:0/173585143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbec095550 0x7efbec1a7b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efbec097d60 tx=0x7efbdc004750 comp rx=0 tx=0).stop 2024-04-19T23:45:15.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.662+0000 7efbf3967700 1 -- 172.21.15.76:0/173585143 shutdown_connections 2024-04-19T23:45:15.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.662+0000 7efbf3967700 1 --2- 172.21.15.76:0/173585143 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7efbd0037780 0x7efbd0039c40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.662+0000 7efbf3967700 1 --2- 172.21.15.76:0/173585143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbec095550 0x7efbec1a7b60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.662+0000 7efbf3967700 1 -- 172.21.15.76:0/173585143 >> 172.21.15.76:0/173585143 conn(0x7efbec09be70 msgr2=0x7efbec071060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.662+0000 7efbf3967700 1 -- 172.21.15.76:0/173585143 shutdown_connections 2024-04-19T23:45:15.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.662+0000 7efbf3967700 1 -- 172.21.15.76:0/173585143 wait complete. 2024-04-19T23:45:15.662 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-04-19T23:45:15.672 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-19T23:45:15.151917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":113896,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":112121,"kb_avail":377373464,"statfs":{"total":386547056640,"available":386430427136,"internally_reserved":0,"allocated":1753088,"data_stored":1354260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6372,"internal_metadata":114812700},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000714"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.429079+0000","last_change":"2024-04-19T23:45:12.426102+0000","last_active":"2024-04-19T23:45:12.429079+0000","last_peered":"2024-04-19T23:45:12.429079+0000","last_clean":"2024-04-19T23:45:12.429079+0000","last_became_active":"2024-04-19T23:45:12.425815+0000","last_became_peered":"2024-04-19T23:45:12.425815+0000","last_unstale":"2024-04-19T23:45:12.429079+0000","last_undegraded":"2024-04-19T23:45:12.429079+0000","last_fullsized":"2024-04-19T23:45:12.429079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:50:28.913291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.187550+0000","last_change":"2024-04-19T23:45:12.187168+0000","last_active":"2024-04-19T23:45:12.187550+0000","last_peered":"2024-04-19T23:45:12.187550+0000","last_clean":"2024-04-19T23:45:12.187550+0000","last_became_active":"2024-04-19T23:45:12.186906+0000","last_became_peered":"2024-04-19T23:45:12.186906+0000","last_unstale":"2024-04-19T23:45:12.187550+0000","last_undegraded":"2024-04-19T23:45:12.187550+0000","last_fullsized":"2024-04-19T23:45:12.187550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:40:21.971134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.189298+0000","last_change":"2024-04-19T23:45:12.185228+0000","last_active":"2024-04-19T23:45:12.189298+0000","last_peered":"2024-04-19T23:45:12.189298+0000","last_clean":"2024-04-19T23:45:12.189298+0000","last_became_active":"2024-04-19T23:45:12.184898+0000","last_became_peered":"2024-04-19T23:45:12.184898+0000","last_unstale":"2024-04-19T23:45:12.189298+0000","last_undegraded":"2024-04-19T23:45:12.189298+0000","last_fullsized":"2024-04-19T23:45:12.189298+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:17:56.541966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.189312+0000","last_change":"2024-04-19T23:45:12.185269+0000","last_active":"2024-04-19T23:45:12.189312+0000","last_peered":"2024-04-19T23:45:12.189312+0000","last_clean":"2024-04-19T23:45:12.189312+0000","last_became_active":"2024-04-19T23:45:12.184955+0000","last_became_peered":"2024-04-19T23:45:12.184955+0000","last_unstale":"2024-04-19T23:45:12.189312+0000","last_undegraded":"2024-04-19T23:45:12.189312+0000","last_fullsized":"2024-04-19T23:45:12.189312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:41:37.765452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":163,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.423878+0000","last_change":"2024-04-19T23:45:07.365909+0000","last_active":"2024-04-19T23:45:12.423878+0000","last_peered":"2024-04-19T23:45:12.423878+0000","last_clean":"2024-04-19T23:45:12.423878+0000","last_became_active":"2024-04-19T23:45:07.364767+0000","last_became_peered":"2024-04-19T23:45:07.364767+0000","last_unstale":"2024-04-19T23:45:12.423878+0000","last_undegraded":"2024-04-19T23:45:12.423878+0000","last_fullsized":"2024-04-19T23:45:12.423878+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:06.159943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:06.159943+0000","last_clean_scrub_stamp":"2024-04-19T23:45:06.159943+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:20:23.283278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.191868+0000","last_change":"2024-04-19T23:45:12.187161+0000","last_active":"2024-04-19T23:45:12.191868+0000","last_peered":"2024-04-19T23:45:12.191868+0000","last_clean":"2024-04-19T23:45:12.191868+0000","last_became_active":"2024-04-19T23:45:12.186869+0000","last_became_peered":"2024-04-19T23:45:12.186869+0000","last_unstale":"2024-04-19T23:45:12.191868+0000","last_undegraded":"2024-04-19T23:45:12.191868+0000","last_fullsized":"2024-04-19T23:45:12.191868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:57:54.031691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.189198+0000","last_change":"2024-04-19T23:45:12.184804+0000","last_active":"2024-04-19T23:45:12.189198+0000","last_peered":"2024-04-19T23:45:12.189198+0000","last_clean":"2024-04-19T23:45:12.189198+0000","last_became_active":"2024-04-19T23:45:12.184488+0000","last_became_peered":"2024-04-19T23:45:12.184488+0000","last_unstale":"2024-04-19T23:45:12.189198+0000","last_undegraded":"2024-04-19T23:45:12.189198+0000","last_fullsized":"2024-04-19T23:45:12.189198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:17:48.069688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.189270+0000","last_change":"2024-04-19T23:45:12.185202+0000","last_active":"2024-04-19T23:45:12.189270+0000","last_peered":"2024-04-19T23:45:12.189270+0000","last_clean":"2024-04-19T23:45:12.189270+0000","last_became_active":"2024-04-19T23:45:12.184866+0000","last_became_peered":"2024-04-19T23:45:12.184866+0000","last_unstale":"2024-04-19T23:45:12.189270+0000","last_undegraded":"2024-04-19T23:45:12.189270+0000","last_fullsized":"2024-04-19T23:45:12.189270+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:21:18.494557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.185705+0000","last_change":"2024-04-19T23:45:12.184815+0000","last_active":"2024-04-19T23:45:12.185705+0000","last_peered":"2024-04-19T23:45:12.185705+0000","last_clean":"2024-04-19T23:45:12.185705+0000","last_became_active":"2024-04-19T23:45:12.184552+0000","last_became_peered":"2024-04-19T23:45:12.184552+0000","last_unstale":"2024-04-19T23:45:12.185705+0000","last_undegraded":"2024-04-19T23:45:12.185705+0000","last_fullsized":"2024-04-19T23:45:12.185705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:22:18.616921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":42376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":632744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31252,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340588,"statfs":{"total":96636764160,"available":96604762112,"internally_reserved":0,"allocated":139264,"data_stored":42376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":636764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T23:45:15.673 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T23:45:15.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.793+0000 7f92e113e700 1 Processor -- start 2024-04-19T23:45:15.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.793+0000 7f92e113e700 1 -- start start 2024-04-19T23:45:15.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.793+0000 7f92e113e700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f92dc12eb40 0x7f92dc130f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.793+0000 7f92e113e700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92dc098260 con 0x7f92dc0944c0 2024-04-19T23:45:15.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.793+0000 7f92e113e700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92dc06b750 con 0x7f92dc12eb40 2024-04-19T23:45:15.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.793+0000 7f92da59c700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f92dc12eb40 0x7f92dc130f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.793+0000 7f92dad9d700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f92dc0944c0 0x7f92dc0948a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:49032/0 (socket says 172.21.15.76:49032) 2024-04-19T23:45:15.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.793+0000 7f92dad9d700 1 -- 172.21.15.76:0/3056822383 learned_addr learned my addr 172.21.15.76:0/3056822383 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:15.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92da59c700 1 -- 172.21.15.76:0/3056822383 >> v1:172.21.15.76:6789/0 conn(0x7f92dc0944c0 legacy=0x7f92dc0948a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92da59c700 1 -- 172.21.15.76:0/3056822383 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc09b170 con 0x7f92dc12eb40 2024-04-19T23:45:15.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92da59c700 1 --2- 172.21.15.76:0/3056822383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92dc12eb40 0x7f92dc130f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0097c0 tx=0x7f92cc009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988441e743f6eb68 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92d9d9b700 1 -- 172.21.15.76:0/3056822383 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92cc004160 con 0x7f92dc12eb40 2024-04-19T23:45:15.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92d9d9b700 1 -- 172.21.15.76:0/3056822383 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc0042c0 con 0x7f92dc12eb40 2024-04-19T23:45:15.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92d9d9b700 1 -- 172.21.15.76:0/3056822383 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92cc004580 con 0x7f92dc12eb40 2024-04-19T23:45:15.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92e113e700 1 -- 172.21.15.76:0/3056822383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92dc12eb40 msgr2=0x7f92dc130f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92e113e700 1 --2- 172.21.15.76:0/3056822383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92dc12eb40 0x7f92dc130f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0097c0 tx=0x7f92cc009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92e113e700 1 -- 172.21.15.76:0/3056822383 shutdown_connections 2024-04-19T23:45:15.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92e113e700 1 --2- 172.21.15.76:0/3056822383 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92dc12eb40 0x7f92dc130f30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92e113e700 1 -- 172.21.15.76:0/3056822383 >> 172.21.15.76:0/3056822383 conn(0x7f92dc09e350 msgr2=0x7f92dc09a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.794+0000 7f92e113e700 1 -- 172.21.15.76:0/3056822383 shutdown_connections 2024-04-19T23:45:15.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.795+0000 7f92e113e700 1 -- 172.21.15.76:0/3056822383 wait complete. 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.796+0000 7f92e113e700 1 Processor -- start 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.796+0000 7f92e113e700 1 -- start start 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.796+0000 7f92e113e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92dc0944c0 0x7f92dc06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.796+0000 7f92e113e700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc12bfa0 con 0x7f92dc0944c0 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.797+0000 7f92dad9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92dc0944c0 0x7f92dc06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.797+0000 7f92dad9d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92dc0944c0 0x7f92dc06ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:49990/0 (socket says 172.21.15.76:49990) 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.797+0000 7f92dad9d700 1 -- 172.21.15.76:0/2814206475 learned_addr learned my addr 172.21.15.76:0/2814206475 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.797+0000 7f92dad9d700 1 -- 172.21.15.76:0/2814206475 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc0094a0 con 0x7f92dc0944c0 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.797+0000 7f92dad9d700 1 --2- 172.21.15.76:0/2814206475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92dc0944c0 0x7f92dc06ddb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c410 tx=0x7f92d000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.797+0000 7f92c37fe700 1 -- 172.21.15.76:0/2814206475 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92d0005ca0 con 0x7f92dc0944c0 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.797+0000 7f92c37fe700 1 -- 172.21.15.76:0/2814206475 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d0005e00 con 0x7f92dc0944c0 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.797+0000 7f92e113e700 1 -- 172.21.15.76:0/2814206475 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc12c860 con 0x7f92dc0944c0 2024-04-19T23:45:15.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.797+0000 7f92c37fe700 1 -- 172.21.15.76:0/2814206475 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92d00049c0 con 0x7f92dc0944c0 2024-04-19T23:45:15.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.797+0000 7f92e113e700 1 -- 172.21.15.76:0/2814206475 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc12d2c0 con 0x7f92dc0944c0 2024-04-19T23:45:15.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.798+0000 7f92c37fe700 1 -- 172.21.15.76:0/2814206475 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f92d0004bf0 con 0x7f92dc0944c0 2024-04-19T23:45:15.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.798+0000 7f92e113e700 1 -- 172.21.15.76:0/2814206475 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92dc096940 con 0x7f92dc0944c0 2024-04-19T23:45:15.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.798+0000 7f92c37fe700 1 --2- 172.21.15.76:0/2814206475 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f92c8037740 0x7f92c8039c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:15.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.798+0000 7f92c37fe700 1 -- 172.21.15.76:0/2814206475 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f92d0049960 con 0x7f92dc0944c0 2024-04-19T23:45:15.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.799+0000 7f92da59c700 1 --2- 172.21.15.76:0/2814206475 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f92c8037740 0x7f92c8039c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:15.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.799+0000 7f92da59c700 1 --2- 172.21.15.76:0/2814206475 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f92c8037740 0x7f92c8039c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0090b0 tx=0x7f92cc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:15.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.803+0000 7f92c37fe700 1 -- 172.21.15.76:0/2814206475 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f92d0011810 con 0x7f92dc0944c0 2024-04-19T23:45:15.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.987+0000 7f92e113e700 1 -- 172.21.15.76:0/2814206475 --> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92dc12c670 con 0x7f92c8037740 2024-04-19T23:45:15.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.989+0000 7f92c37fe700 1 -- 172.21.15.76:0/2814206475 <== mgr.4101 v2:172.21.15.155:6824/41459 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34562 (secure 0 0 0) 0x7f92dc12c670 con 0x7f92c8037740 2024-04-19T23:45:15.988 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:45:15.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.991+0000 7f92e113e700 1 -- 172.21.15.76:0/2814206475 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f92c8037740 msgr2=0x7f92c8039c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.991+0000 7f92e113e700 1 --2- 172.21.15.76:0/2814206475 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f92c8037740 0x7f92c8039c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0090b0 tx=0x7f92cc008030 comp rx=0 tx=0).stop 2024-04-19T23:45:15.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.991+0000 7f92e113e700 1 -- 172.21.15.76:0/2814206475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92dc0944c0 msgr2=0x7f92dc06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:15.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.991+0000 7f92e113e700 1 --2- 172.21.15.76:0/2814206475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92dc0944c0 0x7f92dc06ddb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c410 tx=0x7f92d000c7d0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.991+0000 7f92e113e700 1 -- 172.21.15.76:0/2814206475 shutdown_connections 2024-04-19T23:45:15.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.991+0000 7f92e113e700 1 --2- 172.21.15.76:0/2814206475 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f92c8037740 0x7f92c8039c00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.991+0000 7f92e113e700 1 --2- 172.21.15.76:0/2814206475 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92dc0944c0 0x7f92dc06ddb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:15.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.991+0000 7f92e113e700 1 -- 172.21.15.76:0/2814206475 >> 172.21.15.76:0/2814206475 conn(0x7f92dc09e350 msgr2=0x7f92dc130280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:15.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.991+0000 7f92e113e700 1 -- 172.21.15.76:0/2814206475 shutdown_connections 2024-04-19T23:45:15.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:15.991+0000 7f92e113e700 1 -- 172.21.15.76:0/2814206475 wait complete. 2024-04-19T23:45:15.991 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-04-19T23:45:16.002 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-19T23:45:15.151917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":113896,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":112121,"kb_avail":377373464,"statfs":{"total":386547056640,"available":386430427136,"internally_reserved":0,"allocated":1753088,"data_stored":1354260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6372,"internal_metadata":114812700},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000714"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.429079+0000","last_change":"2024-04-19T23:45:12.426102+0000","last_active":"2024-04-19T23:45:12.429079+0000","last_peered":"2024-04-19T23:45:12.429079+0000","last_clean":"2024-04-19T23:45:12.429079+0000","last_became_active":"2024-04-19T23:45:12.425815+0000","last_became_peered":"2024-04-19T23:45:12.425815+0000","last_unstale":"2024-04-19T23:45:12.429079+0000","last_undegraded":"2024-04-19T23:45:12.429079+0000","last_fullsized":"2024-04-19T23:45:12.429079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T01:50:28.913291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.187550+0000","last_change":"2024-04-19T23:45:12.187168+0000","last_active":"2024-04-19T23:45:12.187550+0000","last_peered":"2024-04-19T23:45:12.187550+0000","last_clean":"2024-04-19T23:45:12.187550+0000","last_became_active":"2024-04-19T23:45:12.186906+0000","last_became_peered":"2024-04-19T23:45:12.186906+0000","last_unstale":"2024-04-19T23:45:12.187550+0000","last_undegraded":"2024-04-19T23:45:12.187550+0000","last_fullsized":"2024-04-19T23:45:12.187550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:40:21.971134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.189298+0000","last_change":"2024-04-19T23:45:12.185228+0000","last_active":"2024-04-19T23:45:12.189298+0000","last_peered":"2024-04-19T23:45:12.189298+0000","last_clean":"2024-04-19T23:45:12.189298+0000","last_became_active":"2024-04-19T23:45:12.184898+0000","last_became_peered":"2024-04-19T23:45:12.184898+0000","last_unstale":"2024-04-19T23:45:12.189298+0000","last_undegraded":"2024-04-19T23:45:12.189298+0000","last_fullsized":"2024-04-19T23:45:12.189298+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:17:56.541966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.189312+0000","last_change":"2024-04-19T23:45:12.185269+0000","last_active":"2024-04-19T23:45:12.189312+0000","last_peered":"2024-04-19T23:45:12.189312+0000","last_clean":"2024-04-19T23:45:12.189312+0000","last_became_active":"2024-04-19T23:45:12.184955+0000","last_became_peered":"2024-04-19T23:45:12.184955+0000","last_unstale":"2024-04-19T23:45:12.189312+0000","last_undegraded":"2024-04-19T23:45:12.189312+0000","last_fullsized":"2024-04-19T23:45:12.189312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:41:37.765452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":163,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.423878+0000","last_change":"2024-04-19T23:45:07.365909+0000","last_active":"2024-04-19T23:45:12.423878+0000","last_peered":"2024-04-19T23:45:12.423878+0000","last_clean":"2024-04-19T23:45:12.423878+0000","last_became_active":"2024-04-19T23:45:07.364767+0000","last_became_peered":"2024-04-19T23:45:07.364767+0000","last_unstale":"2024-04-19T23:45:12.423878+0000","last_undegraded":"2024-04-19T23:45:12.423878+0000","last_fullsized":"2024-04-19T23:45:12.423878+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:06.159943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:06.159943+0000","last_clean_scrub_stamp":"2024-04-19T23:45:06.159943+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:20:23.283278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.191868+0000","last_change":"2024-04-19T23:45:12.187161+0000","last_active":"2024-04-19T23:45:12.191868+0000","last_peered":"2024-04-19T23:45:12.191868+0000","last_clean":"2024-04-19T23:45:12.191868+0000","last_became_active":"2024-04-19T23:45:12.186869+0000","last_became_peered":"2024-04-19T23:45:12.186869+0000","last_unstale":"2024-04-19T23:45:12.191868+0000","last_undegraded":"2024-04-19T23:45:12.191868+0000","last_fullsized":"2024-04-19T23:45:12.191868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:57:54.031691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.189198+0000","last_change":"2024-04-19T23:45:12.184804+0000","last_active":"2024-04-19T23:45:12.189198+0000","last_peered":"2024-04-19T23:45:12.189198+0000","last_clean":"2024-04-19T23:45:12.189198+0000","last_became_active":"2024-04-19T23:45:12.184488+0000","last_became_peered":"2024-04-19T23:45:12.184488+0000","last_unstale":"2024-04-19T23:45:12.189198+0000","last_undegraded":"2024-04-19T23:45:12.189198+0000","last_fullsized":"2024-04-19T23:45:12.189198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:17:48.069688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.189270+0000","last_change":"2024-04-19T23:45:12.185202+0000","last_active":"2024-04-19T23:45:12.189270+0000","last_peered":"2024-04-19T23:45:12.189270+0000","last_clean":"2024-04-19T23:45:12.189270+0000","last_became_active":"2024-04-19T23:45:12.184866+0000","last_became_peered":"2024-04-19T23:45:12.184866+0000","last_unstale":"2024-04-19T23:45:12.189270+0000","last_undegraded":"2024-04-19T23:45:12.189270+0000","last_fullsized":"2024-04-19T23:45:12.189270+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:21:18.494557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T23:45:12.185705+0000","last_change":"2024-04-19T23:45:12.184815+0000","last_active":"2024-04-19T23:45:12.185705+0000","last_peered":"2024-04-19T23:45:12.185705+0000","last_clean":"2024-04-19T23:45:12.185705+0000","last_became_active":"2024-04-19T23:45:12.184552+0000","last_became_peered":"2024-04-19T23:45:12.184552+0000","last_unstale":"2024-04-19T23:45:12.185705+0000","last_undegraded":"2024-04-19T23:45:12.185705+0000","last_fullsized":"2024-04-19T23:45:12.185705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T23:45:11.176514+0000","last_clean_scrub_stamp":"2024-04-19T23:45:11.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:22:18.616921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":42376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":632744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31252,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340588,"statfs":{"total":96636764160,"available":96604762112,"internally_reserved":0,"allocated":139264,"data_stored":42376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":636764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T23:45:16.003 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T23:45:16.003 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-19T23:45:16.003 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-19T23:45:16.004 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-19T23:45:16.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.123+0000 7f54ab266700 1 Processor -- start 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.123+0000 7f54ab266700 1 -- start start 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.123+0000 7f54ab266700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f54a412b200 0x7f54a412fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.123+0000 7f54ab266700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a40970b0 con 0x7f54a412a710 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.123+0000 7f54ab266700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a409db40 con 0x7f54a412b200 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.124+0000 7f54a8801700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f54a412b200 0x7f54a412fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.124+0000 7f54a9002700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f54a412a710 0x7f54a412aaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:49034/0 (socket says 172.21.15.76:49034) 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.124+0000 7f54a9002700 1 -- 172.21.15.76:0/2080249852 learned_addr learned my addr 172.21.15.76:0/2080249852 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.124+0000 7f54a8801700 1 -- 172.21.15.76:0/2080249852 >> v1:172.21.15.76:6789/0 conn(0x7f54a412a710 legacy=0x7f54a412aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.124+0000 7f54a8801700 1 -- 172.21.15.76:0/2080249852 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a4096960 con 0x7f54a412b200 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.124+0000 7f549bfff700 1 -- 172.21.15.76:0/2080249852 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611811409 0 0) 0x7f54a40970b0 con 0x7f54a412a710 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.124+0000 7f54a8801700 1 --2- 172.21.15.76:0/2080249852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54a412b200 0x7f54a412fa30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f54a00097c0 tx=0x7f54a0009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89371f0fded682eb server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.124+0000 7f549bfff700 1 -- 172.21.15.76:0/2080249852 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a0004160 con 0x7f54a412b200 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.124+0000 7f549bfff700 1 -- 172.21.15.76:0/2080249852 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a00042c0 con 0x7f54a412b200 2024-04-19T23:45:16.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.124+0000 7f549bfff700 1 -- 172.21.15.76:0/2080249852 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54a0004580 con 0x7f54a412b200 2024-04-19T23:45:16.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.125+0000 7f54ab266700 1 -- 172.21.15.76:0/2080249852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54a412b200 msgr2=0x7f54a412fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:16.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.125+0000 7f54ab266700 1 --2- 172.21.15.76:0/2080249852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54a412b200 0x7f54a412fa30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f54a00097c0 tx=0x7f54a0009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:16.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.125+0000 7f54ab266700 1 -- 172.21.15.76:0/2080249852 shutdown_connections 2024-04-19T23:45:16.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.125+0000 7f54ab266700 1 --2- 172.21.15.76:0/2080249852 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54a412b200 0x7f54a412fa30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:16.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.125+0000 7f54ab266700 1 -- 172.21.15.76:0/2080249852 >> 172.21.15.76:0/2080249852 conn(0x7f54a409d020 msgr2=0x7f54a409d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:16.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.125+0000 7f54ab266700 1 -- 172.21.15.76:0/2080249852 shutdown_connections 2024-04-19T23:45:16.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.125+0000 7f54ab266700 1 -- 172.21.15.76:0/2080249852 wait complete. 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.126+0000 7f54ab266700 1 Processor -- start 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.126+0000 7f54ab266700 1 -- start start 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.126+0000 7f54ab266700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54a412a710 0x7f54a412e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.126+0000 7f54ab266700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a406f030 con 0x7f54a412a710 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.126+0000 7f54a9002700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54a412a710 0x7f54a412e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.126+0000 7f54a9002700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54a412a710 0x7f54a412e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50008/0 (socket says 172.21.15.76:50008) 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.126+0000 7f54a9002700 1 -- 172.21.15.76:0/333760930 learned_addr learned my addr 172.21.15.76:0/333760930 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.127+0000 7f54a9002700 1 -- 172.21.15.76:0/333760930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a00094a0 con 0x7f54a412a710 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.127+0000 7f54a9002700 1 --2- 172.21.15.76:0/333760930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54a412a710 0x7f54a412e210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f549400c4a0 tx=0x7f549400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.127+0000 7f5499ffb700 1 -- 172.21.15.76:0/333760930 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5494004bb0 con 0x7f54a412a710 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.127+0000 7f5499ffb700 1 -- 172.21.15.76:0/333760930 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5494004d50 con 0x7f54a412a710 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.127+0000 7f54ab266700 1 -- 172.21.15.76:0/333760930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a4072730 con 0x7f54a412a710 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.127+0000 7f5499ffb700 1 -- 172.21.15.76:0/333760930 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54940070d0 con 0x7f54a412a710 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.127+0000 7f54ab266700 1 -- 172.21.15.76:0/333760930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a406fea0 con 0x7f54a412a710 2024-04-19T23:45:16.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.128+0000 7f5499ffb700 1 -- 172.21.15.76:0/333760930 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f54940072c0 con 0x7f54a412a710 2024-04-19T23:45:16.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.128+0000 7f54ab266700 1 -- 172.21.15.76:0/333760930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a412f7d0 con 0x7f54a412a710 2024-04-19T23:45:16.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.128+0000 7f5499ffb700 1 --2- 172.21.15.76:0/333760930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f5488037790 0x7f5488039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:16.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.128+0000 7f5499ffb700 1 -- 172.21.15.76:0/333760930 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f5494049cb0 con 0x7f54a412a710 2024-04-19T23:45:16.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.128+0000 7f54a8801700 1 --2- 172.21.15.76:0/333760930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f5488037790 0x7f5488039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:16.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.129+0000 7f54a8801700 1 --2- 172.21.15.76:0/333760930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f5488037790 0x7f5488039c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54a00090b0 tx=0x7f54a0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:16.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.133+0000 7f5499ffb700 1 -- 172.21.15.76:0/333760930 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f54940102c0 con 0x7f54a412a710 2024-04-19T23:45:16.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.370+0000 7f54ab266700 1 -- 172.21.15.76:0/333760930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f54a406f860 con 0x7f54a412a710 2024-04-19T23:45:16.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.370+0000 7f5499ffb700 1 -- 172.21.15.76:0/333760930 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5494011360 con 0x7f54a412a710 2024-04-19T23:45:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-04-19T23:45:16.370 INFO:teuthology.orchestra.run.smithi076.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-19T23:45:16.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.372+0000 7f54ab266700 1 -- 172.21.15.76:0/333760930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f5488037790 msgr2=0x7f5488039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:16.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.372+0000 7f54ab266700 1 --2- 172.21.15.76:0/333760930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f5488037790 0x7f5488039c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54a00090b0 tx=0x7f54a0008030 comp rx=0 tx=0).stop 2024-04-19T23:45:16.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.372+0000 7f54ab266700 1 -- 172.21.15.76:0/333760930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54a412a710 msgr2=0x7f54a412e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:16.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.372+0000 7f54ab266700 1 --2- 172.21.15.76:0/333760930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54a412a710 0x7f54a412e210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f549400c4a0 tx=0x7f549400c860 comp rx=0 tx=0).stop 2024-04-19T23:45:16.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.372+0000 7f54ab266700 1 -- 172.21.15.76:0/333760930 shutdown_connections 2024-04-19T23:45:16.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.372+0000 7f54ab266700 1 --2- 172.21.15.76:0/333760930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f5488037790 0x7f5488039c50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:16.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.372+0000 7f54ab266700 1 --2- 172.21.15.76:0/333760930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f54a412a710 0x7f54a412e210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:16.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.372+0000 7f54ab266700 1 -- 172.21.15.76:0/333760930 >> 172.21.15.76:0/333760930 conn(0x7f54a409d020 msgr2=0x7f54a4098310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:16.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.372+0000 7f54ab266700 1 -- 172.21.15.76:0/333760930 shutdown_connections 2024-04-19T23:45:16.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:45:16.372+0000 7f54ab266700 1 -- 172.21.15.76:0/333760930 wait complete. 2024-04-19T23:45:16.383 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-19T23:45:16.383 INFO:teuthology.run_tasks:Running task rgw... 2024-04-19T23:45:16.398 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-19T23:45:16.398 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-19T23:45:16.398 INFO:tasks.rgw:Creating data pools 2024-04-19T23:45:16.398 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-19T23:45:16.398 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-04-19T23:45:16.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.532+0000 7f3806168700 1 Processor -- start 2024-04-19T23:45:16.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.533+0000 7f3806168700 1 -- start start 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.533+0000 7f3806168700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f3800116c00 0x7f3800118ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.533+0000 7f3806168700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38001195c0 con 0x7f3800113ea0 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.533+0000 7f3806168700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380011a760 con 0x7f3800116c00 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.533+0000 7f37feffd700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f3800116c00 0x7f3800118ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.533+0000 7f37ff7fe700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f3800113ea0 0x7f3800114280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:37164/0 (socket says 172.21.15.155:37164) 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.533+0000 7f37ff7fe700 1 -- 172.21.15.155:0/482198438 learned_addr learned my addr 172.21.15.155:0/482198438 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.533+0000 7f37feffd700 1 -- 172.21.15.155:0/482198438 >> v1:172.21.15.76:6789/0 conn(0x7f3800113ea0 legacy=0x7f3800114280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.533+0000 7f37feffd700 1 -- 172.21.15.155:0/482198438 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380011a8a0 con 0x7f3800116c00 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.534+0000 7f37feffd700 1 --2- 172.21.15.155:0/482198438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3800116c00 0x7f3800118ff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f37f40097c0 tx=0x7f37f4009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f899e1ef9b1caede server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.534+0000 7f37fe7fc700 1 -- 172.21.15.155:0/482198438 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37f4004160 con 0x7f3800116c00 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.534+0000 7f37fe7fc700 1 -- 172.21.15.155:0/482198438 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40042c0 con 0x7f3800116c00 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.534+0000 7f37fe7fc700 1 -- 172.21.15.155:0/482198438 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37f4004580 con 0x7f3800116c00 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.534+0000 7f3806168700 1 -- 172.21.15.155:0/482198438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3800116c00 msgr2=0x7f3800118ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.534+0000 7f3806168700 1 --2- 172.21.15.155:0/482198438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3800116c00 0x7f3800118ff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f37f40097c0 tx=0x7f37f4009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:16.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.534+0000 7f3806168700 1 -- 172.21.15.155:0/482198438 shutdown_connections 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.534+0000 7f3806168700 1 --2- 172.21.15.155:0/482198438 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3800116c00 0x7f3800118ff0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.534+0000 7f3806168700 1 -- 172.21.15.155:0/482198438 >> 172.21.15.155:0/482198438 conn(0x7f380006f140 msgr2=0x7f3800071560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.534+0000 7f3806168700 1 -- 172.21.15.155:0/482198438 shutdown_connections 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.534+0000 7f3806168700 1 -- 172.21.15.155:0/482198438 wait complete. 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.535+0000 7f3806168700 1 Processor -- start 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.535+0000 7f3806168700 1 -- start start 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.535+0000 7f3806168700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3800113ea0 0x7f38001a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.535+0000 7f3806168700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38001a48b0 con 0x7f3800113ea0 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.536+0000 7f37ff7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3800113ea0 0x7f38001a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.536+0000 7f37ff7fe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3800113ea0 0x7f38001a42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:46722/0 (socket says 172.21.15.155:46722) 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.536+0000 7f37ff7fe700 1 -- 172.21.15.155:0/1076146443 learned_addr learned my addr 172.21.15.155:0/1076146443 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.536+0000 7f37ff7fe700 1 -- 172.21.15.155:0/1076146443 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f40094a0 con 0x7f3800113ea0 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.536+0000 7f37ff7fe700 1 --2- 172.21.15.155:0/1076146443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3800113ea0 0x7f38001a42e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f37f000c410 tx=0x7f37f000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.536+0000 7f37e7fff700 1 -- 172.21.15.155:0/1076146443 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37f0005ca0 con 0x7f3800113ea0 2024-04-19T23:45:16.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.536+0000 7f37e7fff700 1 -- 172.21.15.155:0/1076146443 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f0005e00 con 0x7f3800113ea0 2024-04-19T23:45:16.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.536+0000 7f3806168700 1 -- 172.21.15.155:0/1076146443 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38001a4a50 con 0x7f3800113ea0 2024-04-19T23:45:16.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.536+0000 7f37e7fff700 1 -- 172.21.15.155:0/1076146443 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37f00049c0 con 0x7f3800113ea0 2024-04-19T23:45:16.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.536+0000 7f3806168700 1 -- 172.21.15.155:0/1076146443 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38001a4f60 con 0x7f3800113ea0 2024-04-19T23:45:16.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.537+0000 7f37e7fff700 1 -- 172.21.15.155:0/1076146443 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f37f0004b20 con 0x7f3800113ea0 2024-04-19T23:45:16.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.537+0000 7f37e7fff700 1 --2- 172.21.15.155:0/1076146443 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f37ec037790 0x7f37ec039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:16.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.537+0000 7f37e7fff700 1 -- 172.21.15.155:0/1076146443 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f37f0049900 con 0x7f3800113ea0 2024-04-19T23:45:16.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.537+0000 7f3806168700 1 -- 172.21.15.155:0/1076146443 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38001a5150 con 0x7f3800113ea0 2024-04-19T23:45:16.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.537+0000 7f37feffd700 1 --2- 172.21.15.155:0/1076146443 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f37ec037790 0x7f37ec039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:16.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.538+0000 7f37feffd700 1 --2- 172.21.15.155:0/1076146443 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f37ec037790 0x7f37ec039c50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f37f40097c0 tx=0x7f37f4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:16.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.543+0000 7f37e7fff700 1 -- 172.21.15.155:0/1076146443 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f38001a5150 con 0x7f3800113ea0 2024-04-19T23:45:16.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:16.733+0000 7f3806168700 1 -- 172.21.15.155:0/1076146443 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f38001a5150 con 0x7f3800113ea0 2024-04-19T23:45:17.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.189+0000 7f37e7fff700 1 -- 172.21.15.155:0/1076146443 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v18) v1 ==== 167+0+0 (secure 0 0 0) 0x7f38001a5150 con 0x7f3800113ea0 2024-04-19T23:45:17.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.193+0000 7f3806168700 1 -- 172.21.15.155:0/1076146443 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f37ec037790 msgr2=0x7f37ec039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:17.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.193+0000 7f3806168700 1 --2- 172.21.15.155:0/1076146443 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f37ec037790 0x7f37ec039c50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f37f40097c0 tx=0x7f37f4008030 comp rx=0 tx=0).stop 2024-04-19T23:45:17.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.193+0000 7f3806168700 1 -- 172.21.15.155:0/1076146443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3800113ea0 msgr2=0x7f38001a42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:17.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.193+0000 7f3806168700 1 --2- 172.21.15.155:0/1076146443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3800113ea0 0x7f38001a42e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f37f000c410 tx=0x7f37f000c7d0 comp rx=0 tx=0).stop 2024-04-19T23:45:17.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.193+0000 7f3806168700 1 -- 172.21.15.155:0/1076146443 shutdown_connections 2024-04-19T23:45:17.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.193+0000 7f3806168700 1 --2- 172.21.15.155:0/1076146443 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f37ec037790 0x7f37ec039c50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:17.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.193+0000 7f3806168700 1 --2- 172.21.15.155:0/1076146443 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3800113ea0 0x7f38001a42e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:17.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.193+0000 7f3806168700 1 -- 172.21.15.155:0/1076146443 >> 172.21.15.155:0/1076146443 conn(0x7f380006f140 msgr2=0x7f3800116fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:17.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.193+0000 7f3806168700 1 -- 172.21.15.155:0/1076146443 shutdown_connections 2024-04-19T23:45:17.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.193+0000 7f3806168700 1 -- 172.21.15.155:0/1076146443 wait complete. 2024-04-19T23:45:17.196 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'default.rgw.buckets.data' created 2024-04-19T23:45:17.210 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-19T23:45:17.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.332+0000 7ff7b3c45700 1 Processor -- start 2024-04-19T23:45:17.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.332+0000 7ff7b3c45700 1 -- start start 2024-04-19T23:45:17.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.332+0000 7ff7b3c45700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff7ac117170 0x7ff7ac117550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:17.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.332+0000 7ff7b3c45700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ac117c10 con 0x7ff7ac111040 2024-04-19T23:45:17.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.332+0000 7ff7b3c45700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ac111c00 con 0x7ff7ac117170 2024-04-19T23:45:17.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.333+0000 7ff7b19e1700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff7ac117170 0x7ff7ac117550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:17.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.333+0000 7ff7b11e0700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7ff7ac111040 0x7ff7ac1114f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:37180/0 (socket says 172.21.15.155:37180) 2024-04-19T23:45:17.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.333+0000 7ff7b11e0700 1 -- 172.21.15.155:0/2911093517 learned_addr learned my addr 172.21.15.155:0/2911093517 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:17.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.333+0000 7ff7b19e1700 1 -- 172.21.15.155:0/2911093517 >> v1:172.21.15.76:6789/0 conn(0x7ff7ac111040 legacy=0x7ff7ac1114f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:17.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.333+0000 7ff7b19e1700 1 -- 172.21.15.155:0/2911093517 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac111d70 con 0x7ff7ac117170 2024-04-19T23:45:17.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.333+0000 7ff7b19e1700 1 --2- 172.21.15.155:0/2911093517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7ac117170 0x7ff7ac117550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0097c0 tx=0x7ff79c009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95e39e0ecde3d15 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:17.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.333+0000 7ff7b09df700 1 -- 172.21.15.155:0/2911093517 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff79c004160 con 0x7ff7ac117170 2024-04-19T23:45:17.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.333+0000 7ff7b09df700 1 -- 172.21.15.155:0/2911093517 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c0042c0 con 0x7ff7ac117170 2024-04-19T23:45:17.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.333+0000 7ff7b09df700 1 -- 172.21.15.155:0/2911093517 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff79c004580 con 0x7ff7ac117170 2024-04-19T23:45:17.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.334+0000 7ff7b3c45700 1 -- 172.21.15.155:0/2911093517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7ac117170 msgr2=0x7ff7ac117550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:17.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.334+0000 7ff7b3c45700 1 --2- 172.21.15.155:0/2911093517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7ac117170 0x7ff7ac117550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0097c0 tx=0x7ff79c009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:17.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.334+0000 7ff7b3c45700 1 -- 172.21.15.155:0/2911093517 shutdown_connections 2024-04-19T23:45:17.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.334+0000 7ff7b3c45700 1 --2- 172.21.15.155:0/2911093517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7ac117170 0x7ff7ac117550 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:17.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.334+0000 7ff7b3c45700 1 -- 172.21.15.155:0/2911093517 >> 172.21.15.155:0/2911093517 conn(0x7ff7ac10cf60 msgr2=0x7ff7ac10f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:17.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.334+0000 7ff7b3c45700 1 -- 172.21.15.155:0/2911093517 shutdown_connections 2024-04-19T23:45:17.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.334+0000 7ff7b3c45700 1 -- 172.21.15.155:0/2911093517 wait complete. 2024-04-19T23:45:17.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.335+0000 7ff7b3c45700 1 Processor -- start 2024-04-19T23:45:17.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.335+0000 7ff7b3c45700 1 -- start start 2024-04-19T23:45:17.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.335+0000 7ff7b3c45700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7ac111040 0x7ff7ac1ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:17.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.335+0000 7ff7b3c45700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac1aba20 con 0x7ff7ac111040 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.335+0000 7ff7b19e1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7ac111040 0x7ff7ac1ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.335+0000 7ff7b19e1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7ac111040 0x7ff7ac1ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:46746/0 (socket says 172.21.15.155:46746) 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.335+0000 7ff7b19e1700 1 -- 172.21.15.155:0/1113636927 learned_addr learned my addr 172.21.15.155:0/1113636927 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.335+0000 7ff7b19e1700 1 -- 172.21.15.155:0/1113636927 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c0094a0 con 0x7ff7ac111040 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.336+0000 7ff7b19e1700 1 --2- 172.21.15.155:0/1113636927 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7ac111040 0x7ff7ac1ab450 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff79c004000 tx=0x7ff79c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.336+0000 7ff7a27fc700 1 -- 172.21.15.155:0/1113636927 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff79c003df0 con 0x7ff7ac111040 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.336+0000 7ff7a27fc700 1 -- 172.21.15.155:0/1113636927 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c01e070 con 0x7ff7ac111040 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.336+0000 7ff7b3c45700 1 -- 172.21.15.155:0/1113636927 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ac1abbc0 con 0x7ff7ac111040 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.336+0000 7ff7a27fc700 1 -- 172.21.15.155:0/1113636927 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff79c011780 con 0x7ff7ac111040 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.336+0000 7ff7b3c45700 1 -- 172.21.15.155:0/1113636927 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac1abf90 con 0x7ff7ac111040 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.337+0000 7ff7a27fc700 1 -- 172.21.15.155:0/1113636927 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7ff79c0119b0 con 0x7ff7ac111040 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.337+0000 7ff7b3c45700 1 -- 172.21.15.155:0/1113636927 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ac04f400 con 0x7ff7ac111040 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.337+0000 7ff7a27fc700 1 --2- 172.21.15.155:0/1113636927 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7ff790037730 0x7ff790039bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:17.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.337+0000 7ff7a27fc700 1 -- 172.21.15.155:0/1113636927 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3845+0+0 (secure 0 0 0) 0x7ff79c04b590 con 0x7ff7ac111040 2024-04-19T23:45:17.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.337+0000 7ff7b11e0700 1 --2- 172.21.15.155:0/1113636927 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7ff790037730 0x7ff790039bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:17.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.337+0000 7ff7b11e0700 1 --2- 172.21.15.155:0/1113636927 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7ff790037730 0x7ff790039bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8000f60 tx=0x7ff7a8007b10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:17.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.342+0000 7ff7a27fc700 1 -- 172.21.15.155:0/1113636927 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7ff79c0109d0 con 0x7ff7ac111040 2024-04-19T23:45:17.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:17.535+0000 7ff7b3c45700 1 -- 172.21.15.155:0/1113636927 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7ff7ac117170 con 0x7ff7ac111040 2024-04-19T23:45:18.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.192+0000 7ff7a27fc700 1 -- 172.21.15.155:0/1113636927 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) v1 ==== 185+0+0 (secure 0 0 0) 0x7ff79c0107f0 con 0x7ff7ac111040 2024-04-19T23:45:18.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.198+0000 7ff7b3c45700 1 -- 172.21.15.155:0/1113636927 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7ff790037730 msgr2=0x7ff790039bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:18.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.198+0000 7ff7b3c45700 1 --2- 172.21.15.155:0/1113636927 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7ff790037730 0x7ff790039bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8000f60 tx=0x7ff7a8007b10 comp rx=0 tx=0).stop 2024-04-19T23:45:18.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.198+0000 7ff7b3c45700 1 -- 172.21.15.155:0/1113636927 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7ac111040 msgr2=0x7ff7ac1ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:18.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.198+0000 7ff7b3c45700 1 --2- 172.21.15.155:0/1113636927 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7ac111040 0x7ff7ac1ab450 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff79c004000 tx=0x7ff79c004750 comp rx=0 tx=0).stop 2024-04-19T23:45:18.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.199+0000 7ff7b3c45700 1 -- 172.21.15.155:0/1113636927 shutdown_connections 2024-04-19T23:45:18.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.199+0000 7ff7b3c45700 1 --2- 172.21.15.155:0/1113636927 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7ff790037730 0x7ff790039bf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:18.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.199+0000 7ff7b3c45700 1 --2- 172.21.15.155:0/1113636927 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff7ac111040 0x7ff7ac1ab450 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:18.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.199+0000 7ff7b3c45700 1 -- 172.21.15.155:0/1113636927 >> 172.21.15.155:0/1113636927 conn(0x7ff7ac10cf60 msgr2=0x7ff7ac11bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:18.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.202+0000 7ff7b3c45700 1 -- 172.21.15.155:0/1113636927 shutdown_connections 2024-04-19T23:45:18.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.202+0000 7ff7b3c45700 1 -- 172.21.15.155:0/1113636927 wait complete. 2024-04-19T23:45:18.208 INFO:teuthology.orchestra.run.smithi155.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-19T23:45:18.226 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-19T23:45:18.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.348+0000 7f9594ee4700 1 Processor -- start 2024-04-19T23:45:18.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.348+0000 7f9594ee4700 1 -- start start 2024-04-19T23:45:18.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.349+0000 7f9594ee4700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f9590119f00 0x7f959011c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:18.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.349+0000 7f9594ee4700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959011c8c0 con 0x7f9590117170 2024-04-19T23:45:18.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.349+0000 7f9594ee4700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959011da60 con 0x7f9590119f00 2024-04-19T23:45:18.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.349+0000 7f958dd9b700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f9590119f00 0x7f959011c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:18.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.349+0000 7f958e59c700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f9590117170 0x7f9590117550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:37186/0 (socket says 172.21.15.155:37186) 2024-04-19T23:45:18.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.349+0000 7f958dd9b700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f9590119f00 0x7f959011c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:46762/0 (socket says 172.21.15.155:46762) 2024-04-19T23:45:18.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.349+0000 7f958e59c700 1 -- 172.21.15.155:0/4222884568 learned_addr learned my addr 172.21.15.155:0/4222884568 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:18.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.350+0000 7f958dd9b700 1 -- 172.21.15.155:0/4222884568 >> v1:172.21.15.76:6789/0 conn(0x7f9590117170 legacy=0x7f9590117550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:18.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.350+0000 7f958dd9b700 1 -- 172.21.15.155:0/4222884568 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959011dbd0 con 0x7f9590119f00 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.350+0000 7f958dd9b700 1 --2- 172.21.15.155:0/4222884568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9590119f00 0x7f959011c2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f95800097c0 tx=0x7f9580009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3791fb3d43c3d494 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.350+0000 7f958d59a700 1 -- 172.21.15.155:0/4222884568 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9580004160 con 0x7f9590119f00 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.350+0000 7f958d59a700 1 -- 172.21.15.155:0/4222884568 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95800042c0 con 0x7f9590119f00 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.350+0000 7f958d59a700 1 -- 172.21.15.155:0/4222884568 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9580004580 con 0x7f9590119f00 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.350+0000 7f9594ee4700 1 -- 172.21.15.155:0/4222884568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9590119f00 msgr2=0x7f959011c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.350+0000 7f9594ee4700 1 --2- 172.21.15.155:0/4222884568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9590119f00 0x7f959011c2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f95800097c0 tx=0x7f9580009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.351+0000 7f9594ee4700 1 -- 172.21.15.155:0/4222884568 shutdown_connections 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.351+0000 7f9594ee4700 1 --2- 172.21.15.155:0/4222884568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9590119f00 0x7f959011c2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.351+0000 7f9594ee4700 1 -- 172.21.15.155:0/4222884568 >> 172.21.15.155:0/4222884568 conn(0x7f959010cf60 msgr2=0x7f959010f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.351+0000 7f9594ee4700 1 -- 172.21.15.155:0/4222884568 shutdown_connections 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.351+0000 7f9594ee4700 1 -- 172.21.15.155:0/4222884568 wait complete. 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.351+0000 7f9594ee4700 1 Processor -- start 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.351+0000 7f9594ee4700 1 -- start start 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.352+0000 7f9594ee4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9590117170 0x7f95901a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:18.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.352+0000 7f9594ee4700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95901a5f10 con 0x7f9590117170 2024-04-19T23:45:18.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.352+0000 7f958e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9590117170 0x7f95901a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:18.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.352+0000 7f958e59c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9590117170 0x7f95901a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:46766/0 (socket says 172.21.15.155:46766) 2024-04-19T23:45:18.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.352+0000 7f958e59c700 1 -- 172.21.15.155:0/3606840229 learned_addr learned my addr 172.21.15.155:0/3606840229 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.352+0000 7f958e59c700 1 -- 172.21.15.155:0/3606840229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95800094a0 con 0x7f9590117170 2024-04-19T23:45:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.352+0000 7f958e59c700 1 --2- 172.21.15.155:0/3606840229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9590117170 0x7f95901a5940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f957800c480 tx=0x7f957800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.352+0000 7f9586ffd700 1 -- 172.21.15.155:0/3606840229 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9578005ca0 con 0x7f9590117170 2024-04-19T23:45:18.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.353+0000 7f9586ffd700 1 -- 172.21.15.155:0/3606840229 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9578005e00 con 0x7f9590117170 2024-04-19T23:45:18.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.353+0000 7f9594ee4700 1 -- 172.21.15.155:0/3606840229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95901a6110 con 0x7f9590117170 2024-04-19T23:45:18.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.353+0000 7f9586ffd700 1 -- 172.21.15.155:0/3606840229 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95780049c0 con 0x7f9590117170 2024-04-19T23:45:18.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.353+0000 7f9594ee4700 1 -- 172.21.15.155:0/3606840229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95901aa1f0 con 0x7f9590117170 2024-04-19T23:45:18.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.353+0000 7f9594ee4700 1 -- 172.21.15.155:0/3606840229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959004f400 con 0x7f9590117170 2024-04-19T23:45:18.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.353+0000 7f9586ffd700 1 -- 172.21.15.155:0/3606840229 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f9578004bf0 con 0x7f9590117170 2024-04-19T23:45:18.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.354+0000 7f9586ffd700 1 --2- 172.21.15.155:0/3606840229 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f9570037740 0x7f9570039c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:18.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.354+0000 7f9586ffd700 1 -- 172.21.15.155:0/3606840229 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3856+0+0 (secure 0 0 0) 0x7f9578049980 con 0x7f9590117170 2024-04-19T23:45:18.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.354+0000 7f958dd9b700 1 --2- 172.21.15.155:0/3606840229 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f9570037740 0x7f9570039c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:18.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.354+0000 7f958dd9b700 1 --2- 172.21.15.155:0/3606840229 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f9570037740 0x7f9570039c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9590073da0 tx=0x7f9580008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:18.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.359+0000 7f9586ffd700 1 -- 172.21.15.155:0/3606840229 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f9578011810 con 0x7f9590117170 2024-04-19T23:45:18.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:18.548+0000 7f9594ee4700 1 -- 172.21.15.155:0/3606840229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f95901a6330 con 0x7f9590117170 2024-04-19T23:45:19.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.197+0000 7f9586ffd700 1 -- 172.21.15.155:0/3606840229 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9578011810 con 0x7f9590117170 2024-04-19T23:45:19.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.201+0000 7f9594ee4700 1 -- 172.21.15.155:0/3606840229 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f9570037740 msgr2=0x7f9570039c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:19.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.201+0000 7f9594ee4700 1 --2- 172.21.15.155:0/3606840229 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f9570037740 0x7f9570039c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9590073da0 tx=0x7f9580008030 comp rx=0 tx=0).stop 2024-04-19T23:45:19.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.201+0000 7f9594ee4700 1 -- 172.21.15.155:0/3606840229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9590117170 msgr2=0x7f95901a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:19.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.201+0000 7f9594ee4700 1 --2- 172.21.15.155:0/3606840229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9590117170 0x7f95901a5940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f957800c480 tx=0x7f957800c840 comp rx=0 tx=0).stop 2024-04-19T23:45:19.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.201+0000 7f9594ee4700 1 -- 172.21.15.155:0/3606840229 shutdown_connections 2024-04-19T23:45:19.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.201+0000 7f9594ee4700 1 --2- 172.21.15.155:0/3606840229 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f9570037740 0x7f9570039c00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:19.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.201+0000 7f9594ee4700 1 --2- 172.21.15.155:0/3606840229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9590117170 0x7f95901a5940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:19.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.201+0000 7f9594ee4700 1 -- 172.21.15.155:0/3606840229 >> 172.21.15.155:0/3606840229 conn(0x7f959010cf60 msgr2=0x7f959011a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:19.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.203+0000 7f9594ee4700 1 -- 172.21.15.155:0/3606840229 shutdown_connections 2024-04-19T23:45:19.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.204+0000 7f9594ee4700 1 -- 172.21.15.155:0/3606840229 wait complete. 2024-04-19T23:45:19.207 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'default.rgw.buckets.index' created 2024-04-19T23:45:19.221 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-19T23:45:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.343+0000 7f36d1925700 1 Processor -- start 2024-04-19T23:45:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.343+0000 7f36d1925700 1 -- start start 2024-04-19T23:45:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.343+0000 7f36d1925700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f36cc115030 0x7f36cc115410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.343+0000 7f36d1925700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36cc1159e0 con 0x7f36cc10d350 2024-04-19T23:45:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.343+0000 7f36d1925700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36cc10df10 con 0x7f36cc115030 2024-04-19T23:45:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.344+0000 7f36caffd700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f36cc115030 0x7f36cc115410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.344+0000 7f36ca7fc700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f36cc10d350 0x7f36cc10d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:37200/0 (socket says 172.21.15.155:37200) 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.344+0000 7f36ca7fc700 1 -- 172.21.15.155:0/1149998769 learned_addr learned my addr 172.21.15.155:0/1149998769 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.344+0000 7f36caffd700 1 --2- 172.21.15.155:0/1149998769 >> v2:172.21.15.76:3300/0 conn(0x7f36cc115030 0x7f36cc115410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:46780/0 (socket says 172.21.15.155:46780) 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.344+0000 7f36caffd700 1 -- 172.21.15.155:0/1149998769 >> v1:172.21.15.76:6789/0 conn(0x7f36cc10d350 legacy=0x7f36cc10d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.344+0000 7f36caffd700 1 -- 172.21.15.155:0/1149998769 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc10e080 con 0x7f36cc115030 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.344+0000 7f36caffd700 1 --2- 172.21.15.155:0/1149998769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36cc115030 0x7f36cc115410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f36c00097c0 tx=0x7f36c0009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac571b55642d652f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.345+0000 7f36c9ffb700 1 -- 172.21.15.155:0/1149998769 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36c0004160 con 0x7f36cc115030 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.345+0000 7f36c9ffb700 1 -- 172.21.15.155:0/1149998769 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c00042c0 con 0x7f36cc115030 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.345+0000 7f36c9ffb700 1 -- 172.21.15.155:0/1149998769 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36c0004580 con 0x7f36cc115030 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.345+0000 7f36d1925700 1 -- 172.21.15.155:0/1149998769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36cc115030 msgr2=0x7f36cc115410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.345+0000 7f36d1925700 1 --2- 172.21.15.155:0/1149998769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36cc115030 0x7f36cc115410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f36c00097c0 tx=0x7f36c0009ad0 comp rx=0 tx=0).stop 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.345+0000 7f36d1925700 1 -- 172.21.15.155:0/1149998769 shutdown_connections 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.345+0000 7f36d1925700 1 --2- 172.21.15.155:0/1149998769 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36cc115030 0x7f36cc115410 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.345+0000 7f36d1925700 1 -- 172.21.15.155:0/1149998769 >> 172.21.15.155:0/1149998769 conn(0x7f36cc06f450 msgr2=0x7f36cc071870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:19.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.345+0000 7f36d1925700 1 -- 172.21.15.155:0/1149998769 shutdown_connections 2024-04-19T23:45:19.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.345+0000 7f36d1925700 1 -- 172.21.15.155:0/1149998769 wait complete. 2024-04-19T23:45:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.346+0000 7f36d1925700 1 Processor -- start 2024-04-19T23:45:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.346+0000 7f36d1925700 1 -- start start 2024-04-19T23:45:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.347+0000 7f36d1925700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36cc10d350 0x7f36cc1a9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.347+0000 7f36d1925700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc1a9830 con 0x7f36cc10d350 2024-04-19T23:45:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.347+0000 7f36caffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36cc10d350 0x7f36cc1a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.347+0000 7f36caffd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36cc10d350 0x7f36cc1a9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:46794/0 (socket says 172.21.15.155:46794) 2024-04-19T23:45:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.347+0000 7f36caffd700 1 -- 172.21.15.155:0/3952453658 learned_addr learned my addr 172.21.15.155:0/3952453658 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.347+0000 7f36caffd700 1 -- 172.21.15.155:0/3952453658 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c00094a0 con 0x7f36cc10d350 2024-04-19T23:45:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.347+0000 7f36caffd700 1 --2- 172.21.15.155:0/3952453658 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36cc10d350 0x7f36cc1a9260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f36c0004000 tx=0x7f36c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.348+0000 7f36b3fff700 1 -- 172.21.15.155:0/3952453658 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36c0003df0 con 0x7f36cc10d350 2024-04-19T23:45:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.348+0000 7f36b3fff700 1 -- 172.21.15.155:0/3952453658 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c001e070 con 0x7f36cc10d350 2024-04-19T23:45:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.348+0000 7f36d1925700 1 -- 172.21.15.155:0/3952453658 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36cc1a99d0 con 0x7f36cc10d350 2024-04-19T23:45:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.348+0000 7f36b3fff700 1 -- 172.21.15.155:0/3952453658 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36c0011780 con 0x7f36cc10d350 2024-04-19T23:45:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.348+0000 7f36d1925700 1 -- 172.21.15.155:0/3952453658 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36cc1a9da0 con 0x7f36cc10d350 2024-04-19T23:45:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.348+0000 7f36d1925700 1 -- 172.21.15.155:0/3952453658 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36cc04f400 con 0x7f36cc10d350 2024-04-19T23:45:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.349+0000 7f36b3fff700 1 -- 172.21.15.155:0/3952453658 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f36c00119b0 con 0x7f36cc10d350 2024-04-19T23:45:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.349+0000 7f36b3fff700 1 --2- 172.21.15.155:0/3952453658 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f36b8037730 0x7f36b8039bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.349+0000 7f36b3fff700 1 -- 172.21.15.155:0/3952453658 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4220+0+0 (secure 0 0 0) 0x7f36c004b700 con 0x7f36cc10d350 2024-04-19T23:45:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.349+0000 7f36ca7fc700 1 --2- 172.21.15.155:0/3952453658 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f36b8037730 0x7f36b8039bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.349+0000 7f36ca7fc700 1 --2- 172.21.15.155:0/3952453658 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f36b8037730 0x7f36b8039bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f36bc000f60 tx=0x7f36bc007b10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:19.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.354+0000 7f36b3fff700 1 -- 172.21.15.155:0/3952453658 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f36c00109d0 con 0x7f36cc10d350 2024-04-19T23:45:19.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:19.546+0000 7f36d1925700 1 -- 172.21.15.155:0/3952453658 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7f36cc115030 con 0x7f36cc10d350 2024-04-19T23:45:20.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:20.200+0000 7f36b3fff700 1 -- 172.21.15.155:0/3952453658 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) v1 ==== 187+0+0 (secure 0 0 0) 0x7f36c00107f0 con 0x7f36cc10d350 2024-04-19T23:45:20.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:20.206+0000 7f36d1925700 1 -- 172.21.15.155:0/3952453658 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f36b8037730 msgr2=0x7f36b8039bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:20.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:20.206+0000 7f36d1925700 1 --2- 172.21.15.155:0/3952453658 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f36b8037730 0x7f36b8039bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f36bc000f60 tx=0x7f36bc007b10 comp rx=0 tx=0).stop 2024-04-19T23:45:20.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:20.206+0000 7f36d1925700 1 -- 172.21.15.155:0/3952453658 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36cc10d350 msgr2=0x7f36cc1a9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:20.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:20.206+0000 7f36d1925700 1 --2- 172.21.15.155:0/3952453658 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36cc10d350 0x7f36cc1a9260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f36c0004000 tx=0x7f36c0004750 comp rx=0 tx=0).stop 2024-04-19T23:45:20.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:20.208+0000 7f36d1925700 1 -- 172.21.15.155:0/3952453658 shutdown_connections 2024-04-19T23:45:20.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:20.208+0000 7f36d1925700 1 --2- 172.21.15.155:0/3952453658 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f36b8037730 0x7f36b8039bf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:20.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:20.208+0000 7f36d1925700 1 --2- 172.21.15.155:0/3952453658 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36cc10d350 0x7f36cc1a9260 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:20.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:20.208+0000 7f36d1925700 1 -- 172.21.15.155:0/3952453658 >> 172.21.15.155:0/3952453658 conn(0x7f36cc06f450 msgr2=0x7f36cc110ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:20.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:20.211+0000 7f36d1925700 1 -- 172.21.15.155:0/3952453658 shutdown_connections 2024-04-19T23:45:20.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:20.212+0000 7f36d1925700 1 -- 172.21.15.155:0/3952453658 wait complete. 2024-04-19T23:45:20.223 INFO:teuthology.orchestra.run.smithi155.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-19T23:45:20.235 DEBUG:tasks.rgw:Pools created 2024-04-19T23:45:20.235 INFO:tasks.rgw:Starting rgw... 2024-04-19T23:45:20.235 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-19T23:45:20.235 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-19T23:45:20.236 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-19T23:45:20.236 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-19T23:45:20.238 INFO:tasks.rgw.client.0:Started 2024-04-19T23:45:20.238 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi155.front.sepia.ceph.com:80/ 2024-04-19T23:45:20.238 DEBUG:teuthology.orchestra.run.smithi155:> curl http://smithi155.front.sepia.ceph.com:80/ 2024-04-19T23:45:20.275 INFO:teuthology.orchestra.run.smithi155.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-19T23:45:20.275 INFO:teuthology.orchestra.run.smithi155.stderr: Dload Upload Total Spent Left Speed 2024-04-19T23:45:20.276 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-19T23:45:20.276 INFO:teuthology.orchestra.run.smithi155.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi155.front.sepia.ceph.com port 80: Connection refused 2024-04-19T23:45:21.277 DEBUG:teuthology.orchestra.run.smithi155:> curl http://smithi155.front.sepia.ceph.com:80/ 2024-04-19T23:45:21.303 INFO:teuthology.orchestra.run.smithi155.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-19T23:45:21.304 INFO:teuthology.orchestra.run.smithi155.stderr: Dload Upload Total Spent Left Speed 2024-04-19T23:45:21.304 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-19T23:45:21.305 INFO:teuthology.orchestra.run.smithi155.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi155.front.sepia.ceph.com port 80: Connection refused 2024-04-19T23:45:23.306 DEBUG:teuthology.orchestra.run.smithi155:> curl http://smithi155.front.sepia.ceph.com:80/ 2024-04-19T23:45:23.331 INFO:teuthology.orchestra.run.smithi155.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-19T23:45:23.332 INFO:teuthology.orchestra.run.smithi155.stderr: Dload Upload Total Spent Left Speed 2024-04-19T23:45:23.333 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-19T23:45:23.333 INFO:teuthology.orchestra.run.smithi155.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi155.front.sepia.ceph.com port 80: Connection refused 2024-04-19T23:45:27.334 DEBUG:teuthology.orchestra.run.smithi155:> curl http://smithi155.front.sepia.ceph.com:80/ 2024-04-19T23:45:27.360 INFO:teuthology.orchestra.run.smithi155.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-19T23:45:27.360 INFO:teuthology.orchestra.run.smithi155.stderr: Dload Upload Total Spent Left Speed 2024-04-19T23:45:27.362 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-19T23:45:27.362 INFO:teuthology.orchestra.run.smithi155.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi155.front.sepia.ceph.com port 80: Connection refused 2024-04-19T23:45:35.364 DEBUG:teuthology.orchestra.run.smithi155:> curl http://smithi155.front.sepia.ceph.com:80/ 2024-04-19T23:45:35.390 INFO:teuthology.orchestra.run.smithi155.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-19T23:45:35.390 INFO:teuthology.orchestra.run.smithi155.stderr: Dload Upload Total Spent Left Speed 2024-04-19T23:45:35.391 INFO:teuthology.orchestra.run.smithi155.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 208k 2024-04-19T23:45:35.392 INFO:teuthology.orchestra.run.smithi155.stdout:anonymous 2024-04-19T23:45:35.392 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-04-19T23:45:35.473 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-04-19T23:45:35.473 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-19T23:45:35.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-19T23:45:35.473 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-19T23:45:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.525+0000 7f63ada65a80 1 Processor -- start 2024-04-19T23:45:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.525+0000 7f63ada65a80 1 -- start start 2024-04-19T23:45:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.525+0000 7f63ada65a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5619eff5ec00 0x5619f0246580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.525+0000 7f63ada65a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5619f0289500 con 0x5619eff5e800 2024-04-19T23:45:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.525+0000 7f63ada65a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5619f0000a00 con 0x5619eff5ec00 2024-04-19T23:45:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.526+0000 7f63ab20e700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5619eff5ec00 0x5619f0246580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.526+0000 7f63aba0f700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5619eff5e800 0x5619f004a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46432/0 (socket says 172.21.15.155:46432) 2024-04-19T23:45:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.526+0000 7f63aba0f700 1 -- 172.21.15.155:0/949460156 learned_addr learned my addr 172.21.15.155:0/949460156 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.526+0000 7f63ab20e700 1 -- 172.21.15.155:0/949460156 >> v1:172.21.15.76:6789/0 conn(0x5619eff5e800 legacy=0x5619f004a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.526+0000 7f63ab20e700 1 -- 172.21.15.155:0/949460156 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619eff87d40 con 0x5619eff5ec00 2024-04-19T23:45:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.526+0000 7f63ab20e700 1 --2- 172.21.15.155:0/949460156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5ec00 0x5619f0246580 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5619f0241890 tx=0x5619f004f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3b29b61977e28 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.526+0000 7f63aaa0d700 1 -- 172.21.15.155:0/949460156 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f00174a0 con 0x5619eff5ec00 2024-04-19T23:45:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.526+0000 7f63aaa0d700 1 -- 172.21.15.155:0/949460156 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619f0289800 con 0x5619eff5ec00 2024-04-19T23:45:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.526+0000 7f63aaa0d700 1 -- 172.21.15.155:0/949460156 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f0017600 con 0x5619eff5ec00 2024-04-19T23:45:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.527+0000 7f63ada65a80 1 -- 172.21.15.155:0/949460156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5ec00 msgr2=0x5619f0246580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.527+0000 7f63ada65a80 1 --2- 172.21.15.155:0/949460156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5ec00 0x5619f0246580 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5619f0241890 tx=0x5619f004f920 comp rx=0 tx=0).stop 2024-04-19T23:45:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.527+0000 7f63ada65a80 1 -- 172.21.15.155:0/949460156 shutdown_connections 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.527+0000 7f63ada65a80 1 --2- 172.21.15.155:0/949460156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5ec00 0x5619f0246580 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.527+0000 7f63ada65a80 1 -- 172.21.15.155:0/949460156 >> 172.21.15.155:0/949460156 conn(0x5619eff5e400 msgr2=0x5619f004a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.527+0000 7f63ada65a80 1 -- 172.21.15.155:0/949460156 shutdown_connections 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.527+0000 7f63ada65a80 1 -- 172.21.15.155:0/949460156 wait complete. 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.528+0000 7f63ada65a80 1 Processor -- start 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.528+0000 7f63ada65a80 1 -- start start 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.528+0000 7f63ada65a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.528+0000 7f63ada65a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619f0000500 con 0x5619eff5e800 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.528+0000 7f63aba0f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.528+0000 7f63aba0f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33324/0 (socket says 172.21.15.155:33324) 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.528+0000 7f63aba0f700 1 -- 172.21.15.155:0/3857931304 learned_addr learned my addr 172.21.15.155:0/3857931304 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.528+0000 7f63aba0f700 1 -- 172.21.15.155:0/3857931304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619eff87ba0 con 0x5619eff5e800 2024-04-19T23:45:35.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63aba0f700 1 --2- 172.21.15.155:0/3857931304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5619f0d37800 tx=0x5619f004fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b79fcc0bda4a3d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63aa20c700 1 -- 172.21.15.155:0/3857931304 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f00171e0 con 0x5619eff5e800 2024-04-19T23:45:35.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63aa20c700 1 -- 172.21.15.155:0/3857931304 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619f0289b00 con 0x5619eff5e800 2024-04-19T23:45:35.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63aa20c700 1 -- 172.21.15.155:0/3857931304 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f00174a0 con 0x5619eff5e800 2024-04-19T23:45:35.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63ada65a80 1 -- 172.21.15.155:0/3857931304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 msgr2=0x5619f0246580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63ada65a80 1 --2- 172.21.15.155:0/3857931304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5619f0d37800 tx=0x5619f004fb60 comp rx=0 tx=0).stop 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63ada65a80 1 -- 172.21.15.155:0/3857931304 shutdown_connections 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63ada65a80 1 --2- 172.21.15.155:0/3857931304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63ada65a80 1 -- 172.21.15.155:0/3857931304 >> 172.21.15.155:0/3857931304 conn(0x5619eff5e400 msgr2=0x5619f004b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63ada65a80 1 -- 172.21.15.155:0/3857931304 shutdown_connections 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63ada65a80 1 -- 172.21.15.155:0/3857931304 wait complete. 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.529+0000 7f63ada65a80 1 Processor -- start 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.530+0000 7f63ada65a80 1 -- start start 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.530+0000 7f63ada65a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.530+0000 7f63ada65a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619f00003c0 con 0x5619eff5e800 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.530+0000 7f63aba0f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.530+0000 7f63aba0f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33338/0 (socket says 172.21.15.155:33338) 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.530+0000 7f63aba0f700 1 -- 172.21.15.155:0/3599155592 learned_addr learned my addr 172.21.15.155:0/3599155592 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.530+0000 7f63aba0f700 1 -- 172.21.15.155:0/3599155592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619eff87a00 con 0x5619eff5e800 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.530+0000 7f63aba0f700 1 --2- 172.21.15.155:0/3599155592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x5619f0d37a10 tx=0x5619f004fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.531+0000 7f63a8a09700 1 -- 172.21.15.155:0/3599155592 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f0017600 con 0x5619eff5e800 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.531+0000 7f63a8a09700 1 -- 172.21.15.155:0/3599155592 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619effffc80 con 0x5619eff5e800 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.531+0000 7f63ada65a80 1 -- 172.21.15.155:0/3599155592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619eff87860 con 0x5619eff5e800 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.531+0000 7f63a8a09700 1 -- 172.21.15.155:0/3599155592 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f00171e0 con 0x5619eff5e800 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.531+0000 7f63ada65a80 1 -- 172.21.15.155:0/3599155592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619eff876c0 con 0x5619eff5e800 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.531+0000 7f63ada65a80 1 Processor -- start 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.531+0000 7f63ada65a80 1 -- start start 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.531+0000 7f63ada65a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 0x5619f0246b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.531+0000 7f63a8a09700 1 -- 172.21.15.155:0/3599155592 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5619f0d00b00 con 0x5619eff5e800 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.532+0000 7f63ada65a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619f0000000 con 0x5619eff5f400 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.532+0000 7f63a8a09700 1 --2- 172.21.15.155:0/3599155592 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f02e4000 0x5619f0247080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.532+0000 7f63a8a09700 1 -- 172.21.15.155:0/3599155592 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5619effd9180 con 0x5619eff5e800 2024-04-19T23:45:35.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.532+0000 7f63aba0f700 1 --2- 172.21.15.155:0/3599155592 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f02e4000 0x5619f0247080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.532+0000 7f63ac210700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 0x5619f0246b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.532+0000 7f63ac210700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 0x5619f0246b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33342/0 (socket says 172.21.15.155:33342) 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.532+0000 7f63ac210700 1 -- 172.21.15.155:0/1504944239 learned_addr learned my addr 172.21.15.155:0/1504944239 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.532+0000 7f63aba0f700 1 --2- 172.21.15.155:0/3599155592 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f02e4000 0x5619f0247080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x5619f0df0f90 tx=0x5619f02ac240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.532+0000 7f63ac210700 1 -- 172.21.15.155:0/1504944239 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619eff86000 con 0x5619eff5f400 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.532+0000 7f63ac210700 1 --2- 172.21.15.155:0/1504944239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 0x5619f0246b00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x5619f0df0360 tx=0x5619f02ac9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e18101783331b00 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.533+0000 7f63a6204700 1 -- 172.21.15.155:0/1504944239 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f0017600 con 0x5619eff5f400 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.533+0000 7f63a6204700 1 -- 172.21.15.155:0/1504944239 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619f0288300 con 0x5619eff5f400 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.533+0000 7f63a6204700 1 -- 172.21.15.155:0/1504944239 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f00171e0 con 0x5619eff5f400 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.533+0000 7f63ada65a80 1 -- 172.21.15.155:0/1504944239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 msgr2=0x5619f0246b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.533+0000 7f63ada65a80 1 --2- 172.21.15.155:0/1504944239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 0x5619f0246b00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x5619f0df0360 tx=0x5619f02ac9c0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.533+0000 7f63ada65a80 1 -- 172.21.15.155:0/1504944239 shutdown_connections 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.533+0000 7f63ada65a80 1 --2- 172.21.15.155:0/1504944239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 0x5619f0246b00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.533+0000 7f63ada65a80 1 -- 172.21.15.155:0/1504944239 >> 172.21.15.155:0/1504944239 conn(0x5619eff5ec00 msgr2=0x5619f004b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.533+0000 7f63ada65a80 1 -- 172.21.15.155:0/1504944239 shutdown_connections 2024-04-19T23:45:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.533+0000 7f63ada65a80 1 -- 172.21.15.155:0/1504944239 wait complete. 2024-04-19T23:45:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.534+0000 7f63ada65a80 1 Processor -- start 2024-04-19T23:45:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.534+0000 7f63ada65a80 1 -- start start 2024-04-19T23:45:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.534+0000 7f63ada65a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 0x5619f0246b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.534+0000 7f63ada65a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619eff9a640 con 0x5619eff5f400 2024-04-19T23:45:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.534+0000 7f63ac210700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 0x5619f0246b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.534+0000 7f63ac210700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 0x5619f0246b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33354/0 (socket says 172.21.15.155:33354) 2024-04-19T23:45:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.534+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 learned_addr learned my addr 172.21.15.155:0/2183302780 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.534+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619eff86ea0 con 0x5619eff5f400 2024-04-19T23:45:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.535+0000 7f63ac210700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 0x5619f0246b00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5619f0df0900 tx=0x5619f02ac120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.535+0000 7f63a4a01700 1 -- 172.21.15.155:0/2183302780 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f0017a20 con 0x5619eff5f400 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.535+0000 7f63a4a01700 1 -- 172.21.15.155:0/2183302780 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619effffc80 con 0x5619eff5f400 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.535+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619eff86820 con 0x5619eff5f400 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.535+0000 7f63a4a01700 1 -- 172.21.15.155:0/2183302780 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f0017600 con 0x5619eff5f400 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.535+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619eff869c0 con 0x5619eff5f400 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.536+0000 7f63a4a01700 1 -- 172.21.15.155:0/2183302780 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5619f0d00dc0 con 0x5619eff5f400 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.536+0000 7f63ada65a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.536+0000 7f63a4a01700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f02e4c00 0x5619f0247600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.536+0000 7f63a4a01700 1 -- 172.21.15.155:0/2183302780 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5619effd9340 con 0x5619eff5f400 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.536+0000 7f63ab20e700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f02e4c00 0x5619f0247600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.536+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5619eff5f800 0x5619f0247b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.536+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619eff5fc00 con 0x5619eff5f800 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.536+0000 7f63ac210700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5619eff5f800 0x5619f0247b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ab20e700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f02e4c00 0x5619f0247600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x5619f0241890 tx=0x5619f004f800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ac210700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5619eff5f800 0x5619f0247b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ada65a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ada65a80 20 realm 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ada65a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f02e5000 con 0x5619eff5f800 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ada65a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ada65a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ada65a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f02e5400 con 0x5619eff5f800 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ada65a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ada65a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.537+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f02e5800 con 0x5619eff5f800 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.538+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.538+0000 7f63ada65a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.538+0000 7f63ada65a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.538+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f02e5c00 con 0x5619eff5f800 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.538+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.538+0000 7f63ada65a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.538+0000 7f63ada65a80 20 searching for the correct realm 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.538+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5619f02e5000 0x5619f0248100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.538+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f02e5400 con 0x5619f02e5000 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.538+0000 7f63aba0f700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5619f02e5000 0x5619f0248100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.539+0000 7f63aba0f700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5619f02e5000 0x5619f0248100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.539+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.539+0000 7f63aba0f700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5619f02e5400 0x5619f0248c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.539+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6000 con 0x5619f02e5400 2024-04-19T23:45:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.539+0000 7f63ab20e700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5619f02e5400 0x5619f0248c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.539+0000 7f63ab20e700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5619f02e5400 0x5619f0248c00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.540+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.540+0000 7f63ab20e700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5619f03a6000 0x5619f0249180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.540+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f03a6000 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.540+0000 7f63ac210700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5619f03a6000 0x5619f0249180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.540+0000 7f63ac210700 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5619f03a6000 0x5619f0249180 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.541+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.541+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619eff5f800 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.541+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.541+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619eff5f800 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.541+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.541+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f03a6000 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.542+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.542+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f03a6000 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.542+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.542+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5400 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.542+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.542+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5000 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.542+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.542+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619eff5f800 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.543+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.543+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f03a6000 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.543+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.543+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619eff5f800 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.543+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.543+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5400 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.544+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.544+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5000 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.544+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.544+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5000 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.544+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.544+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f03a6000 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.544+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.544+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5000 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.545+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.545+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5000 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.545+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.545+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619eff5f800 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.545+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.545+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619eff5f800 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.545+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.545+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f03a6000 2024-04-19T23:45:35.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.546+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.546+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5000 2024-04-19T23:45:35.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.546+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.546+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5400 2024-04-19T23:45:35.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.546+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.546+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619eff5f800 2024-04-19T23:45:35.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.546+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.546+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f03a6000 2024-04-19T23:45:35.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.547+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.547+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5000 2024-04-19T23:45:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.547+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.547+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f03a6000 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.548+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.548+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5400 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.548+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.548+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5000 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.548+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.548+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f03a6000 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.548+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.548+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619eff5f800 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5400 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ada65a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ada65a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ada65a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ada65a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ada65a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619eff5fc00 con 0x5619eff5f800 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ada65a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ada65a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.549+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6c00 con 0x5619eff5f800 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7000 con 0x5619f02e5400 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 20 zone default found 2024-04-19T23:45:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 4 Realm: () 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 20 zonegroup default 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7400 con 0x5619f03a6000 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.550+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7800 con 0x5619f02e5000 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.551+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.551+0000 7f63ada65a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.551+0000 7f63ada65a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.551+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5000 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.551+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.551+0000 7f63ada65a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.551+0000 7f63ada65a80 20 started sync module instance, tier type = 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.551+0000 7f63ada65a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.551+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6c00 con 0x5619f02e5400 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.552+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.552+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94669403052800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619eff5fc00 con 0x5619f02e5400 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.552+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f02e5800 con 0x5619eff5f800 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.553+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94669403052800] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.553+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.553+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94669403053952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f02e5c00 con 0x5619eff5f800 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.554+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f02e5000 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.556+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94669403053952] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.556+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.556+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94669403055104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7000 con 0x5619f02e5000 2024-04-19T23:45:35.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.556+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6c00 con 0x5619f02e5400 2024-04-19T23:45:35.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.558+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94669403055104] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.559+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.559+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94669403056256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6400 con 0x5619f02e5400 2024-04-19T23:45:35.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.559+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7800 con 0x5619eff5f800 2024-04-19T23:45:35.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.561+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94669403056256] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.563+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.563+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94669403057408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619eff5f800 2024-04-19T23:45:35.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.563+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6800 con 0x5619f03a6000 2024-04-19T23:45:35.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.565+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.565+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94669403058560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7400 con 0x5619f03a6000 2024-04-19T23:45:35.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.565+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7800 con 0x5619f03a6000 2024-04-19T23:45:35.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.566+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94669403057408] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.566+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.566+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94669403059712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f03a6000 2024-04-19T23:45:35.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.566+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f02e5800 con 0x5619f03a6000 2024-04-19T23:45:35.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.566+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94669403058560] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.567+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94669403059712] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.567+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.567+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94669403060864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f02e5c00 con 0x5619f03a6000 2024-04-19T23:45:35.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.567+0000 7f63ada65a80 20 add_watcher() i=0 2024-04-19T23:45:35.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.567+0000 7f63ada65a80 20 add_watcher() i=1 2024-04-19T23:45:35.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.567+0000 7f63ada65a80 20 add_watcher() i=2 2024-04-19T23:45:35.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.567+0000 7f63ada65a80 20 add_watcher() i=3 2024-04-19T23:45:35.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.567+0000 7f63ada65a80 20 add_watcher() i=4 2024-04-19T23:45:35.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.567+0000 7f63ada65a80 20 add_watcher() i=5 2024-04-19T23:45:35.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.567+0000 7f63ada65a80 20 add_watcher() i=6 2024-04-19T23:45:35.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.568+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94669403060864] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.568+0000 7f63ada65a80 20 add_watcher() i=7 2024-04-19T23:45:35.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.568+0000 7f63ada65a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:35.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.568+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f02e5800 con 0x5619eff5f800 2024-04-19T23:45:35.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.569+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.569+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94669404602368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f02e5c00 con 0x5619eff5f800 2024-04-19T23:45:35.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.571+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94669404602368] v30'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.571+0000 7f63929dd700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:35.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.571+0000 7f63ada65a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:35.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.571+0000 7f63ada65a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:35.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.571+0000 7f63ada65a80 1 Processor -- start 2024-04-19T23:45:35.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.571+0000 7f63ada65a80 1 -- start start 2024-04-19T23:45:35.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.571+0000 7f63ada65a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.571+0000 7f63ada65a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619eff9a780 con 0x5619f03a7400 2024-04-19T23:45:35.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.572+0000 7f63ab20e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.572+0000 7f63ab20e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33356/0 (socket says 172.21.15.155:33356) 2024-04-19T23:45:35.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.572+0000 7f63ab20e700 1 -- 172.21.15.155:0/2094136993 learned_addr learned my addr 172.21.15.155:0/2094136993 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.572+0000 7f63ab20e700 1 -- 172.21.15.155:0/2094136993 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619eff86b60 con 0x5619f03a7400 2024-04-19T23:45:35.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.572+0000 7f63ab20e700 1 --2- 172.21.15.155:0/2094136993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x5619f03c0000 tx=0x5619f02ad6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26dcba35af17df20 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.573+0000 7f63921dc700 1 -- 172.21.15.155:0/2094136993 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f0017760 con 0x5619f03a7400 2024-04-19T23:45:35.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.573+0000 7f63921dc700 1 -- 172.21.15.155:0/2094136993 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619f03ca000 con 0x5619f03a7400 2024-04-19T23:45:35.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.573+0000 7f63921dc700 1 -- 172.21.15.155:0/2094136993 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f03cc000 con 0x5619f03a7400 2024-04-19T23:45:35.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.573+0000 7f63ada65a80 1 -- 172.21.15.155:0/2094136993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 msgr2=0x5619f0248680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.573+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2094136993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x5619f03c0000 tx=0x5619f02ad6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.573+0000 7f63ada65a80 1 -- 172.21.15.155:0/2094136993 shutdown_connections 2024-04-19T23:45:35.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.573+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2094136993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.573+0000 7f63ada65a80 1 -- 172.21.15.155:0/2094136993 >> 172.21.15.155:0/2094136993 conn(0x5619f03a6800 msgr2=0x5619f004c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.573+0000 7f63ada65a80 1 -- 172.21.15.155:0/2094136993 shutdown_connections 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.573+0000 7f63ada65a80 1 -- 172.21.15.155:0/2094136993 wait complete. 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.574+0000 7f63ada65a80 1 Processor -- start 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.574+0000 7f63ada65a80 1 -- start start 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.574+0000 7f63ada65a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.574+0000 7f63ada65a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619f0000000 con 0x5619f03a7400 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.574+0000 7f63ab20e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.574+0000 7f63ab20e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33358/0 (socket says 172.21.15.155:33358) 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.574+0000 7f63ab20e700 1 -- 172.21.15.155:0/2205606988 learned_addr learned my addr 172.21.15.155:0/2205606988 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.575+0000 7f63ab20e700 1 -- 172.21.15.155:0/2205606988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619eff86d00 con 0x5619f03a7400 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.575+0000 7f63ab20e700 1 --2- 172.21.15.155:0/2205606988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5619f03c01e0 tx=0x5619f02ad800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.575+0000 7f63909d9700 1 -- 172.21.15.155:0/2205606988 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f03cc160 con 0x5619f03a7400 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.575+0000 7f63909d9700 1 -- 172.21.15.155:0/2205606988 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619f03ca180 con 0x5619f03a7400 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.575+0000 7f63ada65a80 1 -- 172.21.15.155:0/2205606988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619eff86340 con 0x5619f03a7400 2024-04-19T23:45:35.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.575+0000 7f63909d9700 1 -- 172.21.15.155:0/2205606988 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5619f03cc2c0 con 0x5619f03a7400 2024-04-19T23:45:35.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.575+0000 7f63ada65a80 1 -- 172.21.15.155:0/2205606988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619eff87d40 con 0x5619f03a7400 2024-04-19T23:45:35.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.576+0000 7f63909d9700 1 -- 172.21.15.155:0/2205606988 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5619f0d01b80 con 0x5619f03a7400 2024-04-19T23:45:35.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.576+0000 7f63909d9700 1 --2- 172.21.15.155:0/2205606988 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f044a000 0x5619f0249700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.576+0000 7f63909d9700 1 -- 172.21.15.155:0/2205606988 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5619effd9500 con 0x5619f03a7400 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.576+0000 7f63ac210700 1 --2- 172.21.15.155:0/2205606988 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f044a000 0x5619f0249700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.576+0000 7f63ada65a80 5 note: GC not initialized 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.576+0000 7f63ac210700 1 --2- 172.21.15.155:0/2205606988 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f044a000 0x5619f0249700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x5619f0351c50 tx=0x5619f02aca20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.577+0000 7f638e1d4700 20 reqs_thread_entry: start 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.577+0000 7f63ada65a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.577+0000 7f63ada65a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.577+0000 7f638c1d0700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:05 2024 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.577+0000 7f638b9ae700 20 reqs_thread_entry: start 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.578+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5000 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.578+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.578+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5000 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.578+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.578+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619eff5f800 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.579+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.579+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619eff5f800 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.579+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.579+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5400 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.579+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.579+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5000 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.579+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.579+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619eff5f800 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.580+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.580+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5000 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.580+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.580+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5400 2024-04-19T23:45:35.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.580+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.580+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5000 2024-04-19T23:45:35.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.580+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.580+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619eff5f800 2024-04-19T23:45:35.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.581+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.581+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f03a6000 2024-04-19T23:45:35.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.581+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.581+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f03a6000 2024-04-19T23:45:35.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.582+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.582+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5000 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.582+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.582+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f03a6000 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.582+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.582+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f03a6000 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.582+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.582+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f03a6000 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.583+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.583+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5000 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.583+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.583+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5400 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.583+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.583+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619eff5f800 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.584+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.584+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619eff5f800 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.584+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.584+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5000 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.584+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.584+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5400 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.584+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.584+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f03a6000 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.585+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.585+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619eff5f800 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.585+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.585+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f03a6000 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.585+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.585+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5000 2024-04-19T23:45:35.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.585+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.586+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5400 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.586+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.586+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f03a6000 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.586+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.586+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619eff5f800 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.586+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.586+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5000 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.587+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.587+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a7c00 con 0x5619f02e5400 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.587+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.588+0000 7f63929dd700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:35.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.588+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94669404602368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f044a400 con 0x5619eff5f800 2024-04-19T23:45:35.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.589+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94669404602368] v30'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.589+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94669403052800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f044a800 con 0x5619f02e5400 2024-04-19T23:45:35.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.590+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94669403052800] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.590+0000 7f63ada65a80 20 remove_watcher() i=0 2024-04-19T23:45:35.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.590+0000 7f63ada65a80 2 removed watcher, disabling cache 2024-04-19T23:45:35.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.590+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94669403053952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f044ac00 con 0x5619eff5f800 2024-04-19T23:45:35.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.591+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94669403053952] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.591+0000 7f63ada65a80 20 remove_watcher() i=1 2024-04-19T23:45:35.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.591+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94669403055104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f044b000 con 0x5619f02e5000 2024-04-19T23:45:35.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.593+0000 7f63aba0f700 1 -- 172.21.15.155:0/2183302780 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94669403055104] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039b200 con 0x5619f02e5000 2024-04-19T23:45:35.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.593+0000 7f63ada65a80 20 remove_watcher() i=2 2024-04-19T23:45:35.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.593+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94669403056256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f044b400 con 0x5619f02e5400 2024-04-19T23:45:35.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.594+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94669403056256] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039b440 con 0x5619f02e5400 2024-04-19T23:45:35.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.594+0000 7f63ada65a80 20 remove_watcher() i=3 2024-04-19T23:45:35.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.594+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94669403057408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f044b800 con 0x5619eff5f800 2024-04-19T23:45:35.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.595+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94669403057408] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619eff5f800 2024-04-19T23:45:35.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.595+0000 7f63ada65a80 20 remove_watcher() i=4 2024-04-19T23:45:35.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.595+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94669403058560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f044bc00 con 0x5619f03a6000 2024-04-19T23:45:35.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.597+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94669403058560] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.597+0000 7f63ada65a80 20 remove_watcher() i=5 2024-04-19T23:45:35.597 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.597+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94669403059712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f044a800 con 0x5619f03a6000 2024-04-19T23:45:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.598+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94669403059712] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.598+0000 7f63ada65a80 20 remove_watcher() i=6 2024-04-19T23:45:35.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.598+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94669403060864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619f03a6c00 con 0x5619f03a6000 2024-04-19T23:45:35.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ac210700 1 -- 172.21.15.155:0/2183302780 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94669403060864] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5619f039ab40 con 0x5619f03a6000 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 20 remove_watcher() i=7 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5619f03a6000 msgr2=0x5619f0249180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5619f03a6000 0x5619f0249180 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5619eff5f800 msgr2=0x5619f0247b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5619eff5f800 0x5619f0247b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5619f02e5400 msgr2=0x5619f0248c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5619f02e5400 0x5619f0248c00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5619f02e5000 msgr2=0x5619f0248100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5619f02e5000 0x5619f0248100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f02e4c00 msgr2=0x5619f0247600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f02e4c00 0x5619f0247600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x5619f0241890 tx=0x5619f004f800 comp rx=0 tx=0).stop 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 msgr2=0x5619f0246b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.601 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2183302780 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5f400 0x5619f0246b00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5619f0df0900 tx=0x5619f02ac120 comp rx=0 tx=0).stop 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 reap_dead start 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ab20e700 1 -- 172.21.15.155:0/2183302780 reap_dead start 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 shutdown_connections 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 >> 172.21.15.155:0/2183302780 conn(0x5619eff5ec00 msgr2=0x5619f004b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 shutdown_connections 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.599+0000 7f63ada65a80 1 -- 172.21.15.155:0/2183302780 wait complete. 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/2205606988 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f044a000 msgr2=0x5619f0249700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2205606988 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f044a000 0x5619f0249700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x5619f0351c50 tx=0x5619f02aca20 comp rx=0 tx=0).stop 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/2205606988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 msgr2=0x5619f0248680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2205606988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5619f03c01e0 tx=0x5619f02ad800 comp rx=0 tx=0).stop 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/2205606988 shutdown_connections 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2205606988 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f044a000 0x5619f0249700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 --2- 172.21.15.155:0/2205606988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619f03a7400 0x5619f0248680 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/2205606988 >> 172.21.15.155:0/2205606988 conn(0x5619f03a6800 msgr2=0x5619f004c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/2205606988 shutdown_connections 2024-04-19T23:45:35.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/2205606988 wait complete. 2024-04-19T23:45:35.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/3599155592 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f02e4000 msgr2=0x5619f0247080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 --2- 172.21.15.155:0/3599155592 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f02e4000 0x5619f0247080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x5619f0df0f90 tx=0x5619f02ac240 comp rx=0 tx=0).stop 2024-04-19T23:45:35.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/3599155592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 msgr2=0x5619f0246580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 --2- 172.21.15.155:0/3599155592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x5619f0d37a10 tx=0x5619f004fa40 comp rx=0 tx=0).stop 2024-04-19T23:45:35.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/3599155592 shutdown_connections 2024-04-19T23:45:35.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 --2- 172.21.15.155:0/3599155592 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5619f02e4000 0x5619f0247080 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 --2- 172.21.15.155:0/3599155592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619eff5e800 0x5619f0246580 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/3599155592 >> 172.21.15.155:0/3599155592 conn(0x5619eff5e400 msgr2=0x5619f004b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/3599155592 shutdown_connections 2024-04-19T23:45:35.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.600+0000 7f63ada65a80 1 -- 172.21.15.155:0/3599155592 wait complete. 2024-04-19T23:45:35.607 INFO:teuthology.orchestra.run.smithi155.stdout:[] 2024-04-19T23:45:35.607 DEBUG:tasks.util.rgw: json result: [] 2024-04-19T23:45:35.607 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-04-19T23:45:35.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-04-19T23:45:35.607 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-04-19T23:45:35.652 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:35.653 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.653+0000 7f3255022a80 1 Processor -- start 2024-04-19T23:45:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.653+0000 7f3255022a80 1 -- start start 2024-04-19T23:45:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.653+0000 7f3255022a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5558e0d44800 0x5558e102c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.653+0000 7f3255022a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5558e106f500 con 0x5558e0d44c00 2024-04-19T23:45:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.653+0000 7f3255022a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5558e0de6a00 con 0x5558e0d44800 2024-04-19T23:45:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.654+0000 7f3252fcc700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5558e0d44800 0x5558e102c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.654+0000 7f32527cb700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5558e0d44c00 0x5558e0e30800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46436/0 (socket says 172.21.15.155:46436) 2024-04-19T23:45:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.654+0000 7f32527cb700 1 -- 172.21.15.155:0/2109184208 learned_addr learned my addr 172.21.15.155:0/2109184208 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.654+0000 7f3252fcc700 1 -- 172.21.15.155:0/2109184208 >> v1:172.21.15.76:6789/0 conn(0x5558e0d44c00 legacy=0x5558e0e30800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.654+0000 7f3252fcc700 1 -- 172.21.15.155:0/2109184208 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558e0d6dd40 con 0x5558e0d44800 2024-04-19T23:45:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.654+0000 7f3252fcc700 1 --2- 172.21.15.155:0/2109184208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5558e10279e0 tx=0x5558e0e35920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5a8481affa9954 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.654+0000 7f3251fca700 1 -- 172.21.15.155:0/2109184208 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e0dfd4a0 con 0x5558e0d44800 2024-04-19T23:45:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.654+0000 7f3251fca700 1 -- 172.21.15.155:0/2109184208 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558e106f800 con 0x5558e0d44800 2024-04-19T23:45:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.654+0000 7f3251fca700 1 -- 172.21.15.155:0/2109184208 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e0dfd600 con 0x5558e0d44800 2024-04-19T23:45:35.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.655+0000 7f3255022a80 1 -- 172.21.15.155:0/2109184208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 msgr2=0x5558e102c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.655+0000 7f3255022a80 1 --2- 172.21.15.155:0/2109184208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5558e10279e0 tx=0x5558e0e35920 comp rx=0 tx=0).stop 2024-04-19T23:45:35.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.655+0000 7f3255022a80 1 -- 172.21.15.155:0/2109184208 shutdown_connections 2024-04-19T23:45:35.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.655+0000 7f3255022a80 1 --2- 172.21.15.155:0/2109184208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.655+0000 7f3255022a80 1 -- 172.21.15.155:0/2109184208 >> 172.21.15.155:0/2109184208 conn(0x5558e0d44400 msgr2=0x5558e0e30000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.655+0000 7f3255022a80 1 -- 172.21.15.155:0/2109184208 shutdown_connections 2024-04-19T23:45:35.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.655+0000 7f3255022a80 1 -- 172.21.15.155:0/2109184208 wait complete. 2024-04-19T23:45:35.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.656+0000 7f3255022a80 1 Processor -- start 2024-04-19T23:45:35.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.656+0000 7f3255022a80 1 -- start start 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.656+0000 7f3255022a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.656+0000 7f3255022a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e0de6500 con 0x5558e0d44800 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.656+0000 7f3252fcc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.656+0000 7f3252fcc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33378/0 (socket says 172.21.15.155:33378) 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.656+0000 7f3252fcc700 1 -- 172.21.15.155:0/1058560595 learned_addr learned my addr 172.21.15.155:0/1058560595 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.656+0000 7f3252fcc700 1 -- 172.21.15.155:0/1058560595 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558e0d6dba0 con 0x5558e0d44800 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.656+0000 7f3252fcc700 1 --2- 172.21.15.155:0/1058560595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5558e1b1c0c0 tx=0x5558e0e35800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df75b6d9d49bdeb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.656+0000 7f32517c9700 1 -- 172.21.15.155:0/1058560595 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e0dfd760 con 0x5558e0d44800 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f32517c9700 1 -- 172.21.15.155:0/1058560595 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558e106fb00 con 0x5558e0d44800 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f32517c9700 1 -- 172.21.15.155:0/1058560595 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e0dfd1e0 con 0x5558e0d44800 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f3255022a80 1 -- 172.21.15.155:0/1058560595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 msgr2=0x5558e102c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f3255022a80 1 --2- 172.21.15.155:0/1058560595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5558e1b1c0c0 tx=0x5558e0e35800 comp rx=0 tx=0).stop 2024-04-19T23:45:35.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f3255022a80 1 -- 172.21.15.155:0/1058560595 shutdown_connections 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f3255022a80 1 --2- 172.21.15.155:0/1058560595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f3255022a80 1 -- 172.21.15.155:0/1058560595 >> 172.21.15.155:0/1058560595 conn(0x5558e0d44400 msgr2=0x5558e0e31000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f3255022a80 1 -- 172.21.15.155:0/1058560595 shutdown_connections 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f3255022a80 1 -- 172.21.15.155:0/1058560595 wait complete. 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f3255022a80 1 Processor -- start 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f3255022a80 1 -- start start 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f3255022a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.657+0000 7f3255022a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e0de63c0 con 0x5558e0d44800 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.658+0000 7f3252fcc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.658+0000 7f3252fcc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33386/0 (socket says 172.21.15.155:33386) 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.658+0000 7f3252fcc700 1 -- 172.21.15.155:0/2391998821 learned_addr learned my addr 172.21.15.155:0/2391998821 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.658+0000 7f3252fcc700 1 -- 172.21.15.155:0/2391998821 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558e0d6da00 con 0x5558e0d44800 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.658+0000 7f3252fcc700 1 --2- 172.21.15.155:0/2391998821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5558e1b1d950 tx=0x5558e0e35920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.658+0000 7f324ffc6700 1 -- 172.21.15.155:0/2391998821 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e0dfd4a0 con 0x5558e0d44800 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.658+0000 7f324ffc6700 1 -- 172.21.15.155:0/2391998821 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558e106fc80 con 0x5558e0d44800 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.658+0000 7f3255022a80 1 -- 172.21.15.155:0/2391998821 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5558e0d6d860 con 0x5558e0d44800 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.658+0000 7f324ffc6700 1 -- 172.21.15.155:0/2391998821 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e0dfd600 con 0x5558e0d44800 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.658+0000 7f3255022a80 1 -- 172.21.15.155:0/2391998821 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558e0d6d6c0 con 0x5558e0d44800 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.659+0000 7f3255022a80 1 Processor -- start 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.659+0000 7f3255022a80 1 -- start start 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.659+0000 7f3255022a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 0x5558e102cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.659+0000 7f3255022a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e0d80640 con 0x5558e0d45400 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.659+0000 7f324ffc6700 1 -- 172.21.15.155:0/2391998821 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5558e1ae6b00 con 0x5558e0d44800 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.659+0000 7f32537cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 0x5558e102cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.659+0000 7f32537cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 0x5558e102cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33402/0 (socket says 172.21.15.155:33402) 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.659+0000 7f32537cd700 1 -- 172.21.15.155:0/2739741158 learned_addr learned my addr 172.21.15.155:0/2739741158 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.659+0000 7f324ffc6700 1 --2- 172.21.15.155:0/2391998821 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e10ce000 0x5558e102d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.659+0000 7f324ffc6700 1 -- 172.21.15.155:0/2391998821 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5558e0dbf180 con 0x5558e0d44800 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.659+0000 7f3252fcc700 1 --2- 172.21.15.155:0/2391998821 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e10ce000 0x5558e102d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f32537cd700 1 -- 172.21.15.155:0/2739741158 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558e0d6c000 con 0x5558e0d45400 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f3252fcc700 1 --2- 172.21.15.155:0/2391998821 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e10ce000 0x5558e102d080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x5558e1bd6f00 tx=0x5558e1090540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f32537cd700 1 --2- 172.21.15.155:0/2739741158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 0x5558e102cb00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x5558e10d0000 tx=0x5558e1090720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12369b1a352777d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f324d7c1700 1 -- 172.21.15.155:0/2739741158 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e0dfd4a0 con 0x5558e0d45400 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f324d7c1700 1 -- 172.21.15.155:0/2739741158 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558e0de5c80 con 0x5558e0d45400 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f324d7c1700 1 -- 172.21.15.155:0/2739741158 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e0dfd600 con 0x5558e0d45400 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f3255022a80 1 -- 172.21.15.155:0/2739741158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 msgr2=0x5558e102cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f3255022a80 1 --2- 172.21.15.155:0/2739741158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 0x5558e102cb00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x5558e10d0000 tx=0x5558e1090720 comp rx=0 tx=0).stop 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f3255022a80 1 -- 172.21.15.155:0/2739741158 shutdown_connections 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f3255022a80 1 --2- 172.21.15.155:0/2739741158 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 0x5558e102cb00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f3255022a80 1 -- 172.21.15.155:0/2739741158 >> 172.21.15.155:0/2739741158 conn(0x5558e0d44c00 msgr2=0x5558e0e31800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f3255022a80 1 -- 172.21.15.155:0/2739741158 shutdown_connections 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.660+0000 7f3255022a80 1 -- 172.21.15.155:0/2739741158 wait complete. 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.661+0000 7f3255022a80 1 Processor -- start 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.661+0000 7f3255022a80 1 -- start start 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.661+0000 7f3255022a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 0x5558e102cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.661+0000 7f3255022a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e0d808c0 con 0x5558e0d45400 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.661+0000 7f32537cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 0x5558e102cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.661+0000 7f32537cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 0x5558e102cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33416/0 (socket says 172.21.15.155:33416) 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.661+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 learned_addr learned my addr 172.21.15.155:0/2908379143 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.661+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558e0d6cea0 con 0x5558e0d45400 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.661+0000 7f32537cd700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 0x5558e102cb00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5558e10d1e00 tx=0x5558e10905a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.662+0000 7f324bfbe700 1 -- 172.21.15.155:0/2908379143 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e0dfd760 con 0x5558e0d45400 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.662+0000 7f324bfbe700 1 -- 172.21.15.155:0/2908379143 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558e0de5b00 con 0x5558e0d45400 2024-04-19T23:45:35.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.662+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5558e0d6c820 con 0x5558e0d45400 2024-04-19T23:45:35.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.662+0000 7f324bfbe700 1 -- 172.21.15.155:0/2908379143 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e0dfd4a0 con 0x5558e0d45400 2024-04-19T23:45:35.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.662+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558e0d6c9c0 con 0x5558e0d45400 2024-04-19T23:45:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.663+0000 7f324bfbe700 1 -- 172.21.15.155:0/2908379143 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5558e1ae6dc0 con 0x5558e0d45400 2024-04-19T23:45:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.663+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.663+0000 7f324bfbe700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e10cec00 0x5558e102d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.663+0000 7f324bfbe700 1 -- 172.21.15.155:0/2908379143 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5558e0dbf340 con 0x5558e0d45400 2024-04-19T23:45:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.663+0000 7f32527cb700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e10cec00 0x5558e102d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.663+0000 7f3255022a80 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5558e0d45800 0x5558e102db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.663+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e0d45c00 con 0x5558e0d45800 2024-04-19T23:45:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.663+0000 7f32537cd700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5558e0d45800 0x5558e102db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.663+0000 7f32527cb700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e10cec00 0x5558e102d600 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x5558e1bd7e00 tx=0x5558e1090600 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.663+0000 7f32537cd700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5558e0d45800 0x5558e102db80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 20 realm 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cf000 con 0x5558e0d45800 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cf400 con 0x5558e0d45800 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cf800 con 0x5558e0d45800 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cfc00 con 0x5558e0d45800 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.664+0000 7f3255022a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.665+0000 7f3255022a80 20 searching for the correct realm 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.665+0000 7f3255022a80 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5558e10cf000 0x5558e102e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.665+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cf400 con 0x5558e10cf000 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.665+0000 7f3252fcc700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5558e10cf000 0x5558e102e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.665+0000 7f3252fcc700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5558e10cf000 0x5558e102e100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.665+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.665+0000 7f3252fcc700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5558e10cf400 0x5558e102ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.665+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc000 con 0x5558e10cf400 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.665+0000 7f32527cb700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5558e10cf400 0x5558e102ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.666+0000 7f32527cb700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5558e10cf400 0x5558e102ec00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.666+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.666+0000 7f32527cb700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5558e1bdc000 0x5558e102f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.666+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e1bdc000 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.666+0000 7f32537cd700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5558e1bdc000 0x5558e102f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.666+0000 7f32537cd700 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5558e1bdc000 0x5558e102f180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.667+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.667+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e0d45800 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.667+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.667+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e0d45800 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.667+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.667+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e1bdc000 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.667+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.667+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e1bdc000 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.668+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.668+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf400 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.668+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.668+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf000 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.668+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.668+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e0d45800 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.668+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.668+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e1bdc000 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.669+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.669+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e0d45800 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.669+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.669+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf400 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.669+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.669+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf000 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.669+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.669+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf000 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.670+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.670+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e1bdc000 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.670+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.670+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf000 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.670+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.670+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf000 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.670+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.670+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e0d45800 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.671+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.671+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e0d45800 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.671+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.671+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e1bdc000 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.671+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.671+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf000 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.671+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.671+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf400 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.672+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.672+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e0d45800 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.672+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.672+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e1bdc000 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.672+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.672+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf000 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.672+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.672+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e1bdc000 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.673+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.673+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf400 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.673+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.673+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf000 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.673+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.673+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e1bdc000 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.673+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.673+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e0d45800 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf400 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e0d45c00 con 0x5558e0d45800 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdcc00 con 0x5558e0d45800 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.674+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdd000 con 0x5558e10cf400 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 20 zone default found 2024-04-19T23:45:35.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 4 Realm: () 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 20 zonegroup default 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdd400 con 0x5558e1bdc000 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdd800 con 0x5558e10cf000 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.675+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bddc00 con 0x5558e10cf000 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.676+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.676+0000 7f3255022a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.676+0000 7f3255022a80 20 started sync module instance, tier type = 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.676+0000 7f3255022a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.676+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdcc00 con 0x5558e10cf400 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.677+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.677+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93840220502784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e0d45c00 con 0x5558e10cf400 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.677+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cf800 con 0x5558e0d45800 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.678+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93840220502784] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.678+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.678+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93840220503936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cfc00 con 0x5558e0d45800 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.678+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e10cf000 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.680+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.680+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93840220503936] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.680+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93840220505088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdd000 con 0x5558e10cf000 2024-04-19T23:45:35.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.680+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdcc00 con 0x5558e10cf400 2024-04-19T23:45:35.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.681+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93840220505088] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.686+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.686+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93840220506240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc400 con 0x5558e10cf400 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.686+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdd800 con 0x5558e0d45800 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.687+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93840220506240] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.689+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.689+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93840220507392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bddc00 con 0x5558e0d45800 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.689+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdc800 con 0x5558e1bdc000 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.690+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93840220507392] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.691+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.691+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93840220508544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdd400 con 0x5558e1bdc000 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.691+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdd800 con 0x5558e1bdc000 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.692+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93840220508544] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.693+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.693+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93840220509696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bddc00 con 0x5558e1bdc000 2024-04-19T23:45:35.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.693+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cf800 con 0x5558e1bdc000 2024-04-19T23:45:35.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.694+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.694+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93840220509696] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.694+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93840220510848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cfc00 con 0x5558e1bdc000 2024-04-19T23:45:35.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.694+0000 7f3255022a80 20 add_watcher() i=0 2024-04-19T23:45:35.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.694+0000 7f3255022a80 20 add_watcher() i=1 2024-04-19T23:45:35.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.694+0000 7f3255022a80 20 add_watcher() i=2 2024-04-19T23:45:35.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.694+0000 7f3255022a80 20 add_watcher() i=3 2024-04-19T23:45:35.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.694+0000 7f3255022a80 20 add_watcher() i=4 2024-04-19T23:45:35.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.694+0000 7f3255022a80 20 add_watcher() i=5 2024-04-19T23:45:35.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.694+0000 7f3255022a80 20 add_watcher() i=6 2024-04-19T23:45:35.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.697+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93840220510848] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.697+0000 7f3255022a80 20 add_watcher() i=7 2024-04-19T23:45:35.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.697+0000 7f3255022a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:35.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.697+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cf800 con 0x5558e0d45800 2024-04-19T23:45:35.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.697+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.697+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93840222027776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cfc00 con 0x5558e0d45800 2024-04-19T23:45:35.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.701+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93840222027776] v30'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.701+0000 7f3239f9a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:35.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.701+0000 7f3255022a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:35.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.701+0000 7f3255022a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:35.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.701+0000 7f3255022a80 1 Processor -- start 2024-04-19T23:45:35.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.701+0000 7f3255022a80 1 -- start start 2024-04-19T23:45:35.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.701+0000 7f3255022a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.701+0000 7f3255022a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e0de63c0 con 0x5558e1bdd400 2024-04-19T23:45:35.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.702+0000 7f32527cb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.702+0000 7f32527cb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33418/0 (socket says 172.21.15.155:33418) 2024-04-19T23:45:35.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.702+0000 7f32527cb700 1 -- 172.21.15.155:0/166966398 learned_addr learned my addr 172.21.15.155:0/166966398 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.702+0000 7f32527cb700 1 -- 172.21.15.155:0/166966398 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558e0d6cb60 con 0x5558e1bdd400 2024-04-19T23:45:35.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.702+0000 7f32527cb700 1 --2- 172.21.15.155:0/166966398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5558e11a00c0 tx=0x5558e1091680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7dec46aa501a7c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.702+0000 7f3239799700 1 -- 172.21.15.155:0/166966398 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e11b2000 con 0x5558e1bdd400 2024-04-19T23:45:35.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.702+0000 7f3239799700 1 -- 172.21.15.155:0/166966398 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558e11b4000 con 0x5558e1bdd400 2024-04-19T23:45:35.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.702+0000 7f3239799700 1 -- 172.21.15.155:0/166966398 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e11b2160 con 0x5558e1bdd400 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.703+0000 7f3255022a80 1 -- 172.21.15.155:0/166966398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 msgr2=0x5558e102e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.703+0000 7f3255022a80 1 --2- 172.21.15.155:0/166966398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5558e11a00c0 tx=0x5558e1091680 comp rx=0 tx=0).stop 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.703+0000 7f3255022a80 1 -- 172.21.15.155:0/166966398 shutdown_connections 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.703+0000 7f3255022a80 1 --2- 172.21.15.155:0/166966398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.703+0000 7f3255022a80 1 -- 172.21.15.155:0/166966398 >> 172.21.15.155:0/166966398 conn(0x5558e1bdc800 msgr2=0x5558e0e32000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.703+0000 7f3255022a80 1 -- 172.21.15.155:0/166966398 shutdown_connections 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.703+0000 7f3255022a80 1 -- 172.21.15.155:0/166966398 wait complete. 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.703+0000 7f3255022a80 1 Processor -- start 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.704+0000 7f3255022a80 1 -- start start 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.704+0000 7f3255022a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.704+0000 7f3255022a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e0de6500 con 0x5558e1bdd400 2024-04-19T23:45:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.704+0000 7f32527cb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.704+0000 7f32527cb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33420/0 (socket says 172.21.15.155:33420) 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.704+0000 7f32527cb700 1 -- 172.21.15.155:0/860026261 learned_addr learned my addr 172.21.15.155:0/860026261 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.704+0000 7f32527cb700 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558e0d6cd00 con 0x5558e1bdd400 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.704+0000 7f32527cb700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5558e11a1380 tx=0x5558e10917a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.704+0000 7f3237f96700 1 -- 172.21.15.155:0/860026261 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e11b22c0 con 0x5558e1bdd400 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.705+0000 7f3237f96700 1 -- 172.21.15.155:0/860026261 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558e11b4180 con 0x5558e1bdd400 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.705+0000 7f3237f96700 1 -- 172.21.15.155:0/860026261 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5558e11b2000 con 0x5558e1bdd400 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.705+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5558e0d6c340 con 0x5558e1bdd400 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.705+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558e0d6cb60 con 0x5558e1bdd400 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.705+0000 7f3237f96700 1 -- 172.21.15.155:0/860026261 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5558e1ae7b80 con 0x5558e1bdd400 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.705+0000 7f3237f96700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e1232000 0x5558e102f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.705+0000 7f3237f96700 1 -- 172.21.15.155:0/860026261 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5558e0dbf500 con 0x5558e1bdd400 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.706+0000 7f32537cd700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e1232000 0x5558e102f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.706+0000 7f3255022a80 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5558e1bdd800 0x5558e1248000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.706+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bddc00 con 0x5558e1bdd800 2024-04-19T23:45:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.706+0000 7f3252fcc700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5558e1bdd800 0x5558e1248000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.706+0000 7f32537cd700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e1232000 0x5558e102f700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x5558e1bd66c0 tx=0x5558e10914a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.706+0000 7f3252fcc700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5558e1bdd800 0x5558e1248000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.707+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1bdd800 2024-04-19T23:45:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.707+0000 7f3255022a80 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5558e1232400 0x5558e1248580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.707+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1232800 con 0x5558e1232400 2024-04-19T23:45:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.707+0000 7f32527cb700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5558e1232400 0x5558e1248580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.708+0000 7f32527cb700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5558e1232400 0x5558e1248580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.710+0000 7f32527cb700 1 -- 172.21.15.155:0/860026261 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e1232400 2024-04-19T23:45:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.710+0000 7f3255022a80 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5558e1232c00 0x5558e1248b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.710+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1233000 con 0x5558e1232c00 2024-04-19T23:45:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.710+0000 7f32537cd700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5558e1232c00 0x5558e1248b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.710+0000 7f32537cd700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5558e1232c00 0x5558e1248b00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.711+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.711+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1233400 con 0x5558e1bdd800 2024-04-19T23:45:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.713+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1bdd800 2024-04-19T23:45:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.713+0000 7f3255022a80 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5558e1233800 0x5558e1249080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.713+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1233c00 con 0x5558e1233800 2024-04-19T23:45:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.714+0000 7f3252fcc700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5558e1233800 0x5558e1249080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.714+0000 7f3252fcc700 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5558e1233800 0x5558e1249080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.715+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1233800 2024-04-19T23:45:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.715+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125a000 con 0x5558e1232c00 2024-04-19T23:45:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.716+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'13 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.716+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125a400 con 0x5558e1bdd800 2024-04-19T23:45:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.718+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1bdd800 2024-04-19T23:45:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.718+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125a800 con 0x5558e1232400 2024-04-19T23:45:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.720+0000 7f32527cb700 1 -- 172.21.15.155:0/860026261 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'13 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e1232400 2024-04-19T23:45:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.720+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125ac00 con 0x5558e1233800 2024-04-19T23:45:35.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.723+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1233800 2024-04-19T23:45:35.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.723+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125b000 con 0x5558e1232c00 2024-04-19T23:45:35.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.724+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'16 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.724+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125b400 con 0x5558e1233800 2024-04-19T23:45:35.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.725+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1233800 2024-04-19T23:45:35.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.725+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125b800 con 0x5558e1232400 2024-04-19T23:45:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.726+0000 7f32527cb700 1 -- 172.21.15.155:0/860026261 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e1232400 2024-04-19T23:45:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.726+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125bc00 con 0x5558e1233800 2024-04-19T23:45:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.727+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1233800 2024-04-19T23:45:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.727+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125a800 con 0x5558e1232400 2024-04-19T23:45:35.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.729+0000 7f32527cb700 1 -- 172.21.15.155:0/860026261 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'19 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e1232400 2024-04-19T23:45:35.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.729+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125a400 con 0x5558e1bdd800 2024-04-19T23:45:35.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.730+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1bdd800 2024-04-19T23:45:35.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.730+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1232800 con 0x5558e1232c00 2024-04-19T23:45:35.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.732+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'14 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.732+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1233400 con 0x5558e1233800 2024-04-19T23:45:35.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.733+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'22 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1233800 2024-04-19T23:45:35.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.733+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1233c00 con 0x5558e1232c00 2024-04-19T23:45:35.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.734+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.734+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdcc00 con 0x5558e1bdd800 2024-04-19T23:45:35.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.736+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1bdd800 2024-04-19T23:45:35.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.736+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdd000 con 0x5558e1bdd800 2024-04-19T23:45:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.739+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'29 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1bdd800 2024-04-19T23:45:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.739+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bddc00 con 0x5558e1232c00 2024-04-19T23:45:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.740+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'15 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.740+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e0d45c00 con 0x5558e1233800 2024-04-19T23:45:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.741+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1233800 2024-04-19T23:45:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.741+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1233400 con 0x5558e1232c00 2024-04-19T23:45:35.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.744+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.744+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1233000 con 0x5558e1232c00 2024-04-19T23:45:35.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.745+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'16 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.745+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1232800 con 0x5558e1232c00 2024-04-19T23:45:35.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.745+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.746+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1233c00 con 0x5558e1232c00 2024-04-19T23:45:35.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.748+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'14 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.748+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125ac00 con 0x5558e1232400 2024-04-19T23:45:35.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.750+0000 7f32527cb700 1 -- 172.21.15.155:0/860026261 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e1232400 2024-04-19T23:45:35.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.750+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125b400 con 0x5558e1232c00 2024-04-19T23:45:35.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.752+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.752+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125bc00 con 0x5558e1232400 2024-04-19T23:45:35.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.753+0000 7f32527cb700 1 -- 172.21.15.155:0/860026261 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'14 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e1232400 2024-04-19T23:45:35.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.753+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125a400 con 0x5558e1232c00 2024-04-19T23:45:35.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.756+0000 7f32537cd700 1 -- 172.21.15.155:0/860026261 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1232c00 2024-04-19T23:45:35.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.756+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125a000 con 0x5558e1232400 2024-04-19T23:45:35.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.759+0000 7f32527cb700 1 -- 172.21.15.155:0/860026261 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e1232400 2024-04-19T23:45:35.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.759+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125b000 con 0x5558e1233800 2024-04-19T23:45:35.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.761+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e1233800 2024-04-19T23:45:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.762+0000 7f3235791700 20 reqs_thread_entry: start 2024-04-19T23:45:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.762+0000 7f3255022a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.763+0000 7f3255022a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.763+0000 7f323378d700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:06 2024 2024-04-19T23:45:35.763 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.763+0000 7f3232f6b700 20 reqs_thread_entry: start 2024-04-19T23:45:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.763+0000 7f3255022a80 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-19T23:45:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.763+0000 7f3255022a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.763+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e10cfc00 con 0x5558e10cf400 2024-04-19T23:45:35.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.763+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(62 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.763+0000 7f3255022a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.763+0000 7f3255022a80 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-04-19T23:45:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.763+0000 7f3255022a80 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-19T23:45:35.764 INFO:teuthology.orchestra.run.smithi155.stderr:could not remove user: unable to remove user, user does not exist 2024-04-19T23:45:35.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.763+0000 7f3239f9a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:35.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.764+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93840222027776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bdcc00 con 0x5558e0d45800 2024-04-19T23:45:35.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.765+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93840222027776] v30'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.765+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93840220502784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125b400 con 0x5558e10cf400 2024-04-19T23:45:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.765+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93840220502784] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.766+0000 7f3255022a80 20 remove_watcher() i=0 2024-04-19T23:45:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.766+0000 7f3255022a80 2 removed watcher, disabling cache 2024-04-19T23:45:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.766+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93840220503936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125a400 con 0x5558e0d45800 2024-04-19T23:45:35.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.767+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93840220503936] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.767+0000 7f3255022a80 20 remove_watcher() i=1 2024-04-19T23:45:35.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.767+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93840220505088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125b800 con 0x5558e10cf000 2024-04-19T23:45:35.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.770+0000 7f3252fcc700 1 -- 172.21.15.155:0/2908379143 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93840220505088] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117f200 con 0x5558e10cf000 2024-04-19T23:45:35.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.770+0000 7f3255022a80 20 remove_watcher() i=2 2024-04-19T23:45:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.770+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93840220506240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125a800 con 0x5558e10cf400 2024-04-19T23:45:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.770+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93840220506240] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117f440 con 0x5558e10cf400 2024-04-19T23:45:35.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.770+0000 7f3255022a80 20 remove_watcher() i=3 2024-04-19T23:45:35.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.770+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93840220507392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125ac00 con 0x5558e0d45800 2024-04-19T23:45:35.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.772+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93840220507392] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e0d45800 2024-04-19T23:45:35.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.772+0000 7f3255022a80 20 remove_watcher() i=4 2024-04-19T23:45:35.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.772+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93840220508544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125bc00 con 0x5558e1bdc000 2024-04-19T23:45:35.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.775+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93840220508544] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.775+0000 7f3255022a80 20 remove_watcher() i=5 2024-04-19T23:45:35.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.775+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93840220509696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e125a000 con 0x5558e1bdc000 2024-04-19T23:45:35.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.777+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93840220509696] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.777+0000 7f3255022a80 20 remove_watcher() i=6 2024-04-19T23:45:35.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.777+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93840220510848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5558e1bddc00 con 0x5558e1bdc000 2024-04-19T23:45:35.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f32537cd700 1 -- 172.21.15.155:0/2908379143 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93840220510848] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5558e117eb40 con 0x5558e1bdc000 2024-04-19T23:45:35.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 20 remove_watcher() i=7 2024-04-19T23:45:35.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5558e1bdc000 msgr2=0x5558e102f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5558e1bdc000 0x5558e102f180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5558e0d45800 msgr2=0x5558e102db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5558e0d45800 0x5558e102db80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5558e10cf400 msgr2=0x5558e102ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5558e10cf400 0x5558e102ec00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5558e10cf000 msgr2=0x5558e102e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5558e10cf000 0x5558e102e100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e10cec00 msgr2=0x5558e102d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e10cec00 0x5558e102d600 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x5558e1bd7e00 tx=0x5558e1090600 comp rx=0 tx=0).stop 2024-04-19T23:45:35.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 msgr2=0x5558e102cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 --2- 172.21.15.155:0/2908379143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d45400 0x5558e102cb00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5558e10d1e00 tx=0x5558e10905a0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 reap_dead start 2024-04-19T23:45:35.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f32527cb700 1 -- 172.21.15.155:0/2908379143 reap_dead start 2024-04-19T23:45:35.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 shutdown_connections 2024-04-19T23:45:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.780+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 >> 172.21.15.155:0/2908379143 conn(0x5558e0d44c00 msgr2=0x5558e0e31800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 shutdown_connections 2024-04-19T23:45:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/2908379143 wait complete. 2024-04-19T23:45:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5558e1232400 msgr2=0x5558e1248580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5558e1232400 0x5558e1248580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5558e1bdd800 msgr2=0x5558e1248000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5558e1bdd800 0x5558e1248000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5558e1233800 msgr2=0x5558e1249080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5558e1233800 0x5558e1249080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5558e1232c00 msgr2=0x5558e1248b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5558e1232c00 0x5558e1248b00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e1232000 msgr2=0x5558e102f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e1232000 0x5558e102f700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x5558e1bd66c0 tx=0x5558e10914a0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 msgr2=0x5558e102e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5558e11a1380 tx=0x5558e10917a0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3252fcc700 1 -- 172.21.15.155:0/860026261 reap_dead start 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 shutdown_connections 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 --2- 172.21.15.155:0/860026261 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e1bdd400 0x5558e102e680 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 >> 172.21.15.155:0/860026261 conn(0x5558e1bdc800 msgr2=0x5558e0e32000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 shutdown_connections 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/860026261 wait complete. 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/2391998821 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e10ce000 msgr2=0x5558e102d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 --2- 172.21.15.155:0/2391998821 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e10ce000 0x5558e102d080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x5558e1bd6f00 tx=0x5558e1090540 comp rx=0 tx=0).stop 2024-04-19T23:45:35.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/2391998821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 msgr2=0x5558e102c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 --2- 172.21.15.155:0/2391998821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5558e1b1d950 tx=0x5558e0e35920 comp rx=0 tx=0).stop 2024-04-19T23:45:35.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/2391998821 shutdown_connections 2024-04-19T23:45:35.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 --2- 172.21.15.155:0/2391998821 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5558e10ce000 0x5558e102d080 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 --2- 172.21.15.155:0/2391998821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5558e0d44800 0x5558e102c580 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.781+0000 7f3255022a80 1 -- 172.21.15.155:0/2391998821 >> 172.21.15.155:0/2391998821 conn(0x5558e0d44400 msgr2=0x5558e0e31000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.782+0000 7f3255022a80 1 -- 172.21.15.155:0/2391998821 shutdown_connections 2024-04-19T23:45:35.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.782+0000 7f3255022a80 1 -- 172.21.15.155:0/2391998821 wait complete. 2024-04-19T23:45:35.788 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-19T23:45:35.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-04-19T23:45:35.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-04-19T23:45:35.789 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-04-19T23:45:35.834 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:35.834 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:35.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.834+0000 7fd3e646ea80 1 Processor -- start 2024-04-19T23:45:35.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.835+0000 7fd3e646ea80 1 -- start start 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.835+0000 7fd3e646ea80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55ab2e77ec00 0x55ab2ea66580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.835+0000 7fd3e646ea80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ab2eaa9500 con 0x55ab2e77e800 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.835+0000 7fd3e646ea80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ab2e820a00 con 0x55ab2e77ec00 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.835+0000 7fd3e3c17700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55ab2e77ec00 0x55ab2ea66580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.835+0000 7fd3e4418700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55ab2e77e800 0x55ab2e86a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46442/0 (socket says 172.21.15.155:46442) 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.835+0000 7fd3e3c17700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55ab2e77ec00 0x55ab2ea66580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33434/0 (socket says 172.21.15.155:33434) 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.835+0000 7fd3e4418700 1 -- 172.21.15.155:0/4258140427 learned_addr learned my addr 172.21.15.155:0/4258140427 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.835+0000 7fd3e3c17700 1 -- 172.21.15.155:0/4258140427 >> v1:172.21.15.76:6789/0 conn(0x55ab2e77e800 legacy=0x55ab2e86a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.835+0000 7fd3e3c17700 1 -- 172.21.15.155:0/4258140427 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab2e7a7d40 con 0x55ab2e77ec00 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.835+0000 7fd3e3c17700 1 --2- 172.21.15.155:0/4258140427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77ec00 0x55ab2ea66580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55ab2ea61890 tx=0x55ab2e86f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0dd568ae36ea75 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.836+0000 7fd3e3416700 1 -- 172.21.15.155:0/4258140427 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2e8374a0 con 0x55ab2e77ec00 2024-04-19T23:45:35.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.836+0000 7fd3e3416700 1 -- 172.21.15.155:0/4258140427 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab2eaa9800 con 0x55ab2e77ec00 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.836+0000 7fd3e3416700 1 -- 172.21.15.155:0/4258140427 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2e837600 con 0x55ab2e77ec00 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.836+0000 7fd3e646ea80 1 -- 172.21.15.155:0/4258140427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77ec00 msgr2=0x55ab2ea66580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.836+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/4258140427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77ec00 0x55ab2ea66580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55ab2ea61890 tx=0x55ab2e86f920 comp rx=0 tx=0).stop 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.836+0000 7fd3e646ea80 1 -- 172.21.15.155:0/4258140427 shutdown_connections 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.836+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/4258140427 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77ec00 0x55ab2ea66580 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.836+0000 7fd3e646ea80 1 -- 172.21.15.155:0/4258140427 >> 172.21.15.155:0/4258140427 conn(0x55ab2e77e400 msgr2=0x55ab2e86a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.836+0000 7fd3e646ea80 1 -- 172.21.15.155:0/4258140427 shutdown_connections 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.836+0000 7fd3e646ea80 1 -- 172.21.15.155:0/4258140427 wait complete. 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.837+0000 7fd3e646ea80 1 Processor -- start 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.837+0000 7fd3e646ea80 1 -- start start 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.837+0000 7fd3e646ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.837+0000 7fd3e646ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2e820500 con 0x55ab2e77e800 2024-04-19T23:45:35.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.837+0000 7fd3e4418700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.837+0000 7fd3e4418700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33446/0 (socket says 172.21.15.155:33446) 2024-04-19T23:45:35.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.837+0000 7fd3e4418700 1 -- 172.21.15.155:0/2636610633 learned_addr learned my addr 172.21.15.155:0/2636610633 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.837+0000 7fd3e4418700 1 -- 172.21.15.155:0/2636610633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab2e7a7ba0 con 0x55ab2e77e800 2024-04-19T23:45:35.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e4418700 1 --2- 172.21.15.155:0/2636610633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55ab2f557890 tx=0x55ab2e86fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7652ad928401a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e2c15700 1 -- 172.21.15.155:0/2636610633 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2e8371e0 con 0x55ab2e77e800 2024-04-19T23:45:35.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e2c15700 1 -- 172.21.15.155:0/2636610633 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab2eaa9b00 con 0x55ab2e77e800 2024-04-19T23:45:35.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e2c15700 1 -- 172.21.15.155:0/2636610633 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2e8374a0 con 0x55ab2e77e800 2024-04-19T23:45:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2636610633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 msgr2=0x55ab2ea66580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2636610633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55ab2f557890 tx=0x55ab2e86fb60 comp rx=0 tx=0).stop 2024-04-19T23:45:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2636610633 shutdown_connections 2024-04-19T23:45:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2636610633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2636610633 >> 172.21.15.155:0/2636610633 conn(0x55ab2e77e400 msgr2=0x55ab2e86b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2636610633 shutdown_connections 2024-04-19T23:45:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2636610633 wait complete. 2024-04-19T23:45:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.838+0000 7fd3e646ea80 1 Processor -- start 2024-04-19T23:45:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e646ea80 1 -- start start 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e646ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e646ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2e8203c0 con 0x55ab2e77e800 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e4418700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e4418700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33462/0 (socket says 172.21.15.155:33462) 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e4418700 1 -- 172.21.15.155:0/2608164344 learned_addr learned my addr 172.21.15.155:0/2608164344 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e4418700 1 -- 172.21.15.155:0/2608164344 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab2e7a7a00 con 0x55ab2e77e800 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e4418700 1 --2- 172.21.15.155:0/2608164344 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55ab2f557ad0 tx=0x55ab2e86fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e1412700 1 -- 172.21.15.155:0/2608164344 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2e837600 con 0x55ab2e77e800 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e1412700 1 -- 172.21.15.155:0/2608164344 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab2e81fc80 con 0x55ab2e77e800 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2608164344 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ab2e7a7860 con 0x55ab2e77e800 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.839+0000 7fd3e1412700 1 -- 172.21.15.155:0/2608164344 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2e8371e0 con 0x55ab2e77e800 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.840+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2608164344 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab2e7a76c0 con 0x55ab2e77e800 2024-04-19T23:45:35.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.840+0000 7fd3e646ea80 1 Processor -- start 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.840+0000 7fd3e646ea80 1 -- start start 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.840+0000 7fd3e1412700 1 -- 172.21.15.155:0/2608164344 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ab2f520b00 con 0x55ab2e77e800 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.840+0000 7fd3e646ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 0x55ab2ea66b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.840+0000 7fd3e646ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2e7ba640 con 0x55ab2e77f400 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.840+0000 7fd3e1412700 1 --2- 172.21.15.155:0/2608164344 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2eb0a000 0x55ab2ea67080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.840+0000 7fd3e1412700 1 -- 172.21.15.155:0/2608164344 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ab2e7f9180 con 0x55ab2e77e800 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.841+0000 7fd3e4c19700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 0x55ab2ea66b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.841+0000 7fd3e4418700 1 --2- 172.21.15.155:0/2608164344 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2eb0a000 0x55ab2ea67080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.841+0000 7fd3e4c19700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 0x55ab2ea66b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33470/0 (socket says 172.21.15.155:33470) 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.841+0000 7fd3e4c19700 1 -- 172.21.15.155:0/1601006606 learned_addr learned my addr 172.21.15.155:0/1601006606 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.841+0000 7fd3e4c19700 1 -- 172.21.15.155:0/1601006606 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab2e7a6000 con 0x55ab2e77f400 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.841+0000 7fd3e4418700 1 --2- 172.21.15.155:0/2608164344 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2eb0a000 0x55ab2ea67080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55ab2f5fcab0 tx=0x55ab2ead0240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.841+0000 7fd3e4c19700 1 --2- 172.21.15.155:0/1601006606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 0x55ab2ea66b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55ab2f5fc6c0 tx=0x55ab2ead09c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d92cf5f4c925af server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.841+0000 7fd3dec0d700 1 -- 172.21.15.155:0/1601006606 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2e837600 con 0x55ab2e77f400 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.841+0000 7fd3dec0d700 1 -- 172.21.15.155:0/1601006606 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab2eaa8300 con 0x55ab2e77f400 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.841+0000 7fd3dec0d700 1 -- 172.21.15.155:0/1601006606 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2e8371e0 con 0x55ab2e77f400 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e646ea80 1 -- 172.21.15.155:0/1601006606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 msgr2=0x55ab2ea66b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/1601006606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 0x55ab2ea66b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55ab2f5fc6c0 tx=0x55ab2ead09c0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e646ea80 1 -- 172.21.15.155:0/1601006606 shutdown_connections 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/1601006606 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 0x55ab2ea66b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e646ea80 1 -- 172.21.15.155:0/1601006606 >> 172.21.15.155:0/1601006606 conn(0x55ab2e77ec00 msgr2=0x55ab2e86b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e646ea80 1 -- 172.21.15.155:0/1601006606 shutdown_connections 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e646ea80 1 -- 172.21.15.155:0/1601006606 wait complete. 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e646ea80 1 Processor -- start 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e646ea80 1 -- start start 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e646ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 0x55ab2ea66b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e646ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2e7ba8c0 con 0x55ab2e77f400 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e4c19700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 0x55ab2ea66b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e4c19700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 0x55ab2ea66b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33482/0 (socket says 172.21.15.155:33482) 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.842+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 learned_addr learned my addr 172.21.15.155:0/2305902147 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.843+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab2e7a6ea0 con 0x55ab2e77f400 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.843+0000 7fd3e4c19700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 0x55ab2ea66b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55ab2f5fc4b0 tx=0x55ab2ead0120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.843+0000 7fd3dd40a700 1 -- 172.21.15.155:0/2305902147 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2e837a20 con 0x55ab2e77f400 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.843+0000 7fd3dd40a700 1 -- 172.21.15.155:0/2305902147 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab2e81fc80 con 0x55ab2e77f400 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.843+0000 7fd3dd40a700 1 -- 172.21.15.155:0/2305902147 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2e837600 con 0x55ab2e77f400 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.843+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ab2e7a6820 con 0x55ab2e77f400 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.843+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab2e7a69c0 con 0x55ab2e77f400 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.844+0000 7fd3dd40a700 1 -- 172.21.15.155:0/2305902147 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ab2f520dc0 con 0x55ab2e77f400 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.844+0000 7fd3dd40a700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2eb0ac00 0x55ab2ea67600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.844+0000 7fd3dd40a700 1 -- 172.21.15.155:0/2305902147 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ab2e7f9340 con 0x55ab2e77f400 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.844+0000 7fd3e3c17700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2eb0ac00 0x55ab2ea67600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.844+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.844+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ab2e77f800 0x55ab2ea67b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.844+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2e77fc00 con 0x55ab2e77f800 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.844+0000 7fd3e3c17700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2eb0ac00 0x55ab2ea67600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55ab2ea61890 tx=0x55ab2e86f800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.844+0000 7fd3e4c19700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ab2e77f800 0x55ab2ea67b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e4c19700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ab2e77f800 0x55ab2ea67b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e646ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e646ea80 20 realm 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0b000 con 0x55ab2e77f800 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e646ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e646ea80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0b400 con 0x55ab2e77f800 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e646ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.845+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0b800 con 0x55ab2e77f800 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.846+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.846+0000 7fd3e646ea80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.846+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.846+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0bc00 con 0x55ab2e77f800 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.846+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.846+0000 7fd3e646ea80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:35.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.846+0000 7fd3e646ea80 20 searching for the correct realm 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.846+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ab2eb0b000 0x55ab2ea68100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.846+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0b400 con 0x55ab2eb0b000 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.846+0000 7fd3e4418700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ab2eb0b000 0x55ab2ea68100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.846+0000 7fd3e4418700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ab2eb0b000 0x55ab2ea68100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.847+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.847+0000 7fd3e4418700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ab2eb0b400 0x55ab2ea68c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.847+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6000 con 0x55ab2eb0b400 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.847+0000 7fd3e3c17700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ab2eb0b400 0x55ab2ea68c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.847+0000 7fd3e3c17700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ab2eb0b400 0x55ab2ea68c00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.847+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.847+0000 7fd3e3c17700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ab2ebc6000 0x55ab2ea69180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.847+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2ebc6000 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.848+0000 7fd3e4c19700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ab2ebc6000 0x55ab2ea69180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.848+0000 7fd3e4c19700 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ab2ebc6000 0x55ab2ea69180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.849+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.849+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2e77f800 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.849+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.849+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2e77f800 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.849+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.849+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2ebc6000 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.850+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.850+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2ebc6000 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.850+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.850+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b400 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.850+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.850+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b000 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.850+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.850+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2e77f800 2024-04-19T23:45:35.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.850+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.850+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2ebc6000 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.851+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.851+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2e77f800 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.851+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.851+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b400 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.851+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.851+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b000 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.852+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.852+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b000 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.852+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.852+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2ebc6000 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.852+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.852+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b000 2024-04-19T23:45:35.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.852+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.852+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b000 2024-04-19T23:45:35.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.853+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.853+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2e77f800 2024-04-19T23:45:35.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.853+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.853+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2e77f800 2024-04-19T23:45:35.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.853+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.853+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2ebc6000 2024-04-19T23:45:35.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.854+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.854+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b000 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.854+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.854+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b400 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.854+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.854+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2e77f800 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.854+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.854+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2ebc6000 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.855+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.855+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b000 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.855+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.855+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2ebc6000 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.855+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.855+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b400 2024-04-19T23:45:35.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.855+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.855+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b000 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.856+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.856+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2ebc6000 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.856+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.856+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2e77f800 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b400 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:35.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2e77fc00 con 0x55ab2e77f800 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6c00 con 0x55ab2e77f800 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.857+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7000 con 0x55ab2eb0b400 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:35.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 20 zone default found 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 4 Realm: () 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 20 zonegroup default 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7400 con 0x55ab2ebc6000 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7800 con 0x55ab2eb0b000 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7c00 con 0x55ab2eb0b000 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 20 started sync module instance, tier type = 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.858+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6c00 con 0x55ab2eb0b400 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.859+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.860+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94193710390016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2e77fc00 con 0x55ab2eb0b400 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.860+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0b800 con 0x55ab2e77f800 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.860+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94193710390016] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.861+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.861+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94193710391168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0bc00 con 0x55ab2e77f800 2024-04-19T23:45:35.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.861+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2eb0b000 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.862+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.862+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94193710392320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7000 con 0x55ab2eb0b000 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.862+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6c00 con 0x55ab2eb0b400 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.862+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94193710391168] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.863+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.863+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94193710393472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6400 con 0x55ab2eb0b400 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.863+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7800 con 0x55ab2e77f800 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.864+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94193710392320] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.865+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.865+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94193710394624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7c00 con 0x55ab2e77f800 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.865+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6800 con 0x55ab2ebc6000 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.865+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94193710393472] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.866+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.866+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94193710395776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7400 con 0x55ab2ebc6000 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.866+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7800 con 0x55ab2ebc6000 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.866+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94193710394624] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.867+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.867+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94193710396928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7c00 con 0x55ab2ebc6000 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.867+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0b800 con 0x55ab2ebc6000 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.867+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94193710395776] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.868+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94193710396928] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.868+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.868+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94193710398080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0bc00 con 0x55ab2ebc6000 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.868+0000 7fd3e646ea80 20 add_watcher() i=0 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.868+0000 7fd3e646ea80 20 add_watcher() i=1 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.868+0000 7fd3e646ea80 20 add_watcher() i=2 2024-04-19T23:45:35.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.868+0000 7fd3e646ea80 20 add_watcher() i=3 2024-04-19T23:45:35.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.868+0000 7fd3e646ea80 20 add_watcher() i=4 2024-04-19T23:45:35.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.868+0000 7fd3e646ea80 20 add_watcher() i=5 2024-04-19T23:45:35.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.868+0000 7fd3e646ea80 20 add_watcher() i=6 2024-04-19T23:45:35.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.871+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94193710398080] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.871+0000 7fd3e646ea80 20 add_watcher() i=7 2024-04-19T23:45:35.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.871+0000 7fd3e646ea80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:35.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.871+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0b800 con 0x55ab2e77f800 2024-04-19T23:45:35.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.871+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.871+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94193711939584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0bc00 con 0x55ab2e77f800 2024-04-19T23:45:35.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.872+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94193711939584] v30'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.872+0000 7fd3cb3e6700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:35.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.873+0000 7fd3e646ea80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:35.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.873+0000 7fd3e646ea80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:35.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.873+0000 7fd3e646ea80 1 Processor -- start 2024-04-19T23:45:35.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.873+0000 7fd3e646ea80 1 -- start start 2024-04-19T23:45:35.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.873+0000 7fd3e646ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.873+0000 7fd3e646ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2e8203c0 con 0x55ab2ebc7400 2024-04-19T23:45:35.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.873+0000 7fd3e3c17700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.873+0000 7fd3e3c17700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33494/0 (socket says 172.21.15.155:33494) 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.873+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2626250592 learned_addr learned my addr 172.21.15.155:0/2626250592 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.874+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2626250592 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab2e7a6b60 con 0x55ab2ebc7400 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.874+0000 7fd3e3c17700 1 --2- 172.21.15.155:0/2626250592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55ab2eb5b6e0 tx=0x55ab2ead16e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801f99f2b4ebe690 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.874+0000 7fd3cabe5700 1 -- 172.21.15.155:0/2626250592 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2e837760 con 0x55ab2ebc7400 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.874+0000 7fd3cabe5700 1 -- 172.21.15.155:0/2626250592 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab2ebea000 con 0x55ab2ebc7400 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.874+0000 7fd3cabe5700 1 -- 172.21.15.155:0/2626250592 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2ebec000 con 0x55ab2ebc7400 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.875+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2626250592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 msgr2=0x55ab2ea68680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.875+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2626250592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55ab2eb5b6e0 tx=0x55ab2ead16e0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.875+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2626250592 shutdown_connections 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.875+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2626250592 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.875+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2626250592 >> 172.21.15.155:0/2626250592 conn(0x55ab2ebc6800 msgr2=0x55ab2e86c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.875+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2626250592 shutdown_connections 2024-04-19T23:45:35.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.875+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2626250592 wait complete. 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.875+0000 7fd3e646ea80 1 Processor -- start 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.875+0000 7fd3e646ea80 1 -- start start 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.875+0000 7fd3e646ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.875+0000 7fd3e646ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2e820500 con 0x55ab2ebc7400 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.876+0000 7fd3e3c17700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.876+0000 7fd3e3c17700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33504/0 (socket says 172.21.15.155:33504) 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.876+0000 7fd3e3c17700 1 -- 172.21.15.155:0/3052429424 learned_addr learned my addr 172.21.15.155:0/3052429424 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.876+0000 7fd3e3c17700 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab2e7a6d00 con 0x55ab2ebc7400 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.876+0000 7fd3e3c17700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55ab2ebdd230 tx=0x55ab2ead1800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.876+0000 7fd3c93e2700 1 -- 172.21.15.155:0/3052429424 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2ebec160 con 0x55ab2ebc7400 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.876+0000 7fd3c93e2700 1 -- 172.21.15.155:0/3052429424 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab2ebea180 con 0x55ab2ebc7400 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.876+0000 7fd3c93e2700 1 -- 172.21.15.155:0/3052429424 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab2ebec2c0 con 0x55ab2ebc7400 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.876+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ab2e7a6340 con 0x55ab2ebc7400 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.876+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab2e7a7d40 con 0x55ab2ebc7400 2024-04-19T23:45:35.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.877+0000 7fd3c93e2700 1 -- 172.21.15.155:0/3052429424 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ab2f521b80 con 0x55ab2ebc7400 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.877+0000 7fd3c93e2700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2ec6a000 0x55ab2ea69700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.877+0000 7fd3c93e2700 1 -- 172.21.15.155:0/3052429424 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ab2e7f9500 con 0x55ab2ebc7400 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.877+0000 7fd3e4c19700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2ec6a000 0x55ab2ea69700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.877+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ab2ebc7800 0x55ab2ec80000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.878+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7c00 con 0x55ab2ebc7800 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.878+0000 7fd3e4418700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ab2ebc7800 0x55ab2ec80000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.878+0000 7fd3e4c19700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2ec6a000 0x55ab2ea69700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55ab2eb5b710 tx=0x55ab2ead0a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.878+0000 7fd3e4418700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ab2ebc7800 0x55ab2ec80000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.879+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ebc7800 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.879+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ab2ec6a400 0x55ab2ec80580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.879+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec6a800 con 0x55ab2ec6a400 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.879+0000 7fd3e3c17700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ab2ec6a400 0x55ab2ec80580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.880+0000 7fd3e3c17700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ab2ec6a400 0x55ab2ec80580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.881+0000 7fd3e3c17700 1 -- 172.21.15.155:0/3052429424 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2ec6a400 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.881+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ab2ec6ac00 0x55ab2ec80b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.881+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec6b000 con 0x55ab2ec6ac00 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.881+0000 7fd3e4c19700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ab2ec6ac00 0x55ab2ec80b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.881+0000 7fd3e4c19700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ab2ec6ac00 0x55ab2ec80b00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.882+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.882+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec6b400 con 0x55ab2ebc7800 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.883+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'32 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ebc7800 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.883+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ab2ec6b800 0x55ab2ec81080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.883+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec6bc00 con 0x55ab2ec6b800 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.883+0000 7fd3e4418700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ab2ec6b800 0x55ab2ec81080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.884+0000 7fd3e4418700 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ab2ec6b800 0x55ab2ec81080 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.886+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ec6b800 2024-04-19T23:45:35.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.886+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8c000 con 0x55ab2ec6ac00 2024-04-19T23:45:35.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.889+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'15 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.889+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8c400 con 0x55ab2ebc7800 2024-04-19T23:45:35.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.890+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ebc7800 2024-04-19T23:45:35.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.890+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8c800 con 0x55ab2ec6a400 2024-04-19T23:45:35.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.891+0000 7fd3e3c17700 1 -- 172.21.15.155:0/3052429424 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'15 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2ec6a400 2024-04-19T23:45:35.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.891+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8cc00 con 0x55ab2ec6b800 2024-04-19T23:45:35.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.892+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ec6b800 2024-04-19T23:45:35.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.892+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8d000 con 0x55ab2ec6ac00 2024-04-19T23:45:35.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.893+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.893+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8d400 con 0x55ab2ec6b800 2024-04-19T23:45:35.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.894+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ec6b800 2024-04-19T23:45:35.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.894+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8d800 con 0x55ab2ec6a400 2024-04-19T23:45:35.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.896+0000 7fd3e3c17700 1 -- 172.21.15.155:0/3052429424 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2ec6a400 2024-04-19T23:45:35.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.896+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8dc00 con 0x55ab2ec6b800 2024-04-19T23:45:35.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.897+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ec6b800 2024-04-19T23:45:35.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.897+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8c800 con 0x55ab2ec6a400 2024-04-19T23:45:35.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.898+0000 7fd3e3c17700 1 -- 172.21.15.155:0/3052429424 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'21 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2ec6a400 2024-04-19T23:45:35.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.898+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8c400 con 0x55ab2ebc7800 2024-04-19T23:45:35.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.899+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'33 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ebc7800 2024-04-19T23:45:35.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.899+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec6a800 con 0x55ab2ec6ac00 2024-04-19T23:45:35.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.900+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.900+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec6b400 con 0x55ab2ec6b800 2024-04-19T23:45:35.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.901+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'25 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ec6b800 2024-04-19T23:45:35.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.901+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec6bc00 con 0x55ab2ec6ac00 2024-04-19T23:45:35.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.902+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.902+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6c00 con 0x55ab2ebc7800 2024-04-19T23:45:35.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.903+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ebc7800 2024-04-19T23:45:35.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.903+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7000 con 0x55ab2ebc7800 2024-04-19T23:45:35.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.904+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'34 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ebc7800 2024-04-19T23:45:35.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.904+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc7c00 con 0x55ab2ec6ac00 2024-04-19T23:45:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.907+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'18 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.907+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2e77fc00 con 0x55ab2ec6b800 2024-04-19T23:45:35.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.908+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ec6b800 2024-04-19T23:45:35.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.908+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec6b400 con 0x55ab2ec6ac00 2024-04-19T23:45:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.909+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.909+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec6b000 con 0x55ab2ec6ac00 2024-04-19T23:45:35.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.912+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.912+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec6a800 con 0x55ab2ec6ac00 2024-04-19T23:45:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.913+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.913+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec6bc00 con 0x55ab2ec6ac00 2024-04-19T23:45:35.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.916+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.916+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8cc00 con 0x55ab2ec6a400 2024-04-19T23:45:35.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.917+0000 7fd3e3c17700 1 -- 172.21.15.155:0/3052429424 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2ec6a400 2024-04-19T23:45:35.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.917+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8d400 con 0x55ab2ec6ac00 2024-04-19T23:45:35.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.918+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.918+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8dc00 con 0x55ab2ec6a400 2024-04-19T23:45:35.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.919+0000 7fd3e3c17700 1 -- 172.21.15.155:0/3052429424 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2ec6a400 2024-04-19T23:45:35.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.919+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8c400 con 0x55ab2ec6ac00 2024-04-19T23:45:35.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.920+0000 7fd3e4c19700 1 -- 172.21.15.155:0/3052429424 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ec6ac00 2024-04-19T23:45:35.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.920+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8c000 con 0x55ab2ec6a400 2024-04-19T23:45:35.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.921+0000 7fd3e3c17700 1 -- 172.21.15.155:0/3052429424 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2ec6a400 2024-04-19T23:45:35.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.921+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8d000 con 0x55ab2ec6b800 2024-04-19T23:45:35.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.923+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2ec6b800 2024-04-19T23:45:35.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3c6bdd700 20 reqs_thread_entry: start 2024-04-19T23:45:35.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3e646ea80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:35.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3e646ea80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:35.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3c4bd9700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:06 2024 2024-04-19T23:45:35.925 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:35.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3c43b7700 20 reqs_thread_entry: start 2024-04-19T23:45:35.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3e646ea80 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-19T23:45:35.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3e646ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:35.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0bc00 con 0x55ab2ebc6000 2024-04-19T23:45:35.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3e646ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:35.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3e646ea80 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-19T23:45:35.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.924+0000 7fd3e646ea80 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-19T23:45:35.925 INFO:teuthology.orchestra.run.smithi155.stderr:could not remove user: unable to remove user, user does not exist 2024-04-19T23:45:35.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.925+0000 7fd3cb3e6700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:35.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.925+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94193711939584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ebc6c00 con 0x55ab2e77f800 2024-04-19T23:45:35.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.927+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94193711939584] v30'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.927+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94193710390016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8d400 con 0x55ab2eb0b400 2024-04-19T23:45:35.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.928+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94193710390016] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.928+0000 7fd3e646ea80 20 remove_watcher() i=0 2024-04-19T23:45:35.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.928+0000 7fd3e646ea80 2 removed watcher, disabling cache 2024-04-19T23:45:35.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.928+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94193710391168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8c400 con 0x55ab2e77f800 2024-04-19T23:45:35.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.929+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94193710391168] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.929+0000 7fd3e646ea80 20 remove_watcher() i=1 2024-04-19T23:45:35.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.929+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94193710392320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8d800 con 0x55ab2eb0b000 2024-04-19T23:45:35.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.930+0000 7fd3e4418700 1 -- 172.21.15.155:0/2305902147 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94193710392320] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbf200 con 0x55ab2eb0b000 2024-04-19T23:45:35.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.930+0000 7fd3e646ea80 20 remove_watcher() i=2 2024-04-19T23:45:35.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.930+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94193710393472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8c800 con 0x55ab2eb0b400 2024-04-19T23:45:35.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.931+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94193710393472] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbf440 con 0x55ab2eb0b400 2024-04-19T23:45:35.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.931+0000 7fd3e646ea80 20 remove_watcher() i=3 2024-04-19T23:45:35.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.931+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94193710394624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8cc00 con 0x55ab2e77f800 2024-04-19T23:45:35.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.933+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94193710394624] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2e77f800 2024-04-19T23:45:35.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.933+0000 7fd3e646ea80 20 remove_watcher() i=4 2024-04-19T23:45:35.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.933+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94193710395776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8dc00 con 0x55ab2ebc6000 2024-04-19T23:45:35.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.934+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94193710395776] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.934+0000 7fd3e646ea80 20 remove_watcher() i=5 2024-04-19T23:45:35.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.934+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94193710396928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2ec8c000 con 0x55ab2ebc6000 2024-04-19T23:45:35.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.936+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94193710396928] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.936+0000 7fd3e646ea80 20 remove_watcher() i=6 2024-04-19T23:45:35.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.936+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94193710398080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ab2eb0bc00 con 0x55ab2ebc6000 2024-04-19T23:45:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e4c19700 1 -- 172.21.15.155:0/2305902147 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94193710398080] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ab2ebbeb40 con 0x55ab2ebc6000 2024-04-19T23:45:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 20 remove_watcher() i=7 2024-04-19T23:45:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ab2ebc6000 msgr2=0x55ab2ea69180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ab2ebc6000 0x55ab2ea69180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ab2e77f800 msgr2=0x55ab2ea67b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ab2e77f800 0x55ab2ea67b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ab2eb0b400 msgr2=0x55ab2ea68c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ab2eb0b400 0x55ab2ea68c00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ab2eb0b000 msgr2=0x55ab2ea68100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ab2eb0b000 0x55ab2ea68100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2eb0ac00 msgr2=0x55ab2ea67600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2eb0ac00 0x55ab2ea67600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55ab2ea61890 tx=0x55ab2e86f800 comp rx=0 tx=0).stop 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 msgr2=0x55ab2ea66b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2305902147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77f400 0x55ab2ea66b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55ab2f5fc4b0 tx=0x55ab2ead0120 comp rx=0 tx=0).stop 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 reap_dead start 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e3c17700 1 -- 172.21.15.155:0/2305902147 reap_dead start 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 shutdown_connections 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 >> 172.21.15.155:0/2305902147 conn(0x55ab2e77ec00 msgr2=0x55ab2e86b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 shutdown_connections 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2305902147 wait complete. 2024-04-19T23:45:35.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ab2ec6a400 msgr2=0x55ab2ec80580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ab2ec6a400 0x55ab2ec80580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ab2ebc7800 msgr2=0x55ab2ec80000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ab2ebc7800 0x55ab2ec80000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ab2ec6b800 msgr2=0x55ab2ec81080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ab2ec6b800 0x55ab2ec81080 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ab2ec6ac00 msgr2=0x55ab2ec80b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ab2ec6ac00 0x55ab2ec80b00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2ec6a000 msgr2=0x55ab2ea69700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2ec6a000 0x55ab2ea69700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55ab2eb5b710 tx=0x55ab2ead0a20 comp rx=0 tx=0).stop 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 msgr2=0x55ab2ea68680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e4418700 1 -- 172.21.15.155:0/3052429424 reap_dead start 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.937+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55ab2ebdd230 tx=0x55ab2ead1800 comp rx=0 tx=0).stop 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 shutdown_connections 2024-04-19T23:45:35.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/3052429424 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2ebc7400 0x55ab2ea68680 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 >> 172.21.15.155:0/3052429424 conn(0x55ab2ebc6800 msgr2=0x55ab2e86c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 shutdown_connections 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 -- 172.21.15.155:0/3052429424 wait complete. 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2608164344 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2eb0a000 msgr2=0x55ab2ea67080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2608164344 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2eb0a000 0x55ab2ea67080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55ab2f5fcab0 tx=0x55ab2ead0240 comp rx=0 tx=0).stop 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2608164344 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 msgr2=0x55ab2ea66580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2608164344 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55ab2f557ad0 tx=0x55ab2e86fa40 comp rx=0 tx=0).stop 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2608164344 shutdown_connections 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2608164344 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ab2eb0a000 0x55ab2ea67080 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 --2- 172.21.15.155:0/2608164344 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ab2e77e800 0x55ab2ea66580 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2608164344 >> 172.21.15.155:0/2608164344 conn(0x55ab2e77e400 msgr2=0x55ab2e86b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2608164344 shutdown_connections 2024-04-19T23:45:35.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.938+0000 7fd3e646ea80 1 -- 172.21.15.155:0/2608164344 wait complete. 2024-04-19T23:45:35.943 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-19T23:45:35.944 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-19T23:45:35.944 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-19T23:45:35.944 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-19T23:45:35.989 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:35.989 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:35.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.990+0000 7f6acd0b2a80 1 Processor -- start 2024-04-19T23:45:35.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.990+0000 7f6acd0b2a80 1 -- start start 2024-04-19T23:45:35.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.990+0000 7f6acd0b2a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5641a59d8800 0x5641a5cc0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.990+0000 7f6acd0b2a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5641a5d03500 con 0x5641a59d8c00 2024-04-19T23:45:35.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.990+0000 7f6acd0b2a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5641a5a7aa00 con 0x5641a59d8800 2024-04-19T23:45:35.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.990+0000 7f6acb05c700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5641a59d8800 0x5641a5cc0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.990+0000 7f6aca85b700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5641a59d8c00 0x5641a5ac4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46456/0 (socket says 172.21.15.155:46456) 2024-04-19T23:45:35.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.990+0000 7f6aca85b700 1 -- 172.21.15.155:0/765466185 learned_addr learned my addr 172.21.15.155:0/765466185 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:35.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.990+0000 7f6acb05c700 1 -- 172.21.15.155:0/765466185 >> v1:172.21.15.76:6789/0 conn(0x5641a59d8c00 legacy=0x5641a5ac4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.990+0000 7f6acb05c700 1 -- 172.21.15.155:0/765466185 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641a5a01d40 con 0x5641a59d8800 2024-04-19T23:45:35.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.991+0000 7f6acb05c700 1 --2- 172.21.15.155:0/765466185 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5641a5cbb9e0 tx=0x5641a5ac9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95e10591790ffa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.991+0000 7f6aca05a700 1 -- 172.21.15.155:0/765466185 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5a914a0 con 0x5641a59d8800 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.991+0000 7f6aca05a700 1 -- 172.21.15.155:0/765466185 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641a5d03800 con 0x5641a59d8800 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.991+0000 7f6aca05a700 1 -- 172.21.15.155:0/765466185 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5a91600 con 0x5641a59d8800 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.991+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/765466185 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 msgr2=0x5641a5cc0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.991+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/765466185 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5641a5cbb9e0 tx=0x5641a5ac9920 comp rx=0 tx=0).stop 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.991+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/765466185 shutdown_connections 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.991+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/765466185 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.991+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/765466185 >> 172.21.15.155:0/765466185 conn(0x5641a59d8400 msgr2=0x5641a5ac4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.991+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/765466185 shutdown_connections 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.991+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/765466185 wait complete. 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.992+0000 7f6acd0b2a80 1 Processor -- start 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.992+0000 7f6acd0b2a80 1 -- start start 2024-04-19T23:45:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.992+0000 7f6acd0b2a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.992+0000 7f6acd0b2a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a5a7a500 con 0x5641a59d8800 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.992+0000 7f6acb05c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.992+0000 7f6acb05c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33512/0 (socket says 172.21.15.155:33512) 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.992+0000 7f6acb05c700 1 -- 172.21.15.155:0/2221935551 learned_addr learned my addr 172.21.15.155:0/2221935551 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6acb05c700 1 -- 172.21.15.155:0/2221935551 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641a5a01ba0 con 0x5641a59d8800 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6acb05c700 1 --2- 172.21.15.155:0/2221935551 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5641a67b00c0 tx=0x5641a5ac9800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deafa01b3db5cf5c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6ac9859700 1 -- 172.21.15.155:0/2221935551 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5a91760 con 0x5641a59d8800 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6ac9859700 1 -- 172.21.15.155:0/2221935551 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641a5d03b00 con 0x5641a59d8800 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6ac9859700 1 -- 172.21.15.155:0/2221935551 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5a914a0 con 0x5641a59d8800 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/2221935551 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 msgr2=0x5641a5cc0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/2221935551 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5641a67b00c0 tx=0x5641a5ac9800 comp rx=0 tx=0).stop 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/2221935551 shutdown_connections 2024-04-19T23:45:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/2221935551 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/2221935551 >> 172.21.15.155:0/2221935551 conn(0x5641a59d8400 msgr2=0x5641a5ac5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/2221935551 shutdown_connections 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.993+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/2221935551 wait complete. 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.994+0000 7f6acd0b2a80 1 Processor -- start 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.994+0000 7f6acd0b2a80 1 -- start start 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.994+0000 7f6acd0b2a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.994+0000 7f6acd0b2a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a5a7a3c0 con 0x5641a59d8800 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.994+0000 7f6acb05c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.994+0000 7f6acb05c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33526/0 (socket says 172.21.15.155:33526) 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.994+0000 7f6acb05c700 1 -- 172.21.15.155:0/3480462028 learned_addr learned my addr 172.21.15.155:0/3480462028 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.994+0000 7f6acb05c700 1 -- 172.21.15.155:0/3480462028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641a5a01a00 con 0x5641a59d8800 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.995+0000 7f6acb05c700 1 --2- 172.21.15.155:0/3480462028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5641a67b1950 tx=0x5641a5ac9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.995+0000 7f6ac8056700 1 -- 172.21.15.155:0/3480462028 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5a91600 con 0x5641a59d8800 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.995+0000 7f6ac8056700 1 -- 172.21.15.155:0/3480462028 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641a5d03c80 con 0x5641a59d8800 2024-04-19T23:45:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.995+0000 7f6ac8056700 1 -- 172.21.15.155:0/3480462028 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5a918c0 con 0x5641a59d8800 2024-04-19T23:45:35.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.995+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3480462028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5641a5a01860 con 0x5641a59d8800 2024-04-19T23:45:35.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.995+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3480462028 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641a5a016c0 con 0x5641a59d8800 2024-04-19T23:45:36.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.995+0000 7f6acd0b2a80 1 Processor -- start 2024-04-19T23:45:36.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.995+0000 7f6acd0b2a80 1 -- start start 2024-04-19T23:45:36.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.995+0000 7f6acd0b2a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 0x5641a5cc0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.995+0000 7f6acd0b2a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a5a14640 con 0x5641a59d9400 2024-04-19T23:45:36.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.995+0000 7f6ac8056700 1 -- 172.21.15.155:0/3480462028 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5641a677ab00 con 0x5641a59d8800 2024-04-19T23:45:36.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.996+0000 7f6ac8056700 1 --2- 172.21.15.155:0/3480462028 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5d56000 0x5641a5cc1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.996+0000 7f6ac8056700 1 -- 172.21.15.155:0/3480462028 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5641a5a53180 con 0x5641a59d8800 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.996+0000 7f6acb85d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 0x5641a5cc0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.996+0000 7f6acb05c700 1 --2- 172.21.15.155:0/3480462028 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5d56000 0x5641a5cc1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.996+0000 7f6acb85d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 0x5641a5cc0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33530/0 (socket says 172.21.15.155:33530) 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.996+0000 7f6acb85d700 1 -- 172.21.15.155:0/3839062525 learned_addr learned my addr 172.21.15.155:0/3839062525 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.996+0000 7f6acb05c700 1 --2- 172.21.15.155:0/3480462028 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5d56000 0x5641a5cc1080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x5641a686aed0 tx=0x5641a5d1e540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.996+0000 7f6acb85d700 1 -- 172.21.15.155:0/3839062525 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641a5a00000 con 0x5641a59d9400 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.996+0000 7f6acb85d700 1 --2- 172.21.15.155:0/3839062525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 0x5641a5cc0b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5641a686a9f0 tx=0x5641a5d1e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3b51b98df99678 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.996+0000 7f6ac5851700 1 -- 172.21.15.155:0/3839062525 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5a91600 con 0x5641a59d9400 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.996+0000 7f6ac5851700 1 -- 172.21.15.155:0/3839062525 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641a5a79c80 con 0x5641a59d9400 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.997+0000 7f6ac5851700 1 -- 172.21.15.155:0/3839062525 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5a918c0 con 0x5641a59d9400 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.997+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3839062525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 msgr2=0x5641a5cc0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.997+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/3839062525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 0x5641a5cc0b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5641a686a9f0 tx=0x5641a5d1e720 comp rx=0 tx=0).stop 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.997+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3839062525 shutdown_connections 2024-04-19T23:45:36.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.997+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/3839062525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 0x5641a5cc0b00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.997+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3839062525 >> 172.21.15.155:0/3839062525 conn(0x5641a59d8c00 msgr2=0x5641a5ac5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.997+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3839062525 shutdown_connections 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.997+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3839062525 wait complete. 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.997+0000 7f6acd0b2a80 1 Processor -- start 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.997+0000 7f6acd0b2a80 1 -- start start 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.998+0000 7f6acd0b2a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 0x5641a5cc0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.998+0000 7f6acd0b2a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a5a148c0 con 0x5641a59d9400 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.998+0000 7f6acb85d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 0x5641a5cc0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.998+0000 7f6acb85d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 0x5641a5cc0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33546/0 (socket says 172.21.15.155:33546) 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.998+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 learned_addr learned my addr 172.21.15.155:0/85507759 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.998+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641a5a00ea0 con 0x5641a59d9400 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.998+0000 7f6acb85d700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 0x5641a5cc0b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5641a686bf50 tx=0x5641a5ac98c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.998+0000 7f6ac404e700 1 -- 172.21.15.155:0/85507759 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5a91760 con 0x5641a59d9400 2024-04-19T23:45:36.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.999+0000 7f6ac404e700 1 -- 172.21.15.155:0/85507759 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641a5a79b00 con 0x5641a59d9400 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.999+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5641a5a00820 con 0x5641a59d9400 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.999+0000 7f6ac404e700 1 -- 172.21.15.155:0/85507759 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5a91600 con 0x5641a59d9400 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.999+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641a5a009c0 con 0x5641a59d9400 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:35.999+0000 7f6ac404e700 1 -- 172.21.15.155:0/85507759 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5641a677adc0 con 0x5641a59d9400 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.000+0000 7f6ac404e700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5d56c00 0x5641a5cc1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.000+0000 7f6ac404e700 1 -- 172.21.15.155:0/85507759 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5641a5a53340 con 0x5641a59d9400 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.000+0000 7f6aca85b700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5d56c00 0x5641a5cc1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.000+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.000+0000 7f6aca85b700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5d56c00 0x5641a5cc1600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5641a5d6fd70 tx=0x5641a5d1f320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.000+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5641a59d9800 0x5641a5cc1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.000+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a59d9c00 con 0x5641a59d9800 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.000+0000 7f6acb85d700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5641a59d9800 0x5641a5cc1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.000+0000 7f6acb85d700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5641a59d9800 0x5641a5cc1b80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 20 realm 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57000 con 0x5641a59d9800 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57400 con 0x5641a59d9800 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57800 con 0x5641a59d9800 2024-04-19T23:45:36.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57c00 con 0x5641a59d9800 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.001+0000 7f6acd0b2a80 20 searching for the correct realm 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.002+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5641a5d57000 0x5641a5cc2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.002+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57400 con 0x5641a5d57000 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.002+0000 7f6acb05c700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5641a5d57000 0x5641a5cc2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.002+0000 7f6acb05c700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5641a5d57000 0x5641a5cc2100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.002+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.002+0000 7f6acb05c700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5641a5d57400 0x5641a5cc2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.002+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c000 con 0x5641a5d57400 2024-04-19T23:45:36.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.002+0000 7f6aca85b700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5641a5d57400 0x5641a5cc2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.003+0000 7f6aca85b700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5641a5d57400 0x5641a5cc2c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.003+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.003+0000 7f6aca85b700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5641a5e1c000 0x5641a5cc3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.003+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5e1c000 2024-04-19T23:45:36.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.003+0000 7f6acb85d700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5641a5e1c000 0x5641a5cc3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.003+0000 7f6acb85d700 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5641a5e1c000 0x5641a5cc3180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.004+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.004+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a59d9800 2024-04-19T23:45:36.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.004+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.004+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a59d9800 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.004+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.004+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5e1c000 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.004+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.004+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5e1c000 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.005+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.005+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57400 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.005+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.005+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57000 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.005+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.005+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a59d9800 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.005+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.005+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5e1c000 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.006+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.006+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a59d9800 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.006+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.006+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57400 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.006+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.006+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57000 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.006+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.006+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57000 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.007+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.007+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5e1c000 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.007+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.007+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57000 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.007+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.007+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57000 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.008+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.008+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a59d9800 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.008+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.008+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a59d9800 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.008+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.008+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5e1c000 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.008+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.008+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57000 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.008+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.008+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57400 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.009+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.009+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a59d9800 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.009+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.009+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5e1c000 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.009+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.009+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57000 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.009+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.009+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5e1c000 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.010+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.010+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57400 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.010+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.010+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57000 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.010+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.010+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5e1c000 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a59d9800 2024-04-19T23:45:36.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57400 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a59d9c00 con 0x5641a59d9800 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1cc00 con 0x5641a59d9800 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.011+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1d000 con 0x5641a5d57400 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 20 zone default found 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 4 Realm: () 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 20 zonegroup default 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1d400 con 0x5641a5e1c000 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1d800 con 0x5641a5d57000 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.012+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1dc00 con 0x5641a5d57000 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.013+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.013+0000 7f6acd0b2a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.013+0000 7f6acd0b2a80 20 started sync module instance, tier type = 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.013+0000 7f6acd0b2a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.013+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1cc00 con 0x5641a5d57400 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.014+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.014+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94839954438912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a59d9c00 con 0x5641a5d57400 2024-04-19T23:45:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.014+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57800 con 0x5641a59d9800 2024-04-19T23:45:36.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.015+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94839954438912] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.015+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.015+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94839954440064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57c00 con 0x5641a59d9800 2024-04-19T23:45:36.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.015+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5d57000 2024-04-19T23:45:36.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.016+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.016+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94839954441216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1d000 con 0x5641a5d57000 2024-04-19T23:45:36.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.016+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1cc00 con 0x5641a5d57400 2024-04-19T23:45:36.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.017+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94839954440064] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.018+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94839954441216] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.020+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.020+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94839954442368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c400 con 0x5641a5d57400 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.020+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1d800 con 0x5641a59d9800 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.021+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94839954442368] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.021+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.022+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94839954443520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1dc00 con 0x5641a59d9800 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.022+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1c800 con 0x5641a5e1c000 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.023+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94839954443520] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.023+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.023+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94839954444672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1d400 con 0x5641a5e1c000 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.023+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1d800 con 0x5641a5e1c000 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.024+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94839954444672] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.025+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.025+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94839954445824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1dc00 con 0x5641a5e1c000 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.025+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57800 con 0x5641a5e1c000 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.026+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94839954445824] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.026+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.026+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94839954446976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57c00 con 0x5641a5e1c000 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.026+0000 7f6acd0b2a80 20 add_watcher() i=0 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.026+0000 7f6acd0b2a80 20 add_watcher() i=1 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.026+0000 7f6acd0b2a80 20 add_watcher() i=2 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.026+0000 7f6acd0b2a80 20 add_watcher() i=3 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.026+0000 7f6acd0b2a80 20 add_watcher() i=4 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.026+0000 7f6acd0b2a80 20 add_watcher() i=5 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.026+0000 7f6acd0b2a80 20 add_watcher() i=6 2024-04-19T23:45:36.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.027+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94839954446976] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.027+0000 7f6acd0b2a80 20 add_watcher() i=7 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.027+0000 7f6acd0b2a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.027+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57800 con 0x5641a59d9800 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.028+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.028+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94839955955712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57c00 con 0x5641a59d9800 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.029+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94839955955712] v30'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.029+0000 7f6ab202a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.029+0000 7f6acd0b2a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.029+0000 7f6acd0b2a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.029+0000 7f6acd0b2a80 1 Processor -- start 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.029+0000 7f6acd0b2a80 1 -- start start 2024-04-19T23:45:36.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.029+0000 7f6acd0b2a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.029+0000 7f6acd0b2a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a5a7a3c0 con 0x5641a5e1d400 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.030+0000 7f6aca85b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.030+0000 7f6aca85b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33562/0 (socket says 172.21.15.155:33562) 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.030+0000 7f6aca85b700 1 -- 172.21.15.155:0/2648528164 learned_addr learned my addr 172.21.15.155:0/2648528164 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.030+0000 7f6aca85b700 1 -- 172.21.15.155:0/2648528164 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641a5a00b60 con 0x5641a5e1d400 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.030+0000 7f6aca85b700 1 --2- 172.21.15.155:0/2648528164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5641a5e2e6c0 tx=0x5641a5d1f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab11e01198f3708 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.030+0000 7f6ab1829700 1 -- 172.21.15.155:0/2648528164 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5e42000 con 0x5641a5e1d400 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.030+0000 7f6ab1829700 1 -- 172.21.15.155:0/2648528164 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641a5e4a000 con 0x5641a5e1d400 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.030+0000 7f6ab1829700 1 -- 172.21.15.155:0/2648528164 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5e42160 con 0x5641a5e1d400 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.031+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/2648528164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 msgr2=0x5641a5cc2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.031+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/2648528164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5641a5e2e6c0 tx=0x5641a5d1f680 comp rx=0 tx=0).stop 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.031+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/2648528164 shutdown_connections 2024-04-19T23:45:36.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.031+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/2648528164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.031+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/2648528164 >> 172.21.15.155:0/2648528164 conn(0x5641a5e1c800 msgr2=0x5641a5ac6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.031+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/2648528164 shutdown_connections 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.031+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/2648528164 wait complete. 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.031+0000 7f6acd0b2a80 1 Processor -- start 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.031+0000 7f6acd0b2a80 1 -- start start 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.031+0000 7f6acd0b2a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.031+0000 7f6acd0b2a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a5a7a500 con 0x5641a5e1d400 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.032+0000 7f6aca85b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.032+0000 7f6aca85b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33578/0 (socket says 172.21.15.155:33578) 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.032+0000 7f6aca85b700 1 -- 172.21.15.155:0/313074313 learned_addr learned my addr 172.21.15.155:0/313074313 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.032+0000 7f6aca85b700 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641a5a00d00 con 0x5641a5e1d400 2024-04-19T23:45:36.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.032+0000 7f6aca85b700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5641a5e2f380 tx=0x5641a5d1f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.032+0000 7f6ab0026700 1 -- 172.21.15.155:0/313074313 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5e422c0 con 0x5641a5e1d400 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.032+0000 7f6ab0026700 1 -- 172.21.15.155:0/313074313 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641a5e4a180 con 0x5641a5e1d400 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.032+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5641a5a00340 con 0x5641a5e1d400 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.032+0000 7f6ab0026700 1 -- 172.21.15.155:0/313074313 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5641a5e42000 con 0x5641a5e1d400 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.032+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641a5a00b60 con 0x5641a5e1d400 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.033+0000 7f6ab0026700 1 -- 172.21.15.155:0/313074313 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5641a677bb80 con 0x5641a5e1d400 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.033+0000 7f6ab0026700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5ec6000 0x5641a5cc3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.033+0000 7f6ab0026700 1 -- 172.21.15.155:0/313074313 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5641a5a53500 con 0x5641a5e1d400 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.033+0000 7f6acb85d700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5ec6000 0x5641a5cc3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.033+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5641a5e1d800 0x5641a5eda000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.033+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1dc00 con 0x5641a5e1d800 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.034+0000 7f6acb05c700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5641a5e1d800 0x5641a5eda000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.034+0000 7f6acb85d700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5ec6000 0x5641a5cc3700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5641a5dbfe30 tx=0x5641a5d1f4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.034+0000 7f6acb05c700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5641a5e1d800 0x5641a5eda000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.035+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5e1d800 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.035+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5641a5ec6400 0x5641a5eda580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.035+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ec6800 con 0x5641a5ec6400 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.035+0000 7f6aca85b700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5641a5ec6400 0x5641a5eda580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.036+0000 7f6aca85b700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5641a5ec6400 0x5641a5eda580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.037+0000 7f6aca85b700 1 -- 172.21.15.155:0/313074313 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5ec6400 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.037+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5641a5ec6c00 0x5641a5edab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.037+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ec7000 con 0x5641a5ec6c00 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.037+0000 7f6acb85d700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5641a5ec6c00 0x5641a5edab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.037+0000 7f6acb85d700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5641a5ec6c00 0x5641a5edab00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.038+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.038+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ec7400 con 0x5641a5e1d800 2024-04-19T23:45:36.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.039+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5e1d800 2024-04-19T23:45:36.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.039+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5641a5ec7800 0x5641a5edb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.039+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ec7c00 con 0x5641a5ec7800 2024-04-19T23:45:36.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.039+0000 7f6acb05c700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5641a5ec7800 0x5641a5edb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.039+0000 7f6acb05c700 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5641a5ec7800 0x5641a5edb080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.040+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5ec7800 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.040+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8000 con 0x5641a5ec6c00 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.041+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'17 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.041+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8400 con 0x5641a5e1d800 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.042+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5e1d800 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.042+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8800 con 0x5641a5ec6400 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.043+0000 7f6aca85b700 1 -- 172.21.15.155:0/313074313 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'17 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5ec6400 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.044+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8c00 con 0x5641a5ec7800 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.045+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5ec7800 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.045+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee9000 con 0x5641a5ec6c00 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.046+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.046+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee9400 con 0x5641a5ec7800 2024-04-19T23:45:36.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.046+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5ec7800 2024-04-19T23:45:36.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.046+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee9800 con 0x5641a5ec6400 2024-04-19T23:45:36.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.048+0000 7f6aca85b700 1 -- 172.21.15.155:0/313074313 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5ec6400 2024-04-19T23:45:36.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.048+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee9c00 con 0x5641a5ec7800 2024-04-19T23:45:36.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.049+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5ec7800 2024-04-19T23:45:36.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.049+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8800 con 0x5641a5ec6400 2024-04-19T23:45:36.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.051+0000 7f6aca85b700 1 -- 172.21.15.155:0/313074313 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'23 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5ec6400 2024-04-19T23:45:36.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.051+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8400 con 0x5641a5e1d800 2024-04-19T23:45:36.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.052+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'38 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5e1d800 2024-04-19T23:45:36.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.052+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ec6800 con 0x5641a5ec6c00 2024-04-19T23:45:36.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.054+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.054+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ec7400 con 0x5641a5ec7800 2024-04-19T23:45:36.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.055+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5ec7800 2024-04-19T23:45:36.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.055+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ec7c00 con 0x5641a5ec6c00 2024-04-19T23:45:36.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.056+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.056+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1cc00 con 0x5641a5e1d800 2024-04-19T23:45:36.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.057+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5e1d800 2024-04-19T23:45:36.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.057+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1d000 con 0x5641a5e1d800 2024-04-19T23:45:36.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.058+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'39 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5e1d800 2024-04-19T23:45:36.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.058+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1dc00 con 0x5641a5ec6c00 2024-04-19T23:45:36.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.059+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.059+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a59d9c00 con 0x5641a5ec7800 2024-04-19T23:45:36.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.060+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5ec7800 2024-04-19T23:45:36.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.060+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ec7400 con 0x5641a5ec6c00 2024-04-19T23:45:36.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.061+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.061+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ec7000 con 0x5641a5ec6c00 2024-04-19T23:45:36.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.062+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.062+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ec6800 con 0x5641a5ec6c00 2024-04-19T23:45:36.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.064+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.064+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ec7c00 con 0x5641a5ec6c00 2024-04-19T23:45:36.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.065+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.065+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8c00 con 0x5641a5ec6400 2024-04-19T23:45:36.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.066+0000 7f6aca85b700 1 -- 172.21.15.155:0/313074313 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5ec6400 2024-04-19T23:45:36.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.066+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee9400 con 0x5641a5ec6c00 2024-04-19T23:45:36.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.067+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.067+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee9c00 con 0x5641a5ec6400 2024-04-19T23:45:36.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.068+0000 7f6aca85b700 1 -- 172.21.15.155:0/313074313 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5ec6400 2024-04-19T23:45:36.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.068+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8400 con 0x5641a5ec6c00 2024-04-19T23:45:36.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.069+0000 7f6acb85d700 1 -- 172.21.15.155:0/313074313 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5ec6c00 2024-04-19T23:45:36.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.069+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8000 con 0x5641a5ec6400 2024-04-19T23:45:36.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.070+0000 7f6aca85b700 1 -- 172.21.15.155:0/313074313 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5ec6400 2024-04-19T23:45:36.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.070+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee9000 con 0x5641a5ec7800 2024-04-19T23:45:36.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.071+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5ec7800 2024-04-19T23:45:36.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.072+0000 7f6aad821700 20 reqs_thread_entry: start 2024-04-19T23:45:36.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.073+0000 7f6acd0b2a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:36.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.073+0000 7f6acd0b2a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:36.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.073+0000 7f6aab81d700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:06 2024 2024-04-19T23:45:36.073 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:36.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.073+0000 7f6aaaffb700 20 reqs_thread_entry: start 2024-04-19T23:45:36.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.073+0000 7f6acd0b2a80 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-19T23:45:36.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.073+0000 7f6acd0b2a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.073+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57c00 con 0x5641a5e1c000 2024-04-19T23:45:36.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.073+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.073+0000 7f6acd0b2a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.073+0000 7f6acd0b2a80 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-19T23:45:36.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.073+0000 7f6acd0b2a80 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:45:36.074 INFO:teuthology.orchestra.run.smithi155.stderr:could not remove user: unable to remove user, user does not exist 2024-04-19T23:45:36.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.074+0000 7f6ab202a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.074+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94839955955712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5e1cc00 con 0x5641a59d9800 2024-04-19T23:45:36.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.075+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94839955955712] v30'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.075+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94839954438912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee9400 con 0x5641a5d57400 2024-04-19T23:45:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.076+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94839954438912] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.076+0000 7f6acd0b2a80 20 remove_watcher() i=0 2024-04-19T23:45:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.076+0000 7f6acd0b2a80 2 removed watcher, disabling cache 2024-04-19T23:45:36.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.076+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94839954440064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8400 con 0x5641a59d9800 2024-04-19T23:45:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.077+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94839954440064] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.077+0000 7f6acd0b2a80 20 remove_watcher() i=1 2024-04-19T23:45:36.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.077+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94839954441216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee9800 con 0x5641a5d57000 2024-04-19T23:45:36.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.078+0000 7f6acb05c700 1 -- 172.21.15.155:0/85507759 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94839954441216] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e15200 con 0x5641a5d57000 2024-04-19T23:45:36.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.078+0000 7f6acd0b2a80 20 remove_watcher() i=2 2024-04-19T23:45:36.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.078+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94839954442368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8800 con 0x5641a5d57400 2024-04-19T23:45:36.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.079+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94839954442368] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e15440 con 0x5641a5d57400 2024-04-19T23:45:36.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.079+0000 7f6acd0b2a80 20 remove_watcher() i=3 2024-04-19T23:45:36.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.079+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94839954443520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8c00 con 0x5641a59d9800 2024-04-19T23:45:36.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.082+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94839954443520] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a59d9800 2024-04-19T23:45:36.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.082+0000 7f6acd0b2a80 20 remove_watcher() i=4 2024-04-19T23:45:36.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.082+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94839954444672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee9c00 con 0x5641a5e1c000 2024-04-19T23:45:36.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.084+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94839954444672] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.084+0000 7f6acd0b2a80 20 remove_watcher() i=5 2024-04-19T23:45:36.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.084+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94839954445824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5ee8000 con 0x5641a5e1c000 2024-04-19T23:45:36.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.085+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94839954445824] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.085+0000 7f6acd0b2a80 20 remove_watcher() i=6 2024-04-19T23:45:36.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.085+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94839954446976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5641a5d57c00 con 0x5641a5e1c000 2024-04-19T23:45:36.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acb85d700 1 -- 172.21.15.155:0/85507759 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94839954446976] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5641a5e14b40 con 0x5641a5e1c000 2024-04-19T23:45:36.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 20 remove_watcher() i=7 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5641a5e1c000 msgr2=0x5641a5cc3180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5641a5e1c000 0x5641a5cc3180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5641a59d9800 msgr2=0x5641a5cc1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5641a59d9800 0x5641a5cc1b80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5641a5d57400 msgr2=0x5641a5cc2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5641a5d57400 0x5641a5cc2c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5641a5d57000 msgr2=0x5641a5cc2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5641a5d57000 0x5641a5cc2100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5d56c00 msgr2=0x5641a5cc1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5d56c00 0x5641a5cc1600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5641a5d6fd70 tx=0x5641a5d1f320 comp rx=0 tx=0).stop 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 msgr2=0x5641a5cc0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/85507759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d9400 0x5641a5cc0b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5641a686bf50 tx=0x5641a5ac98c0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 reap_dead start 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6aca85b700 1 -- 172.21.15.155:0/85507759 reap_dead start 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 shutdown_connections 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 >> 172.21.15.155:0/85507759 conn(0x5641a59d8c00 msgr2=0x5641a5ac5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 shutdown_connections 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.086+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/85507759 wait complete. 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5641a5ec6400 msgr2=0x5641a5eda580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5641a5ec6400 0x5641a5eda580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5641a5e1d800 msgr2=0x5641a5eda000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5641a5e1d800 0x5641a5eda000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5641a5ec7800 msgr2=0x5641a5edb080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5641a5ec7800 0x5641a5edb080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5641a5ec6c00 msgr2=0x5641a5edab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5641a5ec6c00 0x5641a5edab00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5ec6000 msgr2=0x5641a5cc3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5ec6000 0x5641a5cc3700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5641a5dbfe30 tx=0x5641a5d1f4a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 msgr2=0x5641a5cc2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acb05c700 1 -- 172.21.15.155:0/313074313 reap_dead start 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5641a5e2f380 tx=0x5641a5d1f7a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 shutdown_connections 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/313074313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a5e1d400 0x5641a5cc2680 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 >> 172.21.15.155:0/313074313 conn(0x5641a5e1c800 msgr2=0x5641a5ac6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 shutdown_connections 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/313074313 wait complete. 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3480462028 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5d56000 msgr2=0x5641a5cc1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/3480462028 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5d56000 0x5641a5cc1080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x5641a686aed0 tx=0x5641a5d1e540 comp rx=0 tx=0).stop 2024-04-19T23:45:36.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3480462028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 msgr2=0x5641a5cc0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/3480462028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5641a67b1950 tx=0x5641a5ac9920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3480462028 shutdown_connections 2024-04-19T23:45:36.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/3480462028 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5641a5d56000 0x5641a5cc1080 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 --2- 172.21.15.155:0/3480462028 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5641a59d8800 0x5641a5cc0580 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3480462028 >> 172.21.15.155:0/3480462028 conn(0x5641a59d8400 msgr2=0x5641a5ac5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3480462028 shutdown_connections 2024-04-19T23:45:36.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.087+0000 7f6acd0b2a80 1 -- 172.21.15.155:0/3480462028 wait complete. 2024-04-19T23:45:36.093 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-19T23:45:36.093 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-19T23:45:36.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-19T23:45:36.093 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-19T23:45:36.139 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:36.139 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:36.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.139+0000 7fd1ad20ca80 1 Processor -- start 2024-04-19T23:45:36.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.140+0000 7fd1ad20ca80 1 -- start start 2024-04-19T23:45:36.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.140+0000 7fd1ad20ca80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5617765e6800 0x5617768ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.140+0000 7fd1ad20ca80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561776911500 con 0x5617765e6c00 2024-04-19T23:45:36.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.140+0000 7fd1ad20ca80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x561776688a00 con 0x5617765e6800 2024-04-19T23:45:36.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.140+0000 7fd1ab1b6700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5617765e6800 0x5617768ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.140+0000 7fd1aa9b5700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5617765e6c00 0x5617766d2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46466/0 (socket says 172.21.15.155:46466) 2024-04-19T23:45:36.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.140+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/3943366223 learned_addr learned my addr 172.21.15.155:0/3943366223 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:36.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.140+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/3943366223 >> v1:172.21.15.76:6789/0 conn(0x5617765e6c00 legacy=0x5617766d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.140+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/3943366223 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56177660fd40 con 0x5617765e6800 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.141+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/3943366223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5617768c99e0 tx=0x5617766d7920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48d9c85a80a557b server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.141+0000 7fd1aa1b4700 1 -- 172.21.15.155:0/3943366223 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56177669f4a0 con 0x5617765e6800 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.141+0000 7fd1aa1b4700 1 -- 172.21.15.155:0/3943366223 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561776911800 con 0x5617765e6800 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.141+0000 7fd1aa1b4700 1 -- 172.21.15.155:0/3943366223 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56177669f600 con 0x5617765e6800 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.141+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3943366223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 msgr2=0x5617768ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.141+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/3943366223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5617768c99e0 tx=0x5617766d7920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.141+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3943366223 shutdown_connections 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.141+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/3943366223 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.141+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3943366223 >> 172.21.15.155:0/3943366223 conn(0x5617765e6400 msgr2=0x5617766d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.141+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3943366223 shutdown_connections 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.141+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3943366223 wait complete. 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.142+0000 7fd1ad20ca80 1 Processor -- start 2024-04-19T23:45:36.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.142+0000 7fd1ad20ca80 1 -- start start 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.142+0000 7fd1ad20ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.142+0000 7fd1ad20ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561776688500 con 0x5617765e6800 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.142+0000 7fd1ab1b6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.142+0000 7fd1ab1b6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33592/0 (socket says 172.21.15.155:33592) 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.142+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/3438338402 learned_addr learned my addr 172.21.15.155:0/3438338402 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/3438338402 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56177660fba0 con 0x5617765e6800 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/3438338402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x561777451860 tx=0x5617766d7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b107e8de38871e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1a99b3700 1 -- 172.21.15.155:0/3438338402 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56177669f760 con 0x5617765e6800 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1a99b3700 1 -- 172.21.15.155:0/3438338402 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561776911b00 con 0x5617765e6800 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1a99b3700 1 -- 172.21.15.155:0/3438338402 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56177669f1e0 con 0x5617765e6800 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3438338402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 msgr2=0x5617768ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/3438338402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x561777451860 tx=0x5617766d7800 comp rx=0 tx=0).stop 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3438338402 shutdown_connections 2024-04-19T23:45:36.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/3438338402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3438338402 >> 172.21.15.155:0/3438338402 conn(0x5617765e6400 msgr2=0x5617766d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3438338402 shutdown_connections 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.143+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3438338402 wait complete. 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.144+0000 7fd1ad20ca80 1 Processor -- start 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.144+0000 7fd1ad20ca80 1 -- start start 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.144+0000 7fd1ad20ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.144+0000 7fd1ad20ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617766883c0 con 0x5617765e6800 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.144+0000 7fd1ab1b6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.144+0000 7fd1ab1b6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33596/0 (socket says 172.21.15.155:33596) 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.144+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/3800033356 learned_addr learned my addr 172.21.15.155:0/3800033356 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.144+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/3800033356 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56177660fa00 con 0x5617765e6800 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.144+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/3800033356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x561777451f20 tx=0x5617766d7920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.145+0000 7fd1a81b0700 1 -- 172.21.15.155:0/3800033356 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56177669f4a0 con 0x5617765e6800 2024-04-19T23:45:36.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.145+0000 7fd1a81b0700 1 -- 172.21.15.155:0/3800033356 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561776911c80 con 0x5617765e6800 2024-04-19T23:45:36.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.145+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3800033356 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56177660f860 con 0x5617765e6800 2024-04-19T23:45:36.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.145+0000 7fd1a81b0700 1 -- 172.21.15.155:0/3800033356 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56177669f600 con 0x5617765e6800 2024-04-19T23:45:36.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.145+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3800033356 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56177660f6c0 con 0x5617765e6800 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.145+0000 7fd1ad20ca80 1 Processor -- start 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.145+0000 7fd1ad20ca80 1 -- start start 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.145+0000 7fd1a81b0700 1 -- 172.21.15.155:0/3800033356 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561777388b00 con 0x5617765e6800 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.145+0000 7fd1ad20ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 0x5617768ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.145+0000 7fd1ad20ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561776622640 con 0x5617765e7400 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1a81b0700 1 --2- 172.21.15.155:0/3800033356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56177696a000 0x5617768cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1a81b0700 1 -- 172.21.15.155:0/3800033356 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x561776661180 con 0x5617765e6800 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/3800033356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56177696a000 0x5617768cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1ab9b7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 0x5617768ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1ab9b7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 0x5617768ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33608/0 (socket says 172.21.15.155:33608) 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/41114029 learned_addr learned my addr 172.21.15.155:0/41114029 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/3800033356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56177696a000 0x5617768cf080 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x56177745eff0 tx=0x561776930540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/41114029 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56177660e000 con 0x5617765e7400 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1ab9b7700 1 --2- 172.21.15.155:0/41114029 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 0x5617768ceb00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x56177745e270 tx=0x561776930720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b620690d3b7353 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1a59ab700 1 -- 172.21.15.155:0/41114029 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56177669f4a0 con 0x5617765e7400 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1a59ab700 1 -- 172.21.15.155:0/41114029 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561776687c80 con 0x5617765e7400 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.146+0000 7fd1a59ab700 1 -- 172.21.15.155:0/41114029 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56177669f600 con 0x5617765e7400 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.147+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/41114029 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 msgr2=0x5617768ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.147+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/41114029 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 0x5617768ceb00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x56177745e270 tx=0x561776930720 comp rx=0 tx=0).stop 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.147+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/41114029 shutdown_connections 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.147+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/41114029 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 0x5617768ceb00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.147+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/41114029 >> 172.21.15.155:0/41114029 conn(0x5617765e6c00 msgr2=0x5617766d3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.147+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/41114029 shutdown_connections 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.147+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/41114029 wait complete. 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.147+0000 7fd1ad20ca80 1 Processor -- start 2024-04-19T23:45:36.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.147+0000 7fd1ad20ca80 1 -- start start 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.147+0000 7fd1ad20ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 0x5617768ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.147+0000 7fd1ad20ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617766228c0 con 0x5617765e7400 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.148+0000 7fd1ab9b7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 0x5617768ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.148+0000 7fd1ab9b7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 0x5617768ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33622/0 (socket says 172.21.15.155:33622) 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.148+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 learned_addr learned my addr 172.21.15.155:0/971973404 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.148+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56177660eea0 con 0x5617765e7400 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.148+0000 7fd1ab9b7700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 0x5617768ceb00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x56177745e810 tx=0x5617766d78c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.148+0000 7fd1a41a8700 1 -- 172.21.15.155:0/971973404 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56177669f760 con 0x5617765e7400 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.148+0000 7fd1a41a8700 1 -- 172.21.15.155:0/971973404 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561776687b00 con 0x5617765e7400 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.148+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56177660e820 con 0x5617765e7400 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.148+0000 7fd1a41a8700 1 -- 172.21.15.155:0/971973404 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56177669f4a0 con 0x5617765e7400 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.148+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56177660e9c0 con 0x5617765e7400 2024-04-19T23:45:36.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.149+0000 7fd1a41a8700 1 -- 172.21.15.155:0/971973404 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561777388dc0 con 0x5617765e7400 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.149+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.149+0000 7fd1a41a8700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56177696ac00 0x5617768cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.149+0000 7fd1a41a8700 1 -- 172.21.15.155:0/971973404 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x561776661340 con 0x5617765e7400 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.149+0000 7fd1aa9b5700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56177696ac00 0x5617768cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.149+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5617765e7800 0x5617768cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.149+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5617765e7c00 con 0x5617765e7800 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.149+0000 7fd1ab9b7700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5617765e7800 0x5617768cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1aa9b5700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56177696ac00 0x5617768cf600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x561776975d70 tx=0x561776931320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ab9b7700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5617765e7800 0x5617768cfb80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ad20ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ad20ca80 20 realm 2024-04-19T23:45:36.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696b000 con 0x5617765e7800 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ad20ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ad20ca80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696b400 con 0x5617765e7800 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ad20ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.150+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696b800 con 0x5617765e7800 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.151+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.151+0000 7fd1ad20ca80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.151+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.151+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696bc00 con 0x5617765e7800 2024-04-19T23:45:36.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.151+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.151+0000 7fd1ad20ca80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.151+0000 7fd1ad20ca80 20 searching for the correct realm 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.151+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56177696b000 0x5617768d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.151+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696b400 con 0x56177696b000 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.151+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56177696b000 0x5617768d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.151+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56177696b000 0x5617768d0100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.152+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.152+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56177696b400 0x5617768d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.152+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482000 con 0x56177696b400 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.152+0000 7fd1aa9b5700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56177696b400 0x5617768d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.152+0000 7fd1aa9b5700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56177696b400 0x5617768d0c00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.152+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.152+0000 7fd1aa9b5700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561777482000 0x5617768d1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.152+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x561777482000 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.153+0000 7fd1ab9b7700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561777482000 0x5617768d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.153+0000 7fd1ab9b7700 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561777482000 0x5617768d1180 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.153+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.153+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x5617765e7800 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.154+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.154+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x5617765e7800 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.154+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.154+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x561777482000 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.154+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.154+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x561777482000 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.154+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.154+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b400 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.155+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.155+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b000 2024-04-19T23:45:36.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.155+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.155+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x5617765e7800 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.155+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.155+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x561777482000 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.155+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.155+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x5617765e7800 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.156+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.156+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b400 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.156+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.156+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b000 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.156+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.156+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b000 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.156+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.156+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x561777482000 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.157+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.157+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b000 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.157+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.157+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b000 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.157+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.157+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x5617765e7800 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.157+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.157+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x5617765e7800 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.157+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.157+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x561777482000 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.158+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.158+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b000 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.158+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.158+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b400 2024-04-19T23:45:36.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.158+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.158+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x5617765e7800 2024-04-19T23:45:36.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.158+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.158+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x561777482000 2024-04-19T23:45:36.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.159+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.159+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b000 2024-04-19T23:45:36.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.159+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.159+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x561777482000 2024-04-19T23:45:36.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.159+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.159+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b400 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.160+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.160+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b000 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.160+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.160+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x561777482000 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.160+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.160+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x5617765e7800 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.160+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.160+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b400 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:36.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5617765e7c00 con 0x5617765e7800 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482c00 con 0x5617765e7800 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483000 con 0x56177696b400 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 zone default found 2024-04-19T23:45:36.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 4 Realm: () 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 zonegroup default 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.161+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483400 con 0x561777482000 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ad20ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483800 con 0x56177696b000 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ad20ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483c00 con 0x56177696b000 2024-04-19T23:45:36.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ad20ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ad20ca80 20 started sync module instance, tier type = 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ad20ca80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.162+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482c00 con 0x56177696b400 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.163+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.163+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94658773146368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5617765e7c00 con 0x56177696b400 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.163+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696b800 con 0x5617765e7800 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.164+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94658773146368] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.164+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.164+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94658773147520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696bc00 con 0x5617765e7800 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.165+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x56177696b000 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.167+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.167+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94658773148672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483000 con 0x56177696b000 2024-04-19T23:45:36.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.167+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94658773147520] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.167+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482c00 con 0x56177696b400 2024-04-19T23:45:36.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.170+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94658773148672] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.170+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.170+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94658773149824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482400 con 0x56177696b400 2024-04-19T23:45:36.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.170+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483800 con 0x5617765e7800 2024-04-19T23:45:36.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.173+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.173+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94658773150976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483c00 con 0x5617765e7800 2024-04-19T23:45:36.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.173+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482800 con 0x561777482000 2024-04-19T23:45:36.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.176+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.176+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94658773152128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483400 con 0x561777482000 2024-04-19T23:45:36.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.176+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483800 con 0x561777482000 2024-04-19T23:45:36.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.176+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94658773149824] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.178+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94658773150976] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.181+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94658773152128] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.181+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.181+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94658773153280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483c00 con 0x561777482000 2024-04-19T23:45:36.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.181+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696b800 con 0x561777482000 2024-04-19T23:45:36.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.183+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.183+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94658773154432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696bc00 con 0x561777482000 2024-04-19T23:45:36.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.183+0000 7fd1ad20ca80 20 add_watcher() i=0 2024-04-19T23:45:36.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.183+0000 7fd1ad20ca80 20 add_watcher() i=1 2024-04-19T23:45:36.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.183+0000 7fd1ad20ca80 20 add_watcher() i=2 2024-04-19T23:45:36.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.183+0000 7fd1ad20ca80 20 add_watcher() i=3 2024-04-19T23:45:36.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.183+0000 7fd1ad20ca80 20 add_watcher() i=4 2024-04-19T23:45:36.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.183+0000 7fd1ad20ca80 20 add_watcher() i=5 2024-04-19T23:45:36.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.186+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94658773153280] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.186+0000 7fd1ad20ca80 20 add_watcher() i=6 2024-04-19T23:45:36.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.189+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94658773154432] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.189+0000 7fd1ad20ca80 20 add_watcher() i=7 2024-04-19T23:45:36.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.189+0000 7fd1ad20ca80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:36.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.189+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696b800 con 0x5617765e7800 2024-04-19T23:45:36.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.189+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.189+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94658774671360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696bc00 con 0x5617765e7800 2024-04-19T23:45:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.190+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94658774671360] v30'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.190+0000 7fd192184700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.190+0000 7fd1ad20ca80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.190+0000 7fd1ad20ca80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.190+0000 7fd1ad20ca80 1 Processor -- start 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.191+0000 7fd1ad20ca80 1 -- start start 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.191+0000 7fd1ad20ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 0x5617768d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.191+0000 7fd1ad20ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617766883c0 con 0x561777483400 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.191+0000 7fd1aa9b5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 0x5617768d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.191+0000 7fd1aa9b5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 0x5617768d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33628/0 (socket says 172.21.15.155:33628) 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.191+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/1252439428 learned_addr learned my addr 172.21.15.155:0/1252439428 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.191+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/1252439428 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56177660eb60 con 0x561777483400 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.191+0000 7fd1aa9b5700 1 --2- 172.21.15.155:0/1252439428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 0x5617768d0680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5617769cfe30 tx=0x561776931680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c76262b2fd2cbd server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.191+0000 7fd191983700 1 -- 172.21.15.155:0/1252439428 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561776a50000 con 0x561777483400 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.192+0000 7fd191983700 1 -- 172.21.15.155:0/1252439428 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561776a52000 con 0x561777483400 2024-04-19T23:45:36.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.192+0000 7fd191983700 1 -- 172.21.15.155:0/1252439428 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561776a50160 con 0x561777483400 2024-04-19T23:45:36.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.192+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/1252439428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 msgr2=0x5617768d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.192+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/1252439428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 0x5617768d0680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5617769cfe30 tx=0x561776931680 comp rx=0 tx=0).stop 2024-04-19T23:45:36.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.192+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/1252439428 shutdown_connections 2024-04-19T23:45:36.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.192+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/1252439428 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 0x5617768d0680 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.192+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/1252439428 >> 172.21.15.155:0/1252439428 conn(0x561777482800 msgr2=0x5617766d4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.192+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/1252439428 shutdown_connections 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.192+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/1252439428 wait complete. 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.193+0000 7fd1ad20ca80 1 Processor -- start 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.193+0000 7fd1ad20ca80 1 -- start start 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.193+0000 7fd1ad20ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 0x5617768d0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.193+0000 7fd1ad20ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561776688500 con 0x561777483400 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.193+0000 7fd1aa9b5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 0x5617768d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.193+0000 7fd1aa9b5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 0x5617768d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33634/0 (socket says 172.21.15.155:33634) 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.193+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/2650995271 learned_addr learned my addr 172.21.15.155:0/2650995271 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.193+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56177660ed00 con 0x561777483400 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.193+0000 7fd1aa9b5700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 0x5617768d0680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x561776a57290 tx=0x5617769317a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.194+0000 7fd190180700 1 -- 172.21.15.155:0/2650995271 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561776a502c0 con 0x561777483400 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.194+0000 7fd190180700 1 -- 172.21.15.155:0/2650995271 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561776a52180 con 0x561777483400 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.194+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56177660e340 con 0x561777483400 2024-04-19T23:45:36.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.194+0000 7fd190180700 1 -- 172.21.15.155:0/2650995271 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561776a50000 con 0x561777483400 2024-04-19T23:45:36.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.194+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56177660eb60 con 0x561777483400 2024-04-19T23:45:36.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.194+0000 7fd190180700 1 -- 172.21.15.155:0/2650995271 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561777389b80 con 0x561777483400 2024-04-19T23:45:36.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.195+0000 7fd190180700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561776ad4000 0x5617768d1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.195+0000 7fd190180700 1 -- 172.21.15.155:0/2650995271 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x561776661500 con 0x561777483400 2024-04-19T23:45:36.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.195+0000 7fd1ab9b7700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561776ad4000 0x5617768d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.195+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561777483800 0x561776aea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.195+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483c00 con 0x561777483800 2024-04-19T23:45:36.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.195+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561777483800 0x561776aea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.195+0000 7fd1ab9b7700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561776ad4000 0x5617768d1700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5617769cfcb0 tx=0x5617769314a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.195+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561777483800 0x561776aea000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.196+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561776a11200 con 0x561777483800 2024-04-19T23:45:36.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.196+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561776ad4400 0x561776aea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.196+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776ad4800 con 0x561776ad4400 2024-04-19T23:45:36.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.197+0000 7fd1aa9b5700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561776ad4400 0x561776aea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.197+0000 7fd1aa9b5700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561776ad4400 0x561776aea580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.199+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/2650995271 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561776a11440 con 0x561776ad4400 2024-04-19T23:45:36.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.199+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561776ad4c00 0x561776aeab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.199+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776ad5000 con 0x561776ad4c00 2024-04-19T23:45:36.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.199+0000 7fd1ab9b7700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561776ad4c00 0x561776aeab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.199+0000 7fd1ab9b7700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561776ad4c00 0x561776aeab00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.200+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.200+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776ad5400 con 0x561777483800 2024-04-19T23:45:36.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.203+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561776a11200 con 0x561777483800 2024-04-19T23:45:36.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.203+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561776ad5800 0x561776aeb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.203+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776ad5c00 con 0x561776ad5800 2024-04-19T23:45:36.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.203+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561776ad5800 0x561776aeb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.203+0000 7fd1ab1b6700 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561776ad5800 0x561776aeb080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.206+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'29 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561776a11200 con 0x561776ad5800 2024-04-19T23:45:36.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.206+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8000 con 0x561776ad4c00 2024-04-19T23:45:36.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.207+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.207+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8400 con 0x561777483800 2024-04-19T23:45:36.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.208+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561776a11200 con 0x561777483800 2024-04-19T23:45:36.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.208+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8800 con 0x561776ad4400 2024-04-19T23:45:36.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.209+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/2650995271 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561776a11440 con 0x561776ad4400 2024-04-19T23:45:36.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.209+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8c00 con 0x561776ad5800 2024-04-19T23:45:36.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.210+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561776a11200 con 0x561776ad5800 2024-04-19T23:45:36.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.210+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af9000 con 0x561776ad4c00 2024-04-19T23:45:36.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.211+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'19 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.211+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af9400 con 0x561776ad5800 2024-04-19T23:45:36.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.212+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11200 con 0x561776ad5800 2024-04-19T23:45:36.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.212+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af9800 con 0x561776ad4400 2024-04-19T23:45:36.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.213+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/2650995271 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11440 con 0x561776ad4400 2024-04-19T23:45:36.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.213+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af9c00 con 0x561776ad5800 2024-04-19T23:45:36.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.214+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11200 con 0x561776ad5800 2024-04-19T23:45:36.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.214+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8800 con 0x561776ad4400 2024-04-19T23:45:36.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.215+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/2650995271 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'25 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11440 con 0x561776ad4400 2024-04-19T23:45:36.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.215+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8400 con 0x561777483800 2024-04-19T23:45:36.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.216+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11200 con 0x561777483800 2024-04-19T23:45:36.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.216+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776ad4800 con 0x561776ad4c00 2024-04-19T23:45:36.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.217+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.217+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776ad5400 con 0x561776ad5800 2024-04-19T23:45:36.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.218+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11200 con 0x561776ad5800 2024-04-19T23:45:36.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.218+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776ad5c00 con 0x561776ad4c00 2024-04-19T23:45:36.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.219+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.219+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482c00 con 0x561777483800 2024-04-19T23:45:36.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.220+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11200 con 0x561777483800 2024-04-19T23:45:36.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.220+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483000 con 0x561777483800 2024-04-19T23:45:36.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.221+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'44 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11200 con 0x561777483800 2024-04-19T23:45:36.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.221+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777483c00 con 0x561776ad4c00 2024-04-19T23:45:36.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.222+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.222+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5617765e7c00 con 0x561776ad5800 2024-04-19T23:45:36.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.223+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11200 con 0x561776ad5800 2024-04-19T23:45:36.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.223+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776ad5400 con 0x561776ad4c00 2024-04-19T23:45:36.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.226+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.226+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776ad5000 con 0x561776ad4c00 2024-04-19T23:45:36.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.227+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'19 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.227+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776ad4800 con 0x561776ad4c00 2024-04-19T23:45:36.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.228+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.228+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776ad5c00 con 0x561776ad4c00 2024-04-19T23:45:36.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.229+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.229+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8c00 con 0x561776ad4400 2024-04-19T23:45:36.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.230+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/2650995271 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11440 con 0x561776ad4400 2024-04-19T23:45:36.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.230+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af9400 con 0x561776ad4c00 2024-04-19T23:45:36.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.231+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.231+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af9c00 con 0x561776ad4400 2024-04-19T23:45:36.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.232+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/2650995271 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11440 con 0x561776ad4400 2024-04-19T23:45:36.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.232+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8400 con 0x561776ad4c00 2024-04-19T23:45:36.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.233+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/2650995271 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561776ad4c00 2024-04-19T23:45:36.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.233+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8000 con 0x561776ad4400 2024-04-19T23:45:36.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.234+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/2650995271 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11440 con 0x561776ad4400 2024-04-19T23:45:36.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.234+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af9000 con 0x561776ad5800 2024-04-19T23:45:36.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.235+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561776a11200 con 0x561776ad5800 2024-04-19T23:45:36.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.236+0000 7fd18d97b700 20 reqs_thread_entry: start 2024-04-19T23:45:36.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.236+0000 7fd1ad20ca80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:36.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.236+0000 7fd1ad20ca80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:36.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.236+0000 7fd18b977700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:06 2024 2024-04-19T23:45:36.237 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:36.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.237+0000 7fd18b155700 20 reqs_thread_entry: start 2024-04-19T23:45:36.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.237+0000 7fd1ad20ca80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:36.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.237+0000 7fd1ad20ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.237+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696bc00 con 0x5617765e7800 2024-04-19T23:45:36.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.237+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.237+0000 7fd1ad20ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.237+0000 7fd1ad20ca80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-19T23:45:36.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.237+0000 7fd1ad20ca80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:36.238 INFO:teuthology.orchestra.run.smithi155.stderr:could not remove user: unable to remove user, user does not exist 2024-04-19T23:45:36.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.237+0000 7fd192184700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.237+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94658774671360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561777482c00 con 0x5617765e7800 2024-04-19T23:45:36.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.238+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94658774671360] v30'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.238+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94658773146368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af9400 con 0x56177696b400 2024-04-19T23:45:36.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.239+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94658773146368] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.239+0000 7fd1ad20ca80 20 remove_watcher() i=0 2024-04-19T23:45:36.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.239+0000 7fd1ad20ca80 2 removed watcher, disabling cache 2024-04-19T23:45:36.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.239+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94658773147520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8400 con 0x5617765e7800 2024-04-19T23:45:36.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.241+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94658773147520] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.241+0000 7fd1ad20ca80 20 remove_watcher() i=1 2024-04-19T23:45:36.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.241+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94658773148672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af9800 con 0x56177696b000 2024-04-19T23:45:36.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.242+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/971973404 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94658773148672] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a11200 con 0x56177696b000 2024-04-19T23:45:36.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.242+0000 7fd1ad20ca80 20 remove_watcher() i=2 2024-04-19T23:45:36.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.242+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94658773149824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8800 con 0x56177696b400 2024-04-19T23:45:36.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.243+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94658773149824] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a11440 con 0x56177696b400 2024-04-19T23:45:36.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.243+0000 7fd1ad20ca80 20 remove_watcher() i=3 2024-04-19T23:45:36.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.243+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94658773150976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8c00 con 0x5617765e7800 2024-04-19T23:45:36.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.244+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94658773150976] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x5617765e7800 2024-04-19T23:45:36.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.244+0000 7fd1ad20ca80 20 remove_watcher() i=4 2024-04-19T23:45:36.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.244+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94658773152128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af9c00 con 0x561777482000 2024-04-19T23:45:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.245+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94658773152128] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.245+0000 7fd1ad20ca80 20 remove_watcher() i=5 2024-04-19T23:45:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.245+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94658773153280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561776af8000 con 0x561777482000 2024-04-19T23:45:36.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.246+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94658773153280] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.246+0000 7fd1ad20ca80 20 remove_watcher() i=6 2024-04-19T23:45:36.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.246+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94658773154432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56177696bc00 con 0x561777482000 2024-04-19T23:45:36.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ab9b7700 1 -- 172.21.15.155:0/971973404 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94658773154432] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561776a10b40 con 0x561777482000 2024-04-19T23:45:36.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 20 remove_watcher() i=7 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561777482000 msgr2=0x5617768d1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561777482000 0x5617768d1180 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5617765e7800 msgr2=0x5617768cfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5617765e7800 0x5617768cfb80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56177696b400 msgr2=0x5617768d0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56177696b400 0x5617768d0c00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56177696b000 msgr2=0x5617768d0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56177696b000 0x5617768d0100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56177696ac00 msgr2=0x5617768cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56177696ac00 0x5617768cf600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x561776975d70 tx=0x561776931320 comp rx=0 tx=0).stop 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 msgr2=0x5617768ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/971973404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e7400 0x5617768ceb00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x56177745e810 tx=0x5617766d78c0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 reap_dead start 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1aa9b5700 1 -- 172.21.15.155:0/971973404 reap_dead start 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 shutdown_connections 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 >> 172.21.15.155:0/971973404 conn(0x5617765e6c00 msgr2=0x5617766d3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 shutdown_connections 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.247+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/971973404 wait complete. 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561776ad4400 msgr2=0x561776aea580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561776ad4400 0x561776aea580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561777483800 msgr2=0x561776aea000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561777483800 0x561776aea000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561776ad5800 msgr2=0x561776aeb080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561776ad5800 0x561776aeb080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561776ad4c00 msgr2=0x561776aeab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561776ad4c00 0x561776aeab00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561776ad4000 msgr2=0x5617768d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561776ad4000 0x5617768d1700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5617769cfcb0 tx=0x5617769314a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 msgr2=0x5617768d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/2650995271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561777483400 0x5617768d0680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x561776a57290 tx=0x5617769317a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ab1b6700 1 -- 172.21.15.155:0/2650995271 reap_dead start 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 shutdown_connections 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 >> 172.21.15.155:0/2650995271 conn(0x561777482800 msgr2=0x5617766d4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 shutdown_connections 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/2650995271 wait complete. 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3800033356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56177696a000 msgr2=0x5617768cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/3800033356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56177696a000 0x5617768cf080 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x56177745eff0 tx=0x561776930540 comp rx=0 tx=0).stop 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3800033356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 msgr2=0x5617768ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/3800033356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x561777451f20 tx=0x5617766d7920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3800033356 shutdown_connections 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/3800033356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56177696a000 0x5617768cf080 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 --2- 172.21.15.155:0/3800033356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5617765e6800 0x5617768ce580 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.248+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3800033356 >> 172.21.15.155:0/3800033356 conn(0x5617765e6400 msgr2=0x5617766d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.249+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3800033356 shutdown_connections 2024-04-19T23:45:36.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.249+0000 7fd1ad20ca80 1 -- 172.21.15.155:0/3800033356 wait complete. 2024-04-19T23:45:36.253 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-19T23:45:36.254 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-19T23:45:36.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-19T23:45:36.254 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-19T23:45:36.301 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:36.301 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:36.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.302+0000 7f43f0f43a80 1 Processor -- start 2024-04-19T23:45:36.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.302+0000 7f43f0f43a80 1 -- start start 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.302+0000 7f43f0f43a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x563197c56c00 0x563197f3e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.302+0000 7f43f0f43a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563197f81500 con 0x563197c56800 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.302+0000 7f43f0f43a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x563197cf8a00 con 0x563197c56c00 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.302+0000 7f43ee6ec700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x563197c56c00 0x563197f3e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.302+0000 7f43eeeed700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x563197c56800 0x563197d42800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46474/0 (socket says 172.21.15.155:46474) 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.302+0000 7f43eeeed700 1 -- 172.21.15.155:0/3917823967 learned_addr learned my addr 172.21.15.155:0/3917823967 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43ee6ec700 1 -- 172.21.15.155:0/3917823967 >> v1:172.21.15.76:6789/0 conn(0x563197c56800 legacy=0x563197d42800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43ee6ec700 1 -- 172.21.15.155:0/3917823967 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563197c7fd40 con 0x563197c56c00 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43edeeb700 1 -- 172.21.15.155:0/3917823967 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469083380 0 0) 0x563198a24000 con 0x563197c56800 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43ee6ec700 1 --2- 172.21.15.155:0/3917823967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56c00 0x563197f3e580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x563197f39890 tx=0x563197d47920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f40ad57c180ff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43edeeb700 1 -- 172.21.15.155:0/3917823967 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f4a0 con 0x563197c56c00 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43edeeb700 1 -- 172.21.15.155:0/3917823967 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563197f81800 con 0x563197c56c00 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43edeeb700 1 -- 172.21.15.155:0/3917823967 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f600 con 0x563197c56c00 2024-04-19T23:45:36.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3917823967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56c00 msgr2=0x563197f3e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/3917823967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56c00 0x563197f3e580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x563197f39890 tx=0x563197d47920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3917823967 shutdown_connections 2024-04-19T23:45:36.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/3917823967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56c00 0x563197f3e580 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.303+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3917823967 >> 172.21.15.155:0/3917823967 conn(0x563197c56400 msgr2=0x563197d42000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.304+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3917823967 shutdown_connections 2024-04-19T23:45:36.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.304+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3917823967 wait complete. 2024-04-19T23:45:36.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.304+0000 7f43f0f43a80 1 Processor -- start 2024-04-19T23:45:36.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.304+0000 7f43f0f43a80 1 -- start start 2024-04-19T23:45:36.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.304+0000 7f43f0f43a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.304+0000 7f43f0f43a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563197cf8500 con 0x563197c56800 2024-04-19T23:45:36.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.305+0000 7f43eeeed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.305+0000 7f43eeeed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33638/0 (socket says 172.21.15.155:33638) 2024-04-19T23:45:36.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.305+0000 7f43eeeed700 1 -- 172.21.15.155:0/3943649646 learned_addr learned my addr 172.21.15.155:0/3943649646 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.305+0000 7f43eeeed700 1 -- 172.21.15.155:0/3943649646 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563197c7fba0 con 0x563197c56800 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.305+0000 7f43eeeed700 1 --2- 172.21.15.155:0/3943649646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x563198a27770 tx=0x563197d47b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e073224fcc447d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.305+0000 7f43ed6ea700 1 -- 172.21.15.155:0/3943649646 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f1e0 con 0x563197c56800 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.305+0000 7f43ed6ea700 1 -- 172.21.15.155:0/3943649646 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563197f81b00 con 0x563197c56800 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.305+0000 7f43ed6ea700 1 -- 172.21.15.155:0/3943649646 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f4a0 con 0x563197c56800 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3943649646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 msgr2=0x563197f3e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/3943649646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x563198a27770 tx=0x563197d47b60 comp rx=0 tx=0).stop 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3943649646 shutdown_connections 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/3943649646 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3943649646 >> 172.21.15.155:0/3943649646 conn(0x563197c56400 msgr2=0x563197d43000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3943649646 shutdown_connections 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3943649646 wait complete. 2024-04-19T23:45:36.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43f0f43a80 1 Processor -- start 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43f0f43a80 1 -- start start 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43f0f43a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43f0f43a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563197cf83c0 con 0x563197c56800 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43eeeed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43eeeed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33648/0 (socket says 172.21.15.155:33648) 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.306+0000 7f43eeeed700 1 -- 172.21.15.155:0/2889044447 learned_addr learned my addr 172.21.15.155:0/2889044447 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.307+0000 7f43eeeed700 1 -- 172.21.15.155:0/2889044447 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563197c7fa00 con 0x563197c56800 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.307+0000 7f43eeeed700 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x563198a27e30 tx=0x563197d47a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.307+0000 7f43ebee7700 1 -- 172.21.15.155:0/2889044447 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f600 con 0x563197c56800 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.307+0000 7f43ebee7700 1 -- 172.21.15.155:0/2889044447 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563197cf7c80 con 0x563197c56800 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.307+0000 7f43ebee7700 1 -- 172.21.15.155:0/2889044447 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f1e0 con 0x563197c56800 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.307+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563197c7f860 con 0x563197c56800 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.307+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563197c7f6c0 con 0x563197c56800 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.307+0000 7f43f0f43a80 1 Processor -- start 2024-04-19T23:45:36.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.307+0000 7f43f0f43a80 1 -- start start 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43f0f43a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43f0f43a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563197cf8000 con 0x563197c57400 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43ebee7700 1 -- 172.21.15.155:0/2889044447 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5631989f8b00 con 0x563197c56800 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43ef6ee700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43ef6ee700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33654/0 (socket says 172.21.15.155:33654) 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43ef6ee700 1 -- 172.21.15.155:0/1931764745 learned_addr learned my addr 172.21.15.155:0/1931764745 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43ebee7700 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0000 0x563197f3f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43ebee7700 1 -- 172.21.15.155:0/2889044447 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x563197cd1180 con 0x563197c56800 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43eeeed700 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0000 0x563197f3f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43ef6ee700 1 -- 172.21.15.155:0/1931764745 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563197c7e000 con 0x563197c57400 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43eeeed700 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0000 0x563197f3f080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x563198af0f90 tx=0x563197fa8240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43ef6ee700 1 --2- 172.21.15.155:0/1931764745 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x563198af1da0 tx=0x563197fa8120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8735df65a7b177 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43e96e2700 1 -- 172.21.15.155:0/1931764745 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f600 con 0x563197c57400 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43e96e2700 1 -- 172.21.15.155:0/1931764745 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563197f80300 con 0x563197c57400 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.308+0000 7f43e96e2700 1 -- 172.21.15.155:0/1931764745 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f1e0 con 0x563197c57400 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.309+0000 7f43f0f43a80 1 -- 172.21.15.155:0/1931764745 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 msgr2=0x563197f3eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.309+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/1931764745 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x563198af1da0 tx=0x563197fa8120 comp rx=0 tx=0).stop 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.309+0000 7f43f0f43a80 1 -- 172.21.15.155:0/1931764745 shutdown_connections 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.309+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/1931764745 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.309+0000 7f43f0f43a80 1 -- 172.21.15.155:0/1931764745 >> 172.21.15.155:0/1931764745 conn(0x563197c56c00 msgr2=0x563197d43800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.309+0000 7f43f0f43a80 1 -- 172.21.15.155:0/1931764745 shutdown_connections 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.309+0000 7f43f0f43a80 1 -- 172.21.15.155:0/1931764745 wait complete. 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.309+0000 7f43f0f43a80 1 Processor -- start 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.309+0000 7f43f0f43a80 1 -- start start 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.309+0000 7f43f0f43a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.309+0000 7f43f0f43a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563197c92640 con 0x563197c57400 2024-04-19T23:45:36.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.310+0000 7f43ef6ee700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.310+0000 7f43ef6ee700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33660/0 (socket says 172.21.15.155:33660) 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.310+0000 7f43ef6ee700 1 -- 172.21.15.155:0/2087905356 learned_addr learned my addr 172.21.15.155:0/2087905356 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.310+0000 7f43ef6ee700 1 -- 172.21.15.155:0/2087905356 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563197c7eea0 con 0x563197c57400 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.310+0000 7f43ef6ee700 1 --2- 172.21.15.155:0/2087905356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x563198a27f50 tx=0x563197fa88a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.310+0000 7f43e7edf700 1 -- 172.21.15.155:0/2087905356 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0fa20 con 0x563197c57400 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.310+0000 7f43e7edf700 1 -- 172.21.15.155:0/2087905356 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563197cf7c80 con 0x563197c57400 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.310+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2087905356 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563197c7e820 con 0x563197c57400 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.310+0000 7f43e7edf700 1 -- 172.21.15.155:0/2087905356 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f600 con 0x563197c57400 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.310+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2087905356 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563197c7e9c0 con 0x563197c57400 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.311+0000 7f43e7edf700 1 -- 172.21.15.155:0/2087905356 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5631989f8dc0 con 0x563197c57400 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.311+0000 7f43e7edf700 1 --2- 172.21.15.155:0/2087905356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0c00 0x563197f3f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.311+0000 7f43e7edf700 1 -- 172.21.15.155:0/2087905356 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x563197cd1340 con 0x563197c57400 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.311+0000 7f43f0f43a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:36.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.311+0000 7f43f0f43a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.311+0000 7f43ee6ec700 1 --2- 172.21.15.155:0/2087905356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0c00 0x563197f3f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.311+0000 7f43f0f43a80 1 Processor -- start 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.311+0000 7f43f0f43a80 1 -- start start 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.312+0000 7f43f0f43a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.312+0000 7f43ee6ec700 1 --2- 172.21.15.155:0/2087905356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0c00 0x563197f3f600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x563197f39890 tx=0x563197d47800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.312+0000 7f43f0f43a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563197c928c0 con 0x563197c57c00 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.312+0000 7f43eeeed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.312+0000 7f43eeeed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33674/0 (socket says 172.21.15.155:33674) 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.312+0000 7f43eeeed700 1 -- 172.21.15.155:0/1453980295 learned_addr learned my addr 172.21.15.155:0/1453980295 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.312+0000 7f43eeeed700 1 -- 172.21.15.155:0/1453980295 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563197c7eb60 con 0x563197c57c00 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.312+0000 7f43eeeed700 1 --2- 172.21.15.155:0/1453980295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x563198af01b0 tx=0x563197fa89c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feed398f950b2b41 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.312+0000 7f43d5ebb700 1 -- 172.21.15.155:0/1453980295 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f4a0 con 0x563197c57c00 2024-04-19T23:45:36.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.312+0000 7f43d5ebb700 1 -- 172.21.15.155:0/1453980295 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563197cf7c80 con 0x563197c57c00 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.312+0000 7f43d5ebb700 1 -- 172.21.15.155:0/1453980295 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f8c0 con 0x563197c57c00 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.313+0000 7f43f0f43a80 1 -- 172.21.15.155:0/1453980295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 msgr2=0x563197f3fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.313+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/1453980295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x563198af01b0 tx=0x563197fa89c0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.313+0000 7f43f0f43a80 1 -- 172.21.15.155:0/1453980295 shutdown_connections 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.313+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/1453980295 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.313+0000 7f43f0f43a80 1 -- 172.21.15.155:0/1453980295 >> 172.21.15.155:0/1453980295 conn(0x563197c57800 msgr2=0x563197d44000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.313+0000 7f43f0f43a80 1 -- 172.21.15.155:0/1453980295 shutdown_connections 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.313+0000 7f43f0f43a80 1 -- 172.21.15.155:0/1453980295 wait complete. 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.313+0000 7f43f0f43a80 1 Processor -- start 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.313+0000 7f43f0f43a80 1 -- start start 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.313+0000 7f43f0f43a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.313+0000 7f43f0f43a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563197c92f00 con 0x563197c57c00 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.314+0000 7f43eeeed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.314+0000 7f43eeeed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33682/0 (socket says 172.21.15.155:33682) 2024-04-19T23:45:36.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.314+0000 7f43eeeed700 1 -- 172.21.15.155:0/3629741181 learned_addr learned my addr 172.21.15.155:0/3629741181 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.314+0000 7f43eeeed700 1 -- 172.21.15.155:0/3629741181 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563197c7ed00 con 0x563197c57c00 2024-04-19T23:45:36.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.314+0000 7f43eeeed700 1 --2- 172.21.15.155:0/3629741181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x563197fe8de0 tx=0x563197fa81e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.314+0000 7f43d46b8700 1 -- 172.21.15.155:0/3629741181 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f4a0 con 0x563197c57c00 2024-04-19T23:45:36.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.314+0000 7f43d46b8700 1 -- 172.21.15.155:0/3629741181 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5631980a8000 con 0x563197c57c00 2024-04-19T23:45:36.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.314+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3629741181 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563197c7e340 con 0x563197c57c00 2024-04-19T23:45:36.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.314+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3629741181 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631980b0000 con 0x563197c57c00 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.315+0000 7f43d26b4700 20 reqs_thread_entry: start 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.315+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563197fe1c00 0x563197f40100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.315+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631980e2000 con 0x563197fe1c00 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.315+0000 7f43d46b8700 1 -- 172.21.15.155:0/3629741181 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563197d0f8c0 con 0x563197c57c00 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.315+0000 7f43d46b8700 1 -- 172.21.15.155:0/3629741181 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5631989f9b80 con 0x563197c57c00 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.315+0000 7f43ee6ec700 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563197fe1c00 0x563197f40100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.315+0000 7f43d46b8700 1 --2- 172.21.15.155:0/3629741181 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5631980e3400 0x563197f40c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.315+0000 7f43d46b8700 1 -- 172.21.15.155:0/3629741181 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x563197cd1500 con 0x563197c57c00 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.315+0000 7f43ef6ee700 1 --2- 172.21.15.155:0/3629741181 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5631980e3400 0x563197f40c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.316+0000 7f43ee6ec700 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563197fe1c00 0x563197f40100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.316+0000 7f43ef6ee700 1 --2- 172.21.15.155:0/3629741181 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5631980e3400 0x563197f40c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x5631980382a0 tx=0x563197fa9080 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.316+0000 7f43ee6ec700 1 -- 172.21.15.155:0/2889044447 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x563198124240 con 0x563197fe1c00 2024-04-19T23:45:36.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.316+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631980e2400 con 0x563197fe1c00 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.316+0000 7f43ee6ec700 1 -- 172.21.15.155:0/2889044447 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [call out=24b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+898 (crc 0 0 0) 0x563198124240 con 0x563197fe1c00 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.316+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [stat,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5631980e2800 con 0x563197fe1c00 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.318+0000 7f43ee6ec700 1 -- 172.21.15.155:0/2889044447 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [stat,call,writefull 0~874] v30'2 uv2 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x563198124240 con 0x563197fe1c00 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2087905356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0c00 msgr2=0x563197f3f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/2087905356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0c00 0x563197f3f600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x563197f39890 tx=0x563197d47800 comp rx=0 tx=0).stop 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2087905356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 msgr2=0x563197f3eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/2087905356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x563198a27f50 tx=0x563197fa88a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2087905356 shutdown_connections 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/2087905356 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0c00 0x563197f3f600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/2087905356 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57400 0x563197f3eb00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2087905356 >> 172.21.15.155:0/2087905356 conn(0x563197c56c00 msgr2=0x563197d43800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2087905356 shutdown_connections 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2087905356 wait complete. 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3629741181 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5631980e3400 msgr2=0x563197f40c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/3629741181 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5631980e3400 0x563197f40c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x5631980382a0 tx=0x563197fa9080 comp rx=0 tx=0).stop 2024-04-19T23:45:36.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3629741181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 msgr2=0x563197f3fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/3629741181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x563197fe8de0 tx=0x563197fa81e0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3629741181 shutdown_connections 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/3629741181 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5631980e3400 0x563197f40c00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/3629741181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c57c00 0x563197f3fb80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3629741181 >> 172.21.15.155:0/3629741181 conn(0x563197c57800 msgr2=0x563197d44000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3629741181 shutdown_connections 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/3629741181 wait complete. 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563197fe1c00 msgr2=0x563197f40100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563197fe1c00 0x563197f40100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0000 msgr2=0x563197f3f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0000 0x563197f3f080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x563198af0f90 tx=0x563197fa8240 comp rx=0 tx=0).stop 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 msgr2=0x563197f3e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.319+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x563198a27e30 tx=0x563197d47a40 comp rx=0 tx=0).stop 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.320+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 shutdown_connections 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.320+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563197fe1c00 0x563197f40100 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.320+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563197c56800 0x563197f3e580 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.320+0000 7f43f0f43a80 1 --2- 172.21.15.155:0/2889044447 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563197fe0000 0x563197f3f080 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.320+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 >> 172.21.15.155:0/2889044447 conn(0x563197c56400 msgr2=0x563197d43000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.320+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 shutdown_connections 2024-04-19T23:45:36.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.320+0000 7f43f0f43a80 1 -- 172.21.15.155:0/2889044447 wait complete. 2024-04-19T23:45:36.329 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "default", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "domain_root": "default.rgw.meta:root", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "control_pool": "default.rgw.control", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "gc_pool": "default.rgw.log:gc", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "lc_pool": "default.rgw.log:lc", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "log_pool": "default.rgw.log", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "intent_log_pool": "default.rgw.log:intent", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "usage_log_pool": "default.rgw.log:usage", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "roles_pool": "default.rgw.meta:roles", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "reshard_pool": "default.rgw.log:reshard", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2024-04-19T23:45:36.330 INFO:teuthology.orchestra.run.smithi155.stdout: "user_email_pool": "default.rgw.meta:users.email", 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "otp_pool": "default.rgw.otp", 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "system_key": { 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "", 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "" 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_pools": [ 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "default-placement", 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "val": { 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": "default.rgw.buckets.index", 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "storage_classes": { 2024-04-19T23:45:36.331 INFO:teuthology.orchestra.run.smithi155.stdout: "STANDARD": { 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": "default.rgw.buckets.data" 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: "index_type": 0, 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: "inline_data": true 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: "realm_id": "", 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout: "notif_pool": "default.rgw.log:notif" 2024-04-19T23:45:36.332 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:36.333 DEBUG:tasks.util.rgw: json result: {'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-04-19T23:45:36.334 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-19T23:45:36.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-19T23:45:36.334 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-19T23:45:36.377 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:36.377 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:36.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.378+0000 7fa2a861aa80 1 Processor -- start 2024-04-19T23:45:36.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.378+0000 7fa2a861aa80 1 -- start start 2024-04-19T23:45:36.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.378+0000 7fa2a861aa80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x563894822800 0x563894b0a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.378+0000 7fa2a861aa80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563894b4d500 con 0x563894822c00 2024-04-19T23:45:36.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.378+0000 7fa2a861aa80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5638948c4a00 con 0x563894822800 2024-04-19T23:45:36.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.379+0000 7fa2a65c4700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x563894822800 0x563894b0a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.379+0000 7fa2a5dc3700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x563894822c00 0x56389490e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46480/0 (socket says 172.21.15.155:46480) 2024-04-19T23:45:36.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.379+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/269583367 learned_addr learned my addr 172.21.15.155:0/269583367 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:36.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.379+0000 7fa2a65c4700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x563894822800 0x563894b0a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33686/0 (socket says 172.21.15.155:33686) 2024-04-19T23:45:36.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.379+0000 7fa2a65c4700 1 -- 172.21.15.155:0/269583367 >> v1:172.21.15.76:6789/0 conn(0x563894822c00 legacy=0x56389490e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.379+0000 7fa2a65c4700 1 -- 172.21.15.155:0/269583367 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389484bd40 con 0x563894822800 2024-04-19T23:45:36.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.379+0000 7fa2a55c2700 1 -- 172.21.15.155:0/269583367 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471520987 0 0) 0x5638955f0000 con 0x563894822c00 2024-04-19T23:45:36.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.379+0000 7fa2a65c4700 1 --2- 172.21.15.155:0/269583367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x563894b059e0 tx=0x563894913920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def447e2f36965cd server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.379+0000 7fa2a55c2700 1 -- 172.21.15.155:0/269583367 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5638948db4a0 con 0x563894822800 2024-04-19T23:45:36.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.379+0000 7fa2a55c2700 1 -- 172.21.15.155:0/269583367 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563894b4d800 con 0x563894822800 2024-04-19T23:45:36.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.379+0000 7fa2a55c2700 1 -- 172.21.15.155:0/269583367 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5638948db600 con 0x563894822800 2024-04-19T23:45:36.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.380+0000 7fa2a861aa80 1 -- 172.21.15.155:0/269583367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 msgr2=0x563894b0a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.380+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/269583367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x563894b059e0 tx=0x563894913920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.380+0000 7fa2a861aa80 1 -- 172.21.15.155:0/269583367 shutdown_connections 2024-04-19T23:45:36.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.380+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/269583367 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.380+0000 7fa2a861aa80 1 -- 172.21.15.155:0/269583367 >> 172.21.15.155:0/269583367 conn(0x563894822400 msgr2=0x56389490e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.380+0000 7fa2a861aa80 1 -- 172.21.15.155:0/269583367 shutdown_connections 2024-04-19T23:45:36.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.380+0000 7fa2a861aa80 1 -- 172.21.15.155:0/269583367 wait complete. 2024-04-19T23:45:36.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.381+0000 7fa2a861aa80 1 Processor -- start 2024-04-19T23:45:36.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.381+0000 7fa2a861aa80 1 -- start start 2024-04-19T23:45:36.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.381+0000 7fa2a861aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.381+0000 7fa2a861aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638948c4500 con 0x563894822800 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.381+0000 7fa2a65c4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.381+0000 7fa2a65c4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33700/0 (socket says 172.21.15.155:33700) 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.381+0000 7fa2a65c4700 1 -- 172.21.15.155:0/2415600346 learned_addr learned my addr 172.21.15.155:0/2415600346 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.381+0000 7fa2a65c4700 1 -- 172.21.15.155:0/2415600346 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389484bba0 con 0x563894822800 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a65c4700 1 --2- 172.21.15.155:0/2415600346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5638955f3800 tx=0x563894913800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c992f05c75f475 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a4dc1700 1 -- 172.21.15.155:0/2415600346 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5638948db760 con 0x563894822800 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a4dc1700 1 -- 172.21.15.155:0/2415600346 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563894b4db00 con 0x563894822800 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a4dc1700 1 -- 172.21.15.155:0/2415600346 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5638948db1e0 con 0x563894822800 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a861aa80 1 -- 172.21.15.155:0/2415600346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 msgr2=0x563894b0a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/2415600346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5638955f3800 tx=0x563894913800 comp rx=0 tx=0).stop 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a861aa80 1 -- 172.21.15.155:0/2415600346 shutdown_connections 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/2415600346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a861aa80 1 -- 172.21.15.155:0/2415600346 >> 172.21.15.155:0/2415600346 conn(0x563894822400 msgr2=0x56389490f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a861aa80 1 -- 172.21.15.155:0/2415600346 shutdown_connections 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a861aa80 1 -- 172.21.15.155:0/2415600346 wait complete. 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.382+0000 7fa2a861aa80 1 Processor -- start 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.383+0000 7fa2a861aa80 1 -- start start 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.383+0000 7fa2a861aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.383+0000 7fa2a861aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638948c43c0 con 0x563894822800 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.383+0000 7fa2a65c4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.383+0000 7fa2a65c4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33712/0 (socket says 172.21.15.155:33712) 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.383+0000 7fa2a65c4700 1 -- 172.21.15.155:0/1002762721 learned_addr learned my addr 172.21.15.155:0/1002762721 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.383+0000 7fa2a65c4700 1 -- 172.21.15.155:0/1002762721 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389484ba00 con 0x563894822800 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.383+0000 7fa2a65c4700 1 --2- 172.21.15.155:0/1002762721 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5638955f3ec0 tx=0x563894913920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a35be700 1 -- 172.21.15.155:0/1002762721 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5638948db4a0 con 0x563894822800 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a35be700 1 -- 172.21.15.155:0/1002762721 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563894b4dc80 con 0x563894822800 2024-04-19T23:45:36.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1002762721 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56389484b860 con 0x563894822800 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a35be700 1 -- 172.21.15.155:0/1002762721 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5638948db600 con 0x563894822800 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1002762721 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56389484b6c0 con 0x563894822800 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a861aa80 1 Processor -- start 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a861aa80 1 -- start start 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a35be700 1 -- 172.21.15.155:0/1002762721 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5638955c4b00 con 0x563894822800 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a861aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a35be700 1 --2- 172.21.15.155:0/1002762721 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894ba0000 0x563894b0b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a861aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638948c4000 con 0x563894823400 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a35be700 1 -- 172.21.15.155:0/1002762721 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56389489d180 con 0x563894822800 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.384+0000 7fa2a65c4700 1 --2- 172.21.15.155:0/1002762721 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894ba0000 0x563894b0b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.385+0000 7fa2a6dc5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.385+0000 7fa2a6dc5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33714/0 (socket says 172.21.15.155:33714) 2024-04-19T23:45:36.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.385+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/1282339711 learned_addr learned my addr 172.21.15.155:0/1282339711 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.385+0000 7fa2a65c4700 1 --2- 172.21.15.155:0/1002762721 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894ba0000 0x563894b0b080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x56389569b050 tx=0x563894b66540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.385+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/1282339711 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389484a000 con 0x563894823400 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.385+0000 7fa2a6dc5700 1 --2- 172.21.15.155:0/1282339711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x56389569a3f0 tx=0x563894b66720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35a3fec86d04b9e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.385+0000 7fa2a0db9700 1 -- 172.21.15.155:0/1282339711 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5638948db4a0 con 0x563894823400 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.385+0000 7fa2a0db9700 1 -- 172.21.15.155:0/1282339711 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5638948c3c80 con 0x563894823400 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.385+0000 7fa2a0db9700 1 -- 172.21.15.155:0/1282339711 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5638948db600 con 0x563894823400 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.385+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1282339711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 msgr2=0x563894b0ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.385+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/1282339711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x56389569a3f0 tx=0x563894b66720 comp rx=0 tx=0).stop 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1282339711 shutdown_connections 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/1282339711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1282339711 >> 172.21.15.155:0/1282339711 conn(0x563894822c00 msgr2=0x56389490f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1282339711 shutdown_connections 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1282339711 wait complete. 2024-04-19T23:45:36.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a861aa80 1 Processor -- start 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a861aa80 1 -- start start 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a861aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a861aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389485e640 con 0x563894823400 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a6dc5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a6dc5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33726/0 (socket says 172.21.15.155:33726) 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 learned_addr learned my addr 172.21.15.155:0/4160937633 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.386+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389484aea0 con 0x563894823400 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.387+0000 7fa2a6dc5700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x56389569a240 tx=0x5638949138c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.387+0000 7fa29f5b6700 1 -- 172.21.15.155:0/4160937633 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5638948db760 con 0x563894823400 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.387+0000 7fa29f5b6700 1 -- 172.21.15.155:0/4160937633 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5638948c3b00 con 0x563894823400 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.387+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56389484a820 con 0x563894823400 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.387+0000 7fa29f5b6700 1 -- 172.21.15.155:0/4160937633 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5638948db4a0 con 0x563894823400 2024-04-19T23:45:36.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.387+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56389484a9c0 con 0x563894823400 2024-04-19T23:45:36.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.388+0000 7fa29f5b6700 1 -- 172.21.15.155:0/4160937633 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5638955c4dc0 con 0x563894823400 2024-04-19T23:45:36.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.388+0000 7fa2a861aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.388+0000 7fa29f5b6700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894ba0c00 0x563894b0b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.388+0000 7fa29f5b6700 1 -- 172.21.15.155:0/4160937633 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56389489d340 con 0x563894823400 2024-04-19T23:45:36.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.388+0000 7fa2a5dc3700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894ba0c00 0x563894b0b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.388+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563894823800 0x563894b0bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.388+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894823c00 con 0x563894823800 2024-04-19T23:45:36.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.388+0000 7fa2a6dc5700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563894823800 0x563894b0bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.388+0000 7fa2a5dc3700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894ba0c00 0x563894b0b600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5638955f2030 tx=0x563894b67320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.388+0000 7fa2a6dc5700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563894823800 0x563894b0bb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 20 realm 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1000 con 0x563894823800 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1400 con 0x563894823800 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1800 con 0x563894823800 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.389+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1c00 con 0x563894823800 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.390+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.390+0000 7fa2a861aa80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.390+0000 7fa2a861aa80 20 searching for the correct realm 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.390+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563894ba1000 0x563894b0c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.390+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1400 con 0x563894ba1000 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.390+0000 7fa2a65c4700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563894ba1000 0x563894b0c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.390+0000 7fa2a65c4700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563894ba1000 0x563894b0c100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.390+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.390+0000 7fa2a65c4700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563894ba1400 0x563894b0cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.390+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be000 con 0x563894ba1400 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.391+0000 7fa2a5dc3700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563894ba1400 0x563894b0cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.391+0000 7fa2a5dc3700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563894ba1400 0x563894b0cc00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.391+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.391+0000 7fa2a5dc3700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5638956be000 0x563894b0d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.391+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x5638956be000 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.391+0000 7fa2a6dc5700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5638956be000 0x563894b0d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.392+0000 7fa2a6dc5700 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5638956be000 0x563894b0d180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.392+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.392+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894823800 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.392+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.392+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894823800 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.392+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.392+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x5638956be000 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.393+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.393+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x5638956be000 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.393+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.393+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1400 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.393+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.393+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1000 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.393+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.393+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894823800 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.394+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.394+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x5638956be000 2024-04-19T23:45:36.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.394+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.394+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894823800 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.394+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.394+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1400 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.394+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.394+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1000 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.395+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.395+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1000 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.395+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.395+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x5638956be000 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.395+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.395+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1000 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.395+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.395+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1000 2024-04-19T23:45:36.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.396+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.396+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894823800 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.396+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.396+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894823800 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.396+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.396+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x5638956be000 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.396+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.396+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1000 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.397+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.397+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1400 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.397+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.397+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894823800 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.397+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.397+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x5638956be000 2024-04-19T23:45:36.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.397+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.397+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1000 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.398+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.398+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x5638956be000 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.398+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.398+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1400 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.398+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.398+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1000 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.398+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.398+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x5638956be000 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894823800 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1400 2024-04-19T23:45:36.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a861aa80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a861aa80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a861aa80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a861aa80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a861aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894823c00 con 0x563894823800 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a861aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a861aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.399+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bec00 con 0x563894823800 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bf000 con 0x563894ba1400 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 20 zone default found 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 4 Realm: () 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 20 zonegroup default 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bf400 con 0x5638956be000 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.400+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bf800 con 0x563894ba1000 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.401+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.401+0000 7fa2a861aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.401+0000 7fa2a861aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.401+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bfc00 con 0x563894ba1000 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.401+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.401+0000 7fa2a861aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.401+0000 7fa2a861aa80 20 started sync module instance, tier type = 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.401+0000 7fa2a861aa80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.401+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bec00 con 0x563894ba1400 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.402+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.402+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94801012726528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894823c00 con 0x563894ba1400 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.402+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1800 con 0x563894823800 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.403+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.403+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94801012727680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1c00 con 0x563894823800 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.403+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x563894ba1000 2024-04-19T23:45:36.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.404+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94801012726528] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.404+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94801012727680] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.404+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.404+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94801012728832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bf000 con 0x563894ba1000 2024-04-19T23:45:36.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.405+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bec00 con 0x563894ba1400 2024-04-19T23:45:36.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.405+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.405+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94801012729984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be400 con 0x563894ba1400 2024-04-19T23:45:36.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.405+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bf800 con 0x563894823800 2024-04-19T23:45:36.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.405+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94801012728832] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.408+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.408+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94801012731136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bfc00 con 0x563894823800 2024-04-19T23:45:36.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.408+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956be800 con 0x5638956be000 2024-04-19T23:45:36.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.408+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94801012729984] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.409+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94801012731136] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.410+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.410+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94801012732288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bf400 con 0x5638956be000 2024-04-19T23:45:36.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.410+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bf800 con 0x5638956be000 2024-04-19T23:45:36.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.411+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.411+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94801012733440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bfc00 con 0x5638956be000 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.411+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1800 con 0x5638956be000 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.411+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94801012732288] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.412+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94801012733440] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.413+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.413+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94801012734592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1c00 con 0x5638956be000 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.413+0000 7fa2a861aa80 20 add_watcher() i=0 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.413+0000 7fa2a861aa80 20 add_watcher() i=1 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.413+0000 7fa2a861aa80 20 add_watcher() i=2 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.413+0000 7fa2a861aa80 20 add_watcher() i=3 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.413+0000 7fa2a861aa80 20 add_watcher() i=4 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.413+0000 7fa2a861aa80 20 add_watcher() i=5 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.413+0000 7fa2a861aa80 20 add_watcher() i=6 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.417+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94801012734592] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.417+0000 7fa2a861aa80 20 add_watcher() i=7 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.417+0000 7fa2a861aa80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.417+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1800 con 0x563894823800 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.417+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.417+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94801014243328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1c00 con 0x563894823800 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.418+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94801014243328] v30'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.418+0000 7fa28d592700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.418+0000 7fa2a861aa80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.418+0000 7fa2a861aa80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.419+0000 7fa2a861aa80 1 Processor -- start 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.419+0000 7fa2a861aa80 1 -- start start 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.419+0000 7fa2a861aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.419+0000 7fa2a861aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389485e780 con 0x5638956bf400 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.419+0000 7fa2a5dc3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.419+0000 7fa2a5dc3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33740/0 (socket says 172.21.15.155:33740) 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.419+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/2251356973 learned_addr learned my addr 172.21.15.155:0/2251356973 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.419+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/2251356973 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389484ab60 con 0x5638956bf400 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.420+0000 7fa2a5dc3700 1 --2- 172.21.15.155:0/2251356973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x563894c7c0c0 tx=0x563894b67680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a6f55049cee4c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.420+0000 7fa28cd91700 1 -- 172.21.15.155:0/2251356973 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563894c8c000 con 0x5638956bf400 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.420+0000 7fa28cd91700 1 -- 172.21.15.155:0/2251356973 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563894c8e000 con 0x5638956bf400 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.420+0000 7fa28cd91700 1 -- 172.21.15.155:0/2251356973 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563894c8c160 con 0x5638956bf400 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.420+0000 7fa2a861aa80 1 -- 172.21.15.155:0/2251356973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 msgr2=0x563894b0c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.420+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/2251356973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x563894c7c0c0 tx=0x563894b67680 comp rx=0 tx=0).stop 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.420+0000 7fa2a861aa80 1 -- 172.21.15.155:0/2251356973 shutdown_connections 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.420+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/2251356973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.420+0000 7fa2a861aa80 1 -- 172.21.15.155:0/2251356973 >> 172.21.15.155:0/2251356973 conn(0x5638956be800 msgr2=0x563894910000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.421+0000 7fa2a861aa80 1 -- 172.21.15.155:0/2251356973 shutdown_connections 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.421+0000 7fa2a861aa80 1 -- 172.21.15.155:0/2251356973 wait complete. 2024-04-19T23:45:36.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.421+0000 7fa2a861aa80 1 Processor -- start 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.421+0000 7fa2a861aa80 1 -- start start 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.421+0000 7fa2a861aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.421+0000 7fa2a861aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638948c4000 con 0x5638956bf400 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.421+0000 7fa2a5dc3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.421+0000 7fa2a5dc3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33752/0 (socket says 172.21.15.155:33752) 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.421+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/1020253010 learned_addr learned my addr 172.21.15.155:0/1020253010 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.421+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/1020253010 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389484ad00 con 0x5638956bf400 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.422+0000 7fa2a5dc3700 1 --2- 172.21.15.155:0/1020253010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x563894c7c2d0 tx=0x563894b677a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.422+0000 7fa28b58e700 1 -- 172.21.15.155:0/1020253010 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563894c8c2c0 con 0x5638956bf400 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.422+0000 7fa28b58e700 1 -- 172.21.15.155:0/1020253010 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563894c8e180 con 0x5638956bf400 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.422+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1020253010 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56389484a340 con 0x5638956bf400 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.422+0000 7fa28b58e700 1 -- 172.21.15.155:0/1020253010 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563894c8c000 con 0x5638956bf400 2024-04-19T23:45:36.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.422+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1020253010 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56389484ab60 con 0x5638956bf400 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.423+0000 7fa28b58e700 1 -- 172.21.15.155:0/1020253010 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5638955c5b80 con 0x5638956bf400 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.423+0000 7fa28b58e700 1 --2- 172.21.15.155:0/1020253010 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894d10000 0x563894b0d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.423+0000 7fa28b58e700 1 -- 172.21.15.155:0/1020253010 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56389489d500 con 0x5638956bf400 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.423+0000 7fa2a861aa80 5 note: GC not initialized 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.423+0000 7fa2a6dc5700 1 --2- 172.21.15.155:0/1020253010 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894d10000 0x563894b0d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.423+0000 7fa2a6dc5700 1 --2- 172.21.15.155:0/1020253010 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894d10000 0x563894b0d700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x563894ba3e90 tx=0x563894b674a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.424+0000 7fa288d89700 20 reqs_thread_entry: start 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.424+0000 7fa2a861aa80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.424+0000 7fa2a861aa80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.424+0000 7fa286d85700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:06 2024 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.424+0000 7fa286563700 20 reqs_thread_entry: start 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.424+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bfc00 con 0x563894823800 2024-04-19T23:45:36.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.424+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.424+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d10400 con 0x563894ba1400 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.425+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.425+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d10800 con 0x563894823800 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.425+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.425+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d10c00 con 0x563894ba1000 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.425+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.425+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11000 con 0x563894ba1000 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.425+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.425+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11400 con 0x563894ba1000 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.425+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.426+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11800 con 0x563894823800 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.426+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.426+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11c00 con 0x563894823800 2024-04-19T23:45:36.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.426+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.426+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d76000 con 0x563894ba1000 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.426+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.426+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d76400 con 0x563894ba1000 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.426+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.426+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d76800 con 0x5638956be000 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.427+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.427+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d76c00 con 0x563894823800 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.427+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.427+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d77000 con 0x563894ba1400 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.427+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.427+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d77400 con 0x563894ba1000 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.427+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.427+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d77800 con 0x5638956be000 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.428+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.428+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d77c00 con 0x5638956be000 2024-04-19T23:45:36.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.428+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.428+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d77000 con 0x563894ba1000 2024-04-19T23:45:36.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.428+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.428+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d10400 con 0x5638956be000 2024-04-19T23:45:36.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.429+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.429+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d10800 con 0x563894823800 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.429+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.429+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11800 con 0x563894ba1000 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.429+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.429+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11c00 con 0x5638956be000 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.429+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.429+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d10c00 con 0x563894ba1400 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.429+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.429+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11000 con 0x5638956be000 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.430+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.430+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11400 con 0x563894823800 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.430+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.430+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bec00 con 0x563894823800 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.430+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.430+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bfc00 con 0x563894ba1000 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.430+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.430+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bf000 con 0x563894823800 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.431+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.431+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1800 con 0x563894823800 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.431+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.431+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1c00 con 0x563894ba1000 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.431+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.431+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894823c00 con 0x563894ba1000 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.431+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.431+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11800 con 0x563894ba1000 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.431+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.431+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d10400 con 0x5638956be000 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.432+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.433+0000 7fa28d592700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.433+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94801014243328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d10800 con 0x563894823800 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.434+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94801014243328] v30'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.434+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94801012726528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11c00 con 0x563894ba1400 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.436+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94801012726528] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.436+0000 7fa2a861aa80 20 remove_watcher() i=0 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.436+0000 7fa2a861aa80 2 removed watcher, disabling cache 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.436+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94801012727680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11000 con 0x563894823800 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.438+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94801012727680] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.438+0000 7fa2a861aa80 20 remove_watcher() i=1 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.438+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94801012728832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894d11400 con 0x563894ba1000 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.439+0000 7fa2a65c4700 1 -- 172.21.15.155:0/4160937633 <== osd.3 v2:172.21.15.155:6808/41835 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94801012728832] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f200 con 0x563894ba1000 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.439+0000 7fa2a861aa80 20 remove_watcher() i=2 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.439+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94801012729984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894ba1c00 con 0x563894ba1400 2024-04-19T23:45:36.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.440+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94801012729984] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4f440 con 0x563894ba1400 2024-04-19T23:45:36.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.440+0000 7fa2a861aa80 20 remove_watcher() i=3 2024-04-19T23:45:36.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.440+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94801012731136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638956bfc00 con 0x563894823800 2024-04-19T23:45:36.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.441+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.1 v2:172.21.15.155:6800/41833 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94801012731136] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x563894823800 2024-04-19T23:45:36.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.441+0000 7fa2a861aa80 20 remove_watcher() i=4 2024-04-19T23:45:36.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.441+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94801012732288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894c30000 con 0x5638956be000 2024-04-19T23:45:36.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.442+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94801012732288] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.442+0000 7fa2a861aa80 20 remove_watcher() i=5 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.442+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94801012733440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894c30400 con 0x5638956be000 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.443+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94801012733440] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.443+0000 7fa2a861aa80 20 remove_watcher() i=6 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.443+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94801012734592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563894c30800 con 0x5638956be000 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a6dc5700 1 -- 172.21.15.155:0/4160937633 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94801012734592] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563894c4eb40 con 0x5638956be000 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 20 remove_watcher() i=7 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5638956be000 msgr2=0x563894b0d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5638956be000 0x563894b0d180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563894823800 msgr2=0x563894b0bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563894823800 0x563894b0bb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563894ba1400 msgr2=0x563894b0cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563894ba1400 0x563894b0cc00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563894ba1000 msgr2=0x563894b0c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563894ba1000 0x563894b0c100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894ba0c00 msgr2=0x563894b0b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894ba0c00 0x563894b0b600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5638955f2030 tx=0x563894b67320 comp rx=0 tx=0).stop 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 msgr2=0x563894b0ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x56389569a240 tx=0x5638949138c0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.444+0000 7fa2a5dc3700 1 -- 172.21.15.155:0/4160937633 reap_dead start 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 shutdown_connections 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/4160937633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894823400 0x563894b0ab00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 >> 172.21.15.155:0/4160937633 conn(0x563894822c00 msgr2=0x56389490f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 shutdown_connections 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/4160937633 wait complete. 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1020253010 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894d10000 msgr2=0x563894b0d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/1020253010 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894d10000 0x563894b0d700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x563894ba3e90 tx=0x563894b674a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1020253010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 msgr2=0x563894b0c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/1020253010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x563894c7c2d0 tx=0x563894b677a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1020253010 shutdown_connections 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/1020253010 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894d10000 0x563894b0d700 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/1020253010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5638956bf400 0x563894b0c680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1020253010 >> 172.21.15.155:0/1020253010 conn(0x5638956be800 msgr2=0x563894910000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1020253010 shutdown_connections 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1020253010 wait complete. 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1002762721 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894ba0000 msgr2=0x563894b0b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/1002762721 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894ba0000 0x563894b0b080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x56389569b050 tx=0x563894b66540 comp rx=0 tx=0).stop 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1002762721 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 msgr2=0x563894b0a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/1002762721 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5638955f3ec0 tx=0x563894913920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1002762721 shutdown_connections 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/1002762721 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563894ba0000 0x563894b0b080 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 --2- 172.21.15.155:0/1002762721 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563894822800 0x563894b0a580 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.445+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1002762721 >> 172.21.15.155:0/1002762721 conn(0x563894822400 msgr2=0x56389490f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.446+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1002762721 shutdown_connections 2024-04-19T23:45:36.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.446+0000 7fa2a861aa80 1 -- 172.21.15.155:0/1002762721 wait complete. 2024-04-19T23:45:36.452 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:36.452 INFO:teuthology.orchestra.run.smithi155.stdout: "entries": [], 2024-04-19T23:45:36.452 INFO:teuthology.orchestra.run.smithi155.stdout: "summary": [] 2024-04-19T23:45:36.452 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:36.452 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-19T23:45:36.452 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-19T23:45:36.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-19T23:45:36.452 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-19T23:45:36.497 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:36.498 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:36.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.498+0000 7fb0f5786a80 1 Processor -- start 2024-04-19T23:45:36.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.499+0000 7fb0f5786a80 1 -- start start 2024-04-19T23:45:36.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.499+0000 7fb0f5786a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55be90172800 0x55be9045a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.499+0000 7fb0f5786a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55be9049d500 con 0x55be90172c00 2024-04-19T23:45:36.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.499+0000 7fb0f5786a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55be90214a00 con 0x55be90172800 2024-04-19T23:45:36.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.499+0000 7fb0f3730700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55be90172800 0x55be9045a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.499+0000 7fb0f2f2f700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55be90172c00 0x55be9025e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46494/0 (socket says 172.21.15.155:46494) 2024-04-19T23:45:36.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.499+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/3190538387 learned_addr learned my addr 172.21.15.155:0/3190538387 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:36.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.499+0000 7fb0f272e700 1 -- 172.21.15.155:0/3190538387 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691398771 0 0) 0x55be90f40000 con 0x55be90172c00 2024-04-19T23:45:36.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.499+0000 7fb0f3730700 1 -- 172.21.15.155:0/3190538387 >> v1:172.21.15.76:6789/0 conn(0x55be90172c00 legacy=0x55be9025e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.499+0000 7fb0f3730700 1 -- 172.21.15.155:0/3190538387 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be9019bd40 con 0x55be90172800 2024-04-19T23:45:36.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.500+0000 7fb0f3730700 1 --2- 172.21.15.155:0/3190538387 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55be904559e0 tx=0x55be90263920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73fd4f75a6e3d7af server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.500+0000 7fb0f272e700 1 -- 172.21.15.155:0/3190538387 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be9022b4a0 con 0x55be90172800 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.500+0000 7fb0f272e700 1 -- 172.21.15.155:0/3190538387 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be9049d800 con 0x55be90172800 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.500+0000 7fb0f272e700 1 -- 172.21.15.155:0/3190538387 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be9022b600 con 0x55be90172800 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.500+0000 7fb0f5786a80 1 -- 172.21.15.155:0/3190538387 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 msgr2=0x55be9045a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.500+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/3190538387 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55be904559e0 tx=0x55be90263920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.500+0000 7fb0f5786a80 1 -- 172.21.15.155:0/3190538387 shutdown_connections 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.500+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/3190538387 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.500+0000 7fb0f5786a80 1 -- 172.21.15.155:0/3190538387 >> 172.21.15.155:0/3190538387 conn(0x55be90172400 msgr2=0x55be9025e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.500+0000 7fb0f5786a80 1 -- 172.21.15.155:0/3190538387 shutdown_connections 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.500+0000 7fb0f5786a80 1 -- 172.21.15.155:0/3190538387 wait complete. 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.501+0000 7fb0f5786a80 1 Processor -- start 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.501+0000 7fb0f5786a80 1 -- start start 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.501+0000 7fb0f5786a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.501+0000 7fb0f5786a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be90214500 con 0x55be90172800 2024-04-19T23:45:36.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.501+0000 7fb0f3730700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.501+0000 7fb0f3730700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33778/0 (socket says 172.21.15.155:33778) 2024-04-19T23:45:36.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.501+0000 7fb0f3730700 1 -- 172.21.15.155:0/657735818 learned_addr learned my addr 172.21.15.155:0/657735818 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f3730700 1 -- 172.21.15.155:0/657735818 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be9019bba0 con 0x55be90172800 2024-04-19T23:45:36.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f3730700 1 --2- 172.21.15.155:0/657735818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55be90f43800 tx=0x55be90263800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c7e53f5e19779b server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f1f2d700 1 -- 172.21.15.155:0/657735818 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be9022b760 con 0x55be90172800 2024-04-19T23:45:36.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f1f2d700 1 -- 172.21.15.155:0/657735818 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be9049db00 con 0x55be90172800 2024-04-19T23:45:36.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f1f2d700 1 -- 172.21.15.155:0/657735818 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be9022b4a0 con 0x55be90172800 2024-04-19T23:45:36.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f5786a80 1 -- 172.21.15.155:0/657735818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 msgr2=0x55be9045a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/657735818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55be90f43800 tx=0x55be90263800 comp rx=0 tx=0).stop 2024-04-19T23:45:36.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f5786a80 1 -- 172.21.15.155:0/657735818 shutdown_connections 2024-04-19T23:45:36.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/657735818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f5786a80 1 -- 172.21.15.155:0/657735818 >> 172.21.15.155:0/657735818 conn(0x55be90172400 msgr2=0x55be9025f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f5786a80 1 -- 172.21.15.155:0/657735818 shutdown_connections 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.502+0000 7fb0f5786a80 1 -- 172.21.15.155:0/657735818 wait complete. 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.503+0000 7fb0f5786a80 1 Processor -- start 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.503+0000 7fb0f5786a80 1 -- start start 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.503+0000 7fb0f5786a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.503+0000 7fb0f5786a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be902143c0 con 0x55be90172800 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.503+0000 7fb0f3730700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.503+0000 7fb0f3730700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33784/0 (socket says 172.21.15.155:33784) 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.503+0000 7fb0f3730700 1 -- 172.21.15.155:0/2363583268 learned_addr learned my addr 172.21.15.155:0/2363583268 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.503+0000 7fb0f3730700 1 -- 172.21.15.155:0/2363583268 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be9019ba00 con 0x55be90172800 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f3730700 1 --2- 172.21.15.155:0/2363583268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55be90f43ec0 tx=0x55be90263920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f072a700 1 -- 172.21.15.155:0/2363583268 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be9022b600 con 0x55be90172800 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f072a700 1 -- 172.21.15.155:0/2363583268 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be9049dc80 con 0x55be90172800 2024-04-19T23:45:36.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2363583268 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be9019b860 con 0x55be90172800 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f072a700 1 -- 172.21.15.155:0/2363583268 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be9022b8c0 con 0x55be90172800 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2363583268 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be9019b6c0 con 0x55be90172800 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f5786a80 1 Processor -- start 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f5786a80 1 -- start start 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f072a700 1 -- 172.21.15.155:0/2363583268 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55be90f14b00 con 0x55be90172800 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f5786a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 0x55be9045ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f5786a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be90214000 con 0x55be90173400 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f072a700 1 --2- 172.21.15.155:0/2363583268 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be904f0000 0x55be9045b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.504+0000 7fb0f072a700 1 -- 172.21.15.155:0/2363583268 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55be901ed180 con 0x55be90172800 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.505+0000 7fb0f3730700 1 --2- 172.21.15.155:0/2363583268 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be904f0000 0x55be9045b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.505+0000 7fb0f3f31700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 0x55be9045ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.505+0000 7fb0f3f31700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 0x55be9045ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33788/0 (socket says 172.21.15.155:33788) 2024-04-19T23:45:36.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.505+0000 7fb0f3f31700 1 -- 172.21.15.155:0/2913310964 learned_addr learned my addr 172.21.15.155:0/2913310964 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.505+0000 7fb0f3730700 1 --2- 172.21.15.155:0/2363583268 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be904f0000 0x55be9045b080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55be90fed050 tx=0x55be904b6540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.505+0000 7fb0f3f31700 1 -- 172.21.15.155:0/2913310964 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be9019a000 con 0x55be90173400 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.505+0000 7fb0f3f31700 1 --2- 172.21.15.155:0/2913310964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 0x55be9045ab00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55be90fec360 tx=0x55be904b6720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5ebc042d99058e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.505+0000 7fb0edf25700 1 -- 172.21.15.155:0/2913310964 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be9022b600 con 0x55be90173400 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.505+0000 7fb0edf25700 1 -- 172.21.15.155:0/2913310964 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be90213c80 con 0x55be90173400 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.505+0000 7fb0edf25700 1 -- 172.21.15.155:0/2913310964 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be9022b8c0 con 0x55be90173400 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2913310964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 msgr2=0x55be9045ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/2913310964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 0x55be9045ab00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55be90fec360 tx=0x55be904b6720 comp rx=0 tx=0).stop 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2913310964 shutdown_connections 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/2913310964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 0x55be9045ab00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2913310964 >> 172.21.15.155:0/2913310964 conn(0x55be90172c00 msgr2=0x55be9025f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2913310964 shutdown_connections 2024-04-19T23:45:36.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2913310964 wait complete. 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f5786a80 1 Processor -- start 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f5786a80 1 -- start start 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f5786a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 0x55be9045ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f5786a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be901ae640 con 0x55be90173400 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.506+0000 7fb0f3f31700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 0x55be9045ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.507+0000 7fb0f3f31700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 0x55be9045ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33794/0 (socket says 172.21.15.155:33794) 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.507+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 learned_addr learned my addr 172.21.15.155:0/587257358 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.507+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be9019aea0 con 0x55be90173400 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.507+0000 7fb0f3f31700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 0x55be9045ab00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55be90fec1b0 tx=0x55be902638c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.507+0000 7fb0ec722700 1 -- 172.21.15.155:0/587257358 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be9022b760 con 0x55be90173400 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.507+0000 7fb0ec722700 1 -- 172.21.15.155:0/587257358 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be90213b00 con 0x55be90173400 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.507+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be9019a820 con 0x55be90173400 2024-04-19T23:45:36.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.507+0000 7fb0ec722700 1 -- 172.21.15.155:0/587257358 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be9022b600 con 0x55be90173400 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.507+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be9019a9c0 con 0x55be90173400 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.508+0000 7fb0ec722700 1 -- 172.21.15.155:0/587257358 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55be90f14dc0 con 0x55be90173400 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.508+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.508+0000 7fb0ec722700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be904f0c00 0x55be9045b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.508+0000 7fb0ec722700 1 -- 172.21.15.155:0/587257358 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55be901ed340 con 0x55be90173400 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.508+0000 7fb0f2f2f700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be904f0c00 0x55be9045b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.508+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55be90173800 0x55be9045bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.508+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be90173c00 con 0x55be90173800 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.508+0000 7fb0f3f31700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55be90173800 0x55be9045bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.508+0000 7fb0f2f2f700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be904f0c00 0x55be9045b600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55be90f42030 tx=0x55be904b7320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f3f31700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55be90173800 0x55be9045bb80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f5786a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f5786a80 20 realm 2024-04-19T23:45:36.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be904f1000 con 0x55be90173800 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f5786a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f5786a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be904f1400 con 0x55be90173800 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f5786a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.509+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be904f1800 con 0x55be90173800 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.510+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.510+0000 7fb0f5786a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.510+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.510+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be904f1c00 con 0x55be90173800 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.510+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.510+0000 7fb0f5786a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.510+0000 7fb0f5786a80 20 searching for the correct realm 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.510+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55be904f1000 0x55be9045c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.510+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be904f1400 con 0x55be904f1000 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.510+0000 7fb0f3730700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55be904f1000 0x55be9045c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.510+0000 7fb0f3730700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55be904f1000 0x55be9045c100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.511+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.511+0000 7fb0f3730700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55be904f1400 0x55be9045cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.511+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c000 con 0x55be904f1400 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.511+0000 7fb0f2f2f700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55be904f1400 0x55be9045cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.511+0000 7fb0f2f2f700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55be904f1400 0x55be9045cc00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.511+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.511+0000 7fb0f2f2f700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55be9100c000 0x55be9045d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.511+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be9100c000 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.512+0000 7fb0f3f31700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55be9100c000 0x55be9045d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.512+0000 7fb0f3f31700 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55be9100c000 0x55be9045d180 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.512+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.512+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be90173800 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.513+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.513+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be90173800 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.513+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.513+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be9100c000 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.513+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.513+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be9100c000 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.513+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.513+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1400 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.513+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.513+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1000 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.514+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.514+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be90173800 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.514+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.514+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be9100c000 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.514+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.514+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be90173800 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.514+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.514+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1400 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.515+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.515+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1000 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.515+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.515+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1000 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.515+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.515+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be9100c000 2024-04-19T23:45:36.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.515+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.515+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1000 2024-04-19T23:45:36.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.516+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.516+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1000 2024-04-19T23:45:36.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.516+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.516+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be90173800 2024-04-19T23:45:36.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.516+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.516+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be90173800 2024-04-19T23:45:36.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.516+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.516+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be9100c000 2024-04-19T23:45:36.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.516+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.517+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1000 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.517+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.517+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1400 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.517+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.517+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be90173800 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.517+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.517+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be9100c000 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.518+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.518+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1000 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.518+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.518+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be9100c000 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.518+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.518+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1400 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.518+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.518+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1000 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be9100c000 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be90173800 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1400 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f5786a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f5786a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f5786a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f5786a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.519+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be90173c00 con 0x55be90173800 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100cc00 con 0x55be90173800 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100d000 con 0x55be904f1400 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 20 zone default found 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 4 Realm: () 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:36.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 20 zonegroup default 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100d400 con 0x55be9100c000 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.520+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100d800 con 0x55be904f1000 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.521+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.521+0000 7fb0f5786a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.521+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.521+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100dc00 con 0x55be904f1000 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.521+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.521+0000 7fb0f5786a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.521+0000 7fb0f5786a80 20 started sync module instance, tier type = 2024-04-19T23:45:36.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.521+0000 7fb0f5786a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.521+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100cc00 con 0x55be904f1400 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.522+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.522+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94276952595200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be90173c00 con 0x55be904f1400 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.522+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be904f1800 con 0x55be90173800 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.525+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.525+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94276952596352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be904f1c00 con 0x55be90173800 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.525+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be904f1000 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.525+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94276952595200] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.528+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.528+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94276952596352] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.528+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94276952597504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100d000 con 0x55be904f1000 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.528+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100cc00 con 0x55be904f1400 2024-04-19T23:45:36.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.530+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94276952597504] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.530+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.530+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94276952598656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c400 con 0x55be904f1400 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.530+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100d800 con 0x55be90173800 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.531+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.531+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94276952599808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100dc00 con 0x55be90173800 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.531+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100c800 con 0x55be9100c000 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.531+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94276952598656] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.532+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.532+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94276952600960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100d400 con 0x55be9100c000 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.532+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100d800 con 0x55be9100c000 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.532+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94276952599808] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.533+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.533+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94276952602112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100dc00 con 0x55be9100c000 2024-04-19T23:45:36.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.534+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be904f1800 con 0x55be9100c000 2024-04-19T23:45:36.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.534+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94276952600960] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.534+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94276952602112] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.534+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.535+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94276952603264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be904f1c00 con 0x55be9100c000 2024-04-19T23:45:36.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.535+0000 7fb0f5786a80 20 add_watcher() i=0 2024-04-19T23:45:36.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.535+0000 7fb0f5786a80 20 add_watcher() i=1 2024-04-19T23:45:36.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.535+0000 7fb0f5786a80 20 add_watcher() i=2 2024-04-19T23:45:36.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.535+0000 7fb0f5786a80 20 add_watcher() i=3 2024-04-19T23:45:36.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.535+0000 7fb0f5786a80 20 add_watcher() i=4 2024-04-19T23:45:36.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.535+0000 7fb0f5786a80 20 add_watcher() i=5 2024-04-19T23:45:36.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.535+0000 7fb0f5786a80 20 add_watcher() i=6 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.537+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94276952603264] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.537+0000 7fb0f5786a80 20 add_watcher() i=7 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.537+0000 7fb0f5786a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.537+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be904f1800 con 0x55be90173800 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.538+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.538+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94276954112000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be904f1c00 con 0x55be90173800 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.539+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94276954112000] v30'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.539+0000 7fb0da6fe700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.539+0000 7fb0f5786a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.539+0000 7fb0f5786a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.539+0000 7fb0f5786a80 1 Processor -- start 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.539+0000 7fb0f5786a80 1 -- start start 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.539+0000 7fb0f5786a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.539+0000 7fb0f5786a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be901ae780 con 0x55be9100d400 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.540+0000 7fb0f2f2f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.540+0000 7fb0f2f2f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33806/0 (socket says 172.21.15.155:33806) 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.540+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/4109761269 learned_addr learned my addr 172.21.15.155:0/4109761269 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.540+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/4109761269 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be9019ab60 con 0x55be9100d400 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.540+0000 7fb0f2f2f700 1 --2- 172.21.15.155:0/4109761269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55be905cc0c0 tx=0x55be904b7680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e185781e7d29b2a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.540+0000 7fb0d9efd700 1 -- 172.21.15.155:0/4109761269 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be905dc000 con 0x55be9100d400 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.540+0000 7fb0d9efd700 1 -- 172.21.15.155:0/4109761269 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be905de000 con 0x55be9100d400 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.540+0000 7fb0d9efd700 1 -- 172.21.15.155:0/4109761269 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be905dc160 con 0x55be9100d400 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.541+0000 7fb0f5786a80 1 -- 172.21.15.155:0/4109761269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 msgr2=0x55be9045c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.541+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/4109761269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55be905cc0c0 tx=0x55be904b7680 comp rx=0 tx=0).stop 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.541+0000 7fb0f5786a80 1 -- 172.21.15.155:0/4109761269 shutdown_connections 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.541+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/4109761269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.541+0000 7fb0f5786a80 1 -- 172.21.15.155:0/4109761269 >> 172.21.15.155:0/4109761269 conn(0x55be9100c800 msgr2=0x55be90260000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.541+0000 7fb0f5786a80 1 -- 172.21.15.155:0/4109761269 shutdown_connections 2024-04-19T23:45:36.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.541+0000 7fb0f5786a80 1 -- 172.21.15.155:0/4109761269 wait complete. 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.541+0000 7fb0f5786a80 1 Processor -- start 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.542+0000 7fb0f5786a80 1 -- start start 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.542+0000 7fb0f5786a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.542+0000 7fb0f5786a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be90214000 con 0x55be9100d400 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.542+0000 7fb0f2f2f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.542+0000 7fb0f2f2f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33820/0 (socket says 172.21.15.155:33820) 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.542+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/677432318 learned_addr learned my addr 172.21.15.155:0/677432318 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.542+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/677432318 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be9019ad00 con 0x55be9100d400 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.543+0000 7fb0f2f2f700 1 --2- 172.21.15.155:0/677432318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55be905cc2d0 tx=0x55be904b77a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.543+0000 7fb0d86fa700 1 -- 172.21.15.155:0/677432318 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be905dc2c0 con 0x55be9100d400 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.543+0000 7fb0d86fa700 1 -- 172.21.15.155:0/677432318 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be905de180 con 0x55be9100d400 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.543+0000 7fb0d86fa700 1 -- 172.21.15.155:0/677432318 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55be905dc000 con 0x55be9100d400 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.543+0000 7fb0f5786a80 1 -- 172.21.15.155:0/677432318 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be9019a340 con 0x55be9100d400 2024-04-19T23:45:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.543+0000 7fb0f5786a80 1 -- 172.21.15.155:0/677432318 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be9019ab60 con 0x55be9100d400 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.543+0000 7fb0d86fa700 1 -- 172.21.15.155:0/677432318 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55be90f15b80 con 0x55be9100d400 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.544+0000 7fb0d86fa700 1 --2- 172.21.15.155:0/677432318 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be9065e000 0x55be9045d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.544+0000 7fb0d86fa700 1 -- 172.21.15.155:0/677432318 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55be901ed500 con 0x55be9100d400 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.544+0000 7fb0f5786a80 5 note: GC not initialized 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.544+0000 7fb0f3f31700 1 --2- 172.21.15.155:0/677432318 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be9065e000 0x55be9045d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.544+0000 7fb0f3f31700 1 --2- 172.21.15.155:0/677432318 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be9065e000 0x55be9045d700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55be90551ec0 tx=0x55be904b74a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.545+0000 7fb0d5ef5700 20 reqs_thread_entry: start 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.545+0000 7fb0f5786a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.545+0000 7fb0f5786a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.545+0000 7fb0d3ef1700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:06 2024 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.545+0000 7fb0d36cf700 20 reqs_thread_entry: start 2024-04-19T23:45:36.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.545+0000 7fb0f5786a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.545+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9100dc00 con 0x55be90173800 2024-04-19T23:45:36.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.545+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.545+0000 7fb0f5786a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.551 INFO:teuthology.orchestra.run.smithi155.stderr:could not fetch user info: no user info saved 2024-04-19T23:45:36.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.546+0000 7fb0da6fe700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.546+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94276954112000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9065e400 con 0x55be90173800 2024-04-19T23:45:36.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.547+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94276954112000] v30'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.547+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94276952595200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9065e800 con 0x55be904f1400 2024-04-19T23:45:36.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.550+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94276952595200] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.550+0000 7fb0f5786a80 20 remove_watcher() i=0 2024-04-19T23:45:36.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.550+0000 7fb0f5786a80 2 removed watcher, disabling cache 2024-04-19T23:45:36.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.550+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94276952596352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9065ec00 con 0x55be90173800 2024-04-19T23:45:36.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.551+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94276952596352] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.551+0000 7fb0f5786a80 20 remove_watcher() i=1 2024-04-19T23:45:36.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.551+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94276952597504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9065f000 con 0x55be904f1000 2024-04-19T23:45:36.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.552+0000 7fb0f3730700 1 -- 172.21.15.155:0/587257358 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94276952597504] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a7200 con 0x55be904f1000 2024-04-19T23:45:36.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.552+0000 7fb0f5786a80 20 remove_watcher() i=2 2024-04-19T23:45:36.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.552+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94276952598656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9065f400 con 0x55be904f1400 2024-04-19T23:45:36.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.553+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94276952598656] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a7440 con 0x55be904f1400 2024-04-19T23:45:36.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.553+0000 7fb0f5786a80 20 remove_watcher() i=3 2024-04-19T23:45:36.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.553+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94276952599808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9065f800 con 0x55be90173800 2024-04-19T23:45:36.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.554+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94276952599808] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be90173800 2024-04-19T23:45:36.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.554+0000 7fb0f5786a80 20 remove_watcher() i=4 2024-04-19T23:45:36.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.554+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94276952600960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9065fc00 con 0x55be9100c000 2024-04-19T23:45:36.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.555+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94276952600960] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.555+0000 7fb0f5786a80 20 remove_watcher() i=5 2024-04-19T23:45:36.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.555+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94276952602112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9065e400 con 0x55be9100c000 2024-04-19T23:45:36.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.558+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94276952602112] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.558+0000 7fb0f5786a80 20 remove_watcher() i=6 2024-04-19T23:45:36.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.558+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94276952603264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55be9065ec00 con 0x55be9100c000 2024-04-19T23:45:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f3f31700 1 -- 172.21.15.155:0/587257358 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94276952603264] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55be905a6b40 con 0x55be9100c000 2024-04-19T23:45:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 20 remove_watcher() i=7 2024-04-19T23:45:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55be9100c000 msgr2=0x55be9045d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55be9100c000 0x55be9045d180 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55be90173800 msgr2=0x55be9045bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55be90173800 0x55be9045bb80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55be904f1400 msgr2=0x55be9045cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55be904f1400 0x55be9045cc00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55be904f1000 msgr2=0x55be9045c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55be904f1000 0x55be9045c100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be904f0c00 msgr2=0x55be9045b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be904f0c00 0x55be9045b600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55be90f42030 tx=0x55be904b7320 comp rx=0 tx=0).stop 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 msgr2=0x55be9045ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/587257358 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90173400 0x55be9045ab00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55be90fec1b0 tx=0x55be902638c0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 reap_dead start 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f2f2f700 1 -- 172.21.15.155:0/587257358 reap_dead start 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 shutdown_connections 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 >> 172.21.15.155:0/587257358 conn(0x55be90172c00 msgr2=0x55be9025f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 shutdown_connections 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.561+0000 7fb0f5786a80 1 -- 172.21.15.155:0/587257358 wait complete. 2024-04-19T23:45:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/677432318 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be9065e000 msgr2=0x55be9045d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/677432318 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be9065e000 0x55be9045d700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55be90551ec0 tx=0x55be904b74a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/677432318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 msgr2=0x55be9045c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/677432318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55be905cc2d0 tx=0x55be904b77a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/677432318 shutdown_connections 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/677432318 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be9065e000 0x55be9045d700 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/677432318 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be9100d400 0x55be9045c680 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/677432318 >> 172.21.15.155:0/677432318 conn(0x55be9100c800 msgr2=0x55be90260000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/677432318 shutdown_connections 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/677432318 wait complete. 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2363583268 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be904f0000 msgr2=0x55be9045b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/2363583268 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be904f0000 0x55be9045b080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55be90fed050 tx=0x55be904b6540 comp rx=0 tx=0).stop 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2363583268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 msgr2=0x55be9045a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/2363583268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55be90f43ec0 tx=0x55be90263920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2363583268 shutdown_connections 2024-04-19T23:45:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/2363583268 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55be904f0000 0x55be9045b080 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 --2- 172.21.15.155:0/2363583268 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55be90172800 0x55be9045a580 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2363583268 >> 172.21.15.155:0/2363583268 conn(0x55be90172400 msgr2=0x55be9025f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2363583268 shutdown_connections 2024-04-19T23:45:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.562+0000 7fb0f5786a80 1 -- 172.21.15.155:0/2363583268 wait complete. 2024-04-19T23:45:36.566 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T23:45:36.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-19T23:45:36.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-19T23:45:36.567 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-04-19T23:45:36.622 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:36.622 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:36.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.623+0000 7f320329ea80 1 Processor -- start 2024-04-19T23:45:36.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.623+0000 7f320329ea80 1 -- start start 2024-04-19T23:45:36.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.623+0000 7f320329ea80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x555caec78800 0x555caef60580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.623+0000 7f320329ea80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555caefa3500 con 0x555caec78c00 2024-04-19T23:45:36.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.623+0000 7f320329ea80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x555caed1aa00 con 0x555caec78800 2024-04-19T23:45:36.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.623+0000 7f3201248700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x555caec78800 0x555caef60580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.623+0000 7f3200a47700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x555caec78c00 0x555caed64800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46504/0 (socket says 172.21.15.155:46504) 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.623+0000 7f3200a47700 1 -- 172.21.15.155:0/1192057447 learned_addr learned my addr 172.21.15.155:0/1192057447 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.624+0000 7f3201248700 1 -- 172.21.15.155:0/1192057447 >> v1:172.21.15.76:6789/0 conn(0x555caec78c00 legacy=0x555caed64800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.624+0000 7f3201248700 1 -- 172.21.15.155:0/1192057447 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555caeca1d40 con 0x555caec78800 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.624+0000 7f3201248700 1 --2- 172.21.15.155:0/1192057447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x555caef5b9e0 tx=0x555caed69920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1b47697f71e9b server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.624+0000 7f3200246700 1 -- 172.21.15.155:0/1192057447 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caed314a0 con 0x555caec78800 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.624+0000 7f3200246700 1 -- 172.21.15.155:0/1192057447 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555caefa3800 con 0x555caec78800 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.624+0000 7f3200246700 1 -- 172.21.15.155:0/1192057447 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caed31600 con 0x555caec78800 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.624+0000 7f320329ea80 1 -- 172.21.15.155:0/1192057447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 msgr2=0x555caef60580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.624+0000 7f320329ea80 1 --2- 172.21.15.155:0/1192057447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x555caef5b9e0 tx=0x555caed69920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.624+0000 7f320329ea80 1 -- 172.21.15.155:0/1192057447 shutdown_connections 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.624+0000 7f320329ea80 1 --2- 172.21.15.155:0/1192057447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.624+0000 7f320329ea80 1 -- 172.21.15.155:0/1192057447 >> 172.21.15.155:0/1192057447 conn(0x555caec78400 msgr2=0x555caed64000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.625+0000 7f320329ea80 1 -- 172.21.15.155:0/1192057447 shutdown_connections 2024-04-19T23:45:36.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.625+0000 7f320329ea80 1 -- 172.21.15.155:0/1192057447 wait complete. 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.625+0000 7f320329ea80 1 Processor -- start 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.625+0000 7f320329ea80 1 -- start start 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.625+0000 7f320329ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.625+0000 7f320329ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555caed1a500 con 0x555caec78800 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.626+0000 7f3201248700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.626+0000 7f3201248700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33826/0 (socket says 172.21.15.155:33826) 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.626+0000 7f3201248700 1 -- 172.21.15.155:0/1582586436 learned_addr learned my addr 172.21.15.155:0/1582586436 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.626+0000 7f3201248700 1 -- 172.21.15.155:0/1582586436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555caeca1ba0 con 0x555caec78800 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.626+0000 7f3201248700 1 --2- 172.21.15.155:0/1582586436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x555cafa500c0 tx=0x555caed69800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98afd95a1f388d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.626+0000 7f31ffa45700 1 -- 172.21.15.155:0/1582586436 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caed31760 con 0x555caec78800 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.626+0000 7f31ffa45700 1 -- 172.21.15.155:0/1582586436 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555caefa3b00 con 0x555caec78800 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.626+0000 7f31ffa45700 1 -- 172.21.15.155:0/1582586436 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caed314a0 con 0x555caec78800 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f320329ea80 1 -- 172.21.15.155:0/1582586436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 msgr2=0x555caef60580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f320329ea80 1 --2- 172.21.15.155:0/1582586436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x555cafa500c0 tx=0x555caed69800 comp rx=0 tx=0).stop 2024-04-19T23:45:36.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f320329ea80 1 -- 172.21.15.155:0/1582586436 shutdown_connections 2024-04-19T23:45:36.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f320329ea80 1 --2- 172.21.15.155:0/1582586436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f320329ea80 1 -- 172.21.15.155:0/1582586436 >> 172.21.15.155:0/1582586436 conn(0x555caec78400 msgr2=0x555caed65000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f320329ea80 1 -- 172.21.15.155:0/1582586436 shutdown_connections 2024-04-19T23:45:36.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f320329ea80 1 -- 172.21.15.155:0/1582586436 wait complete. 2024-04-19T23:45:36.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f320329ea80 1 Processor -- start 2024-04-19T23:45:36.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f320329ea80 1 -- start start 2024-04-19T23:45:36.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f320329ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f320329ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555caed1a3c0 con 0x555caec78800 2024-04-19T23:45:36.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f3201248700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f3201248700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33836/0 (socket says 172.21.15.155:33836) 2024-04-19T23:45:36.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.627+0000 7f3201248700 1 -- 172.21.15.155:0/3405977951 learned_addr learned my addr 172.21.15.155:0/3405977951 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.628+0000 7f3201248700 1 -- 172.21.15.155:0/3405977951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555caeca1a00 con 0x555caec78800 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.628+0000 7f3201248700 1 --2- 172.21.15.155:0/3405977951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x555cafa51f80 tx=0x555caed69920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.628+0000 7f31fe242700 1 -- 172.21.15.155:0/3405977951 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caed31600 con 0x555caec78800 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.628+0000 7f31fe242700 1 -- 172.21.15.155:0/3405977951 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555caefa3c80 con 0x555caec78800 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.628+0000 7f320329ea80 1 -- 172.21.15.155:0/3405977951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555caeca1860 con 0x555caec78800 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.628+0000 7f31fe242700 1 -- 172.21.15.155:0/3405977951 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caed318c0 con 0x555caec78800 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.628+0000 7f320329ea80 1 -- 172.21.15.155:0/3405977951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555caeca16c0 con 0x555caec78800 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.628+0000 7f320329ea80 1 Processor -- start 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.628+0000 7f31fe242700 1 -- 172.21.15.155:0/3405977951 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x555cafa1ab00 con 0x555caec78800 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.628+0000 7f320329ea80 1 -- start start 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f320329ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 0x555caef60b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f320329ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555caecb4640 con 0x555caec79400 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f31fe242700 1 --2- 172.21.15.155:0/3405977951 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caeff8000 0x555caef61080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f31fe242700 1 -- 172.21.15.155:0/3405977951 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x555caecf3180 con 0x555caec78800 2024-04-19T23:45:36.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f3201248700 1 --2- 172.21.15.155:0/3405977951 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caeff8000 0x555caef61080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f3201a49700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 0x555caef60b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f3201a49700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 0x555caef60b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33838/0 (socket says 172.21.15.155:33838) 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f3201a49700 1 -- 172.21.15.155:0/3003605899 learned_addr learned my addr 172.21.15.155:0/3003605899 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f3201248700 1 --2- 172.21.15.155:0/3405977951 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caeff8000 0x555caef61080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x555cafb00ed0 tx=0x555caefbe540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f3201a49700 1 -- 172.21.15.155:0/3003605899 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555caeca0000 con 0x555caec79400 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f3201a49700 1 --2- 172.21.15.155:0/3003605899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 0x555caef60b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x555cafb00360 tx=0x555caefbe720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70913e86dd2733c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f31fba3d700 1 -- 172.21.15.155:0/3003605899 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caed31600 con 0x555caec79400 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f31fba3d700 1 -- 172.21.15.155:0/3003605899 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555caed19c80 con 0x555caec79400 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.629+0000 7f31fba3d700 1 -- 172.21.15.155:0/3003605899 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caed318c0 con 0x555caec79400 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f320329ea80 1 -- 172.21.15.155:0/3003605899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 msgr2=0x555caef60b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f320329ea80 1 --2- 172.21.15.155:0/3003605899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 0x555caef60b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x555cafb00360 tx=0x555caefbe720 comp rx=0 tx=0).stop 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f320329ea80 1 -- 172.21.15.155:0/3003605899 shutdown_connections 2024-04-19T23:45:36.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f320329ea80 1 --2- 172.21.15.155:0/3003605899 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 0x555caef60b00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f320329ea80 1 -- 172.21.15.155:0/3003605899 >> 172.21.15.155:0/3003605899 conn(0x555caec78c00 msgr2=0x555caed65800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f320329ea80 1 -- 172.21.15.155:0/3003605899 shutdown_connections 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f320329ea80 1 -- 172.21.15.155:0/3003605899 wait complete. 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f320329ea80 1 Processor -- start 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f320329ea80 1 -- start start 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f320329ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 0x555caef60b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f320329ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555caecb48c0 con 0x555caec79400 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f3201a49700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 0x555caef60b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f3201a49700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 0x555caef60b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33854/0 (socket says 172.21.15.155:33854) 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.630+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 learned_addr learned my addr 172.21.15.155:0/3708097810 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.631+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555caeca0ea0 con 0x555caec79400 2024-04-19T23:45:36.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.631+0000 7f3201a49700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 0x555caef60b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x555cafa51e00 tx=0x555caed698c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.631+0000 7f31fa23a700 1 -- 172.21.15.155:0/3708097810 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caed31760 con 0x555caec79400 2024-04-19T23:45:36.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.631+0000 7f31fa23a700 1 -- 172.21.15.155:0/3708097810 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555caed19b00 con 0x555caec79400 2024-04-19T23:45:36.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.631+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555caeca0820 con 0x555caec79400 2024-04-19T23:45:36.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.631+0000 7f31fa23a700 1 -- 172.21.15.155:0/3708097810 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caed31600 con 0x555caec79400 2024-04-19T23:45:36.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.631+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555caeca09c0 con 0x555caec79400 2024-04-19T23:45:36.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.632+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.632+0000 7f31fa23a700 1 -- 172.21.15.155:0/3708097810 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x555cafa1adc0 con 0x555caec79400 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.632+0000 7f31fa23a700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caeff8c00 0x555caef61600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.632+0000 7f31fa23a700 1 -- 172.21.15.155:0/3708097810 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x555caecf3340 con 0x555caec79400 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.632+0000 7f3200a47700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caeff8c00 0x555caef61600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.632+0000 7f320329ea80 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x555caec79800 0x555caef61b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.632+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caec79c00 con 0x555caec79800 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.632+0000 7f3201a49700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x555caec79800 0x555caef61b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f3200a47700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caeff8c00 0x555caef61600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x555caeff7cb0 tx=0x555caefbf320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f3201a49700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x555caec79800 0x555caef61b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f320329ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f320329ea80 20 realm 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9000 con 0x555caec79800 2024-04-19T23:45:36.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f320329ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f320329ea80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:36.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9400 con 0x555caec79800 2024-04-19T23:45:36.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f320329ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.633+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9800 con 0x555caec79800 2024-04-19T23:45:36.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.634+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.634+0000 7f320329ea80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.634+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.634+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9c00 con 0x555caec79800 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.634+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.634+0000 7f320329ea80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.634+0000 7f320329ea80 20 searching for the correct realm 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.634+0000 7f320329ea80 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x555caeff9000 0x555caef62100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.634+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9400 con 0x555caeff9000 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.634+0000 7f3201248700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x555caeff9000 0x555caef62100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.634+0000 7f3201248700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x555caeff9000 0x555caef62100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.635+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.635+0000 7f3201248700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x555caeff9400 0x555caef62c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.635+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8000 con 0x555caeff9400 2024-04-19T23:45:36.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.635+0000 7f3200a47700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x555caeff9400 0x555caef62c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.635+0000 7f3200a47700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x555caeff9400 0x555caef62c00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.636+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.636+0000 7f3200a47700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x555caefa8000 0x555caef63180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.636+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caefa8000 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.636+0000 7f3201a49700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x555caefa8000 0x555caef63180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.636+0000 7f3201a49700 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x555caefa8000 0x555caef63180 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.636+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.636+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caec79800 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.637+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.637+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caec79800 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.637+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.637+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caefa8000 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.637+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.637+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caefa8000 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.637+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.637+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9400 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.637+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.637+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9000 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.638+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.638+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caec79800 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.638+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.638+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caefa8000 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.638+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.638+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caec79800 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.638+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.638+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9400 2024-04-19T23:45:36.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.639+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.639+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9000 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.639+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.639+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9000 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.639+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.639+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caefa8000 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.640+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.640+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9000 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.640+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.640+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9000 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.640+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.640+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caec79800 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.640+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.640+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caec79800 2024-04-19T23:45:36.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.640+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.640+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caefa8000 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.641+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.641+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9000 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.641+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.641+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9400 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.641+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.641+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caec79800 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.641+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.642+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caefa8000 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.642+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.642+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9000 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.642+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.642+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caefa8000 2024-04-19T23:45:36.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.642+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.642+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9400 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.642+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9000 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caefa8000 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caec79800 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9400 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f320329ea80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f320329ea80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f320329ea80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.643+0000 7f320329ea80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:36.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caec79c00 con 0x555caec79800 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8c00 con 0x555caec79800 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9000 con 0x555caeff9400 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 20 zone default found 2024-04-19T23:45:36.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 4 Realm: () 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 20 zonegroup default 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.644+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9400 con 0x555caefa8000 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f320329ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9800 con 0x555caeff9000 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f320329ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9c00 con 0x555caeff9000 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f320329ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f320329ea80 20 started sync module instance, tier type = 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f320329ea80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.645+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8c00 con 0x555caeff9400 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.647+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.647+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93856560675584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caec79c00 con 0x555caeff9400 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.647+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9800 con 0x555caec79800 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.648+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93856560675584] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.648+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.648+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93856560676736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9c00 con 0x555caec79800 2024-04-19T23:45:36.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.648+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caeff9000 2024-04-19T23:45:36.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.651+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.651+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93856560677888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9000 con 0x555caeff9000 2024-04-19T23:45:36.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.651+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8c00 con 0x555caeff9400 2024-04-19T23:45:36.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.652+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.652+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93856560679040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8400 con 0x555caeff9400 2024-04-19T23:45:36.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.652+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9800 con 0x555caec79800 2024-04-19T23:45:36.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.653+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93856560676736] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.653+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93856560679040] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.656+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.656+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93856560680192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9c00 con 0x555caec79800 2024-04-19T23:45:36.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.656+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8800 con 0x555caefa8000 2024-04-19T23:45:36.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.656+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93856560677888] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.659+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.659+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93856560681344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9400 con 0x555caefa8000 2024-04-19T23:45:36.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.659+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9800 con 0x555caefa8000 2024-04-19T23:45:36.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.662+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93856560680192] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.665+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.665+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93856560681344] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.665+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93856560682496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9c00 con 0x555caefa8000 2024-04-19T23:45:36.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.665+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9800 con 0x555caefa8000 2024-04-19T23:45:36.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.667+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93856560682496] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.670+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.670+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93856560683648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9c00 con 0x555caefa8000 2024-04-19T23:45:36.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.670+0000 7f320329ea80 20 add_watcher() i=0 2024-04-19T23:45:36.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.670+0000 7f320329ea80 20 add_watcher() i=1 2024-04-19T23:45:36.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.670+0000 7f320329ea80 20 add_watcher() i=2 2024-04-19T23:45:36.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.670+0000 7f320329ea80 20 add_watcher() i=3 2024-04-19T23:45:36.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.670+0000 7f320329ea80 20 add_watcher() i=4 2024-04-19T23:45:36.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.670+0000 7f320329ea80 20 add_watcher() i=5 2024-04-19T23:45:36.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.670+0000 7f320329ea80 20 add_watcher() i=6 2024-04-19T23:45:36.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.673+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93856560683648] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.673+0000 7f320329ea80 20 add_watcher() i=7 2024-04-19T23:45:36.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.673+0000 7f320329ea80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:36.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.673+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9800 con 0x555caec79800 2024-04-19T23:45:36.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.674+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.674+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93856562208768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9c00 con 0x555caec79800 2024-04-19T23:45:36.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.675+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93856562208768] v30'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.675+0000 7f31e8216700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.675+0000 7f320329ea80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.675+0000 7f320329ea80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.675+0000 7f320329ea80 1 Processor -- start 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.675+0000 7f320329ea80 1 -- start start 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.675+0000 7f320329ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.675+0000 7f320329ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555caed1a3c0 con 0x555caefa9400 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.675+0000 7f3200a47700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.675+0000 7f3200a47700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33864/0 (socket says 172.21.15.155:33864) 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.675+0000 7f3200a47700 1 -- 172.21.15.155:0/3029894402 learned_addr learned my addr 172.21.15.155:0/3029894402 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.676+0000 7f3200a47700 1 -- 172.21.15.155:0/3029894402 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555caeca0b60 con 0x555caefa9400 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.676+0000 7f3200a47700 1 --2- 172.21.15.155:0/3029894402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x555caf0d60c0 tx=0x555caefbf680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fffe3b2f19b309 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.676+0000 7f31e7a15700 1 -- 172.21.15.155:0/3029894402 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caf0e6000 con 0x555caefa9400 2024-04-19T23:45:36.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.676+0000 7f31e7a15700 1 -- 172.21.15.155:0/3029894402 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555caf0e8000 con 0x555caefa9400 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.676+0000 7f31e7a15700 1 -- 172.21.15.155:0/3029894402 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caf0e6160 con 0x555caefa9400 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f320329ea80 1 -- 172.21.15.155:0/3029894402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 msgr2=0x555caef62680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f320329ea80 1 --2- 172.21.15.155:0/3029894402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x555caf0d60c0 tx=0x555caefbf680 comp rx=0 tx=0).stop 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f320329ea80 1 -- 172.21.15.155:0/3029894402 shutdown_connections 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f320329ea80 1 --2- 172.21.15.155:0/3029894402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f320329ea80 1 -- 172.21.15.155:0/3029894402 >> 172.21.15.155:0/3029894402 conn(0x555caefa8800 msgr2=0x555caed66000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f320329ea80 1 -- 172.21.15.155:0/3029894402 shutdown_connections 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f320329ea80 1 -- 172.21.15.155:0/3029894402 wait complete. 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f320329ea80 1 Processor -- start 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f320329ea80 1 -- start start 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f320329ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f320329ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x555caed1a500 con 0x555caefa9400 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f3200a47700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f3200a47700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33872/0 (socket says 172.21.15.155:33872) 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.677+0000 7f3200a47700 1 -- 172.21.15.155:0/3330532974 learned_addr learned my addr 172.21.15.155:0/3330532974 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.678+0000 7f3200a47700 1 -- 172.21.15.155:0/3330532974 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555caeca0d00 con 0x555caefa9400 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.678+0000 7f3200a47700 1 --2- 172.21.15.155:0/3330532974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x555caf0d6d80 tx=0x555caefbf7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.678+0000 7f31e6212700 1 -- 172.21.15.155:0/3330532974 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caf0e62c0 con 0x555caefa9400 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.678+0000 7f31e6212700 1 -- 172.21.15.155:0/3330532974 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555caf0e8180 con 0x555caefa9400 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.678+0000 7f320329ea80 1 -- 172.21.15.155:0/3330532974 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555caeca0340 con 0x555caefa9400 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.678+0000 7f31e6212700 1 -- 172.21.15.155:0/3330532974 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555caf0e6000 con 0x555caefa9400 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.678+0000 7f320329ea80 1 -- 172.21.15.155:0/3330532974 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555caeca0b60 con 0x555caefa9400 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.679+0000 7f31e6212700 1 -- 172.21.15.155:0/3330532974 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x555cafa1bb80 con 0x555caefa9400 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.679+0000 7f31e6212700 1 --2- 172.21.15.155:0/3330532974 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caf166000 0x555caef63700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.679+0000 7f31e6212700 1 -- 172.21.15.155:0/3330532974 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x555caecf3500 con 0x555caefa9400 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.679+0000 7f320329ea80 5 note: GC not initialized 2024-04-19T23:45:36.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.679+0000 7f3201a49700 1 --2- 172.21.15.155:0/3330532974 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caf166000 0x555caef63700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.679+0000 7f3201a49700 1 --2- 172.21.15.155:0/3330532974 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caf166000 0x555caef63700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x555caf065ce0 tx=0x555caefbf4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f31e3a0d700 20 reqs_thread_entry: start 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f320329ea80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f320329ea80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f31e1a09700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:06 2024 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f31e11e7700 20 reqs_thread_entry: start 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f320329ea80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9c00 con 0x555caec79800 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f320329ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f320329ea80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f320329ea80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:36.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f320329ea80 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.680+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf166400 con 0x555caec79800 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf166800 con 0x555caefa8000 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-04-19T23:45:36.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-19T23:45:36.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-19T23:45:36.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-19T23:45:36.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.681+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf166c00 con 0x555caec79800 2024-04-19T23:45:36.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.682+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~357] v30'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.682+0000 7f320329ea80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.682+0000 7f320329ea80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.682+0000 7f320329ea80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.682+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 93856562211072 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf167000 con 0x555caec79800 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.682+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== watch-notify(notify (1) cookie 93856560680192 notify 128849018880 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x555caf063d40 con 0x555caec79800 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.682+0000 7f31fba3d700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 93856560680192 notifier 4293 bl.length()=533 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.682+0000 7f31fba3d700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.682+0000 7f31fba3d700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.682+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(66 notify.4 [notify cookie 93856562211072 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.682+0000 7f31fba3d700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9800 con 0x555caec79800 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.683+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.683+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== watch-notify(notify_complete (2) cookie 93856562211072 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555caf12fd40 con 0x555caec79800 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.683+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf167400 con 0x555caec79800 2024-04-19T23:45:36.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f320329ea80 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f320329ea80 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f320329ea80 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 93856562211072 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf167800 con 0x555caeff9400 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== watch-notify(notify (1) cookie 93856560679040 notify 128849018880 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x555caf063ba0 con 0x555caeff9400 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f31fba3d700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 93856560679040 notifier 4293 bl.length()=169 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f31fba3d700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f31fba3d700 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f31fba3d700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9c00 con 0x555caeff9400 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(69 notify.3 [notify cookie 93856562211072 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== watch-notify(notify_complete (2) cookie 93856562211072 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555caf0621a0 con 0x555caeff9400 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.685+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf167c00 con 0x555caefa8000 2024-04-19T23:45:36.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.688+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.688+0000 7f320329ea80 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.688+0000 7f320329ea80 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.688+0000 7f320329ea80 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.688+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 93856562211072 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf167800 con 0x555caeff9400 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.688+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== watch-notify(notify (1) cookie 93856560679040 notify 128849018881 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x555caf0621a0 con 0x555caeff9400 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.688+0000 7f31fb23c700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 93856560679040 notifier 4293 bl.length()=177 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.688+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(72 notify.3 [notify cookie 93856562211072 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.688+0000 7f31fb23c700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.688+0000 7f31fb23c700 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.688+0000 7f31fb23c700 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf1d8000 con 0x555caeff9400 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.689+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== watch-notify(notify_complete (2) cookie 93856562211072 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555caf062340 con 0x555caeff9400 2024-04-19T23:45:36.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.689+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.694 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:36.694 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:36.694 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:36.694 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:36.694 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:36.694 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:36.694 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:36.694 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:36.694 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:36.694 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:36.695 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:36.696 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:36.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.689+0000 7f31e8216700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.689+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93856562208768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf166400 con 0x555caec79800 2024-04-19T23:45:36.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.690+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 93856562208768] v30'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.690+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93856560675584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf166800 con 0x555caeff9400 2024-04-19T23:45:36.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.691+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 93856560675584] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.691+0000 7f320329ea80 20 remove_watcher() i=0 2024-04-19T23:45:36.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.691+0000 7f320329ea80 2 removed watcher, disabling cache 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.691+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93856560676736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf166c00 con 0x555caec79800 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.693+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 93856560676736] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.693+0000 7f320329ea80 20 remove_watcher() i=1 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.693+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93856560677888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf167000 con 0x555caeff9000 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.696+0000 7f3201248700 1 -- 172.21.15.155:0/3708097810 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 93856560677888] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a5200 con 0x555caeff9000 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.696+0000 7f320329ea80 20 remove_watcher() i=2 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.696+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93856560679040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa8c00 con 0x555caeff9400 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.697+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 <== osd.2 v2:172.21.15.155:6812/41834 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 93856560679040] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a5440 con 0x555caeff9400 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.697+0000 7f320329ea80 20 remove_watcher() i=3 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.697+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93856560680192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caefa9c00 con 0x555caec79800 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.699+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 93856560680192] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caec79800 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.699+0000 7f320329ea80 20 remove_watcher() i=4 2024-04-19T23:45:36.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.699+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93856560681344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caeff9c00 con 0x555caefa8000 2024-04-19T23:45:36.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.700+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 93856560681344] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.700+0000 7f320329ea80 20 remove_watcher() i=5 2024-04-19T23:45:36.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.700+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93856560682496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caec79c00 con 0x555caefa8000 2024-04-19T23:45:36.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.701+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 93856560682496] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.701+0000 7f320329ea80 20 remove_watcher() i=6 2024-04-19T23:45:36.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.701+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93856560683648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555caf1d8400 con 0x555caefa8000 2024-04-19T23:45:36.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f3201a49700 1 -- 172.21.15.155:0/3708097810 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 93856560683648] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555caf0a4b40 con 0x555caefa8000 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 20 remove_watcher() i=7 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x555caefa8000 msgr2=0x555caef63180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x555caefa8000 0x555caef63180 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x555caec79800 msgr2=0x555caef61b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x555caec79800 0x555caef61b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x555caeff9400 msgr2=0x555caef62c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x555caeff9400 0x555caef62c00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x555caeff9000 msgr2=0x555caef62100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x555caeff9000 0x555caef62100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caeff8c00 msgr2=0x555caef61600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caeff8c00 0x555caef61600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x555caeff7cb0 tx=0x555caefbf320 comp rx=0 tx=0).stop 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 msgr2=0x555caef60b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 --2- 172.21.15.155:0/3708097810 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec79400 0x555caef60b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x555cafa51e00 tx=0x555caed698c0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 reap_dead start 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f3200a47700 1 -- 172.21.15.155:0/3708097810 reap_dead start 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 shutdown_connections 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 >> 172.21.15.155:0/3708097810 conn(0x555caec78c00 msgr2=0x555caed65800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 shutdown_connections 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3708097810 wait complete. 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3330532974 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caf166000 msgr2=0x555caef63700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 --2- 172.21.15.155:0/3330532974 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caf166000 0x555caef63700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x555caf065ce0 tx=0x555caefbf4a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3330532974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 msgr2=0x555caef62680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 --2- 172.21.15.155:0/3330532974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x555caf0d6d80 tx=0x555caefbf7a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3330532974 shutdown_connections 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 --2- 172.21.15.155:0/3330532974 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caf166000 0x555caef63700 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 --2- 172.21.15.155:0/3330532974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caefa9400 0x555caef62680 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3330532974 >> 172.21.15.155:0/3330532974 conn(0x555caefa8800 msgr2=0x555caed66000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.702+0000 7f320329ea80 1 -- 172.21.15.155:0/3330532974 shutdown_connections 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.703+0000 7f320329ea80 1 -- 172.21.15.155:0/3330532974 wait complete. 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.703+0000 7f320329ea80 1 -- 172.21.15.155:0/3405977951 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caeff8000 msgr2=0x555caef61080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.703+0000 7f320329ea80 1 --2- 172.21.15.155:0/3405977951 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caeff8000 0x555caef61080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x555cafb00ed0 tx=0x555caefbe540 comp rx=0 tx=0).stop 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.703+0000 7f320329ea80 1 -- 172.21.15.155:0/3405977951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 msgr2=0x555caef60580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.703+0000 7f320329ea80 1 --2- 172.21.15.155:0/3405977951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x555cafa51f80 tx=0x555caed69920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.703+0000 7f320329ea80 1 -- 172.21.15.155:0/3405977951 shutdown_connections 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.703+0000 7f320329ea80 1 --2- 172.21.15.155:0/3405977951 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x555caeff8000 0x555caef61080 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.703+0000 7f320329ea80 1 --2- 172.21.15.155:0/3405977951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555caec78800 0x555caef60580 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.703+0000 7f320329ea80 1 -- 172.21.15.155:0/3405977951 >> 172.21.15.155:0/3405977951 conn(0x555caec78400 msgr2=0x555caed65000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.703+0000 7f320329ea80 1 -- 172.21.15.155:0/3405977951 shutdown_connections 2024-04-19T23:45:36.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.703+0000 7f320329ea80 1 -- 172.21.15.155:0/3405977951 wait complete. 2024-04-19T23:45:36.708 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:36.709 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-19T23:45:36.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-19T23:45:36.709 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-04-19T23:45:36.758 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:36.758 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:36.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.758+0000 7f0813ba6a80 1 Processor -- start 2024-04-19T23:45:36.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.759+0000 7f0813ba6a80 1 -- start start 2024-04-19T23:45:36.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.759+0000 7f0813ba6a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55ff88e30800 0x55ff89118580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.759+0000 7f0813ba6a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ff8915b500 con 0x55ff88e30c00 2024-04-19T23:45:36.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.759+0000 7f0813ba6a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ff88ed2a00 con 0x55ff88e30800 2024-04-19T23:45:36.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.759+0000 7f0811b50700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55ff88e30800 0x55ff89118580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.759+0000 7f081134f700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55ff88e30c00 0x55ff88f1c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46512/0 (socket says 172.21.15.155:46512) 2024-04-19T23:45:36.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.759+0000 7f081134f700 1 -- 172.21.15.155:0/2954531109 learned_addr learned my addr 172.21.15.155:0/2954531109 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:36.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.759+0000 7f0811b50700 1 -- 172.21.15.155:0/2954531109 >> v1:172.21.15.76:6789/0 conn(0x55ff88e30c00 legacy=0x55ff88f1c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.759+0000 7f0811b50700 1 -- 172.21.15.155:0/2954531109 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff88e59d40 con 0x55ff88e30800 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.760+0000 7f0811b50700 1 --2- 172.21.15.155:0/2954531109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55ff891139e0 tx=0x55ff88f21920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a85a0e66bf8cfc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.760+0000 7f0810b4e700 1 -- 172.21.15.155:0/2954531109 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff88ee94a0 con 0x55ff88e30800 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.760+0000 7f0810b4e700 1 -- 172.21.15.155:0/2954531109 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff8915b800 con 0x55ff88e30800 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.760+0000 7f0810b4e700 1 -- 172.21.15.155:0/2954531109 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff88ee9600 con 0x55ff88e30800 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.760+0000 7f0813ba6a80 1 -- 172.21.15.155:0/2954531109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 msgr2=0x55ff89118580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.760+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/2954531109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55ff891139e0 tx=0x55ff88f21920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.760+0000 7f0813ba6a80 1 -- 172.21.15.155:0/2954531109 shutdown_connections 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.760+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/2954531109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.760+0000 7f0813ba6a80 1 -- 172.21.15.155:0/2954531109 >> 172.21.15.155:0/2954531109 conn(0x55ff88e30400 msgr2=0x55ff88f1c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.760+0000 7f0813ba6a80 1 -- 172.21.15.155:0/2954531109 shutdown_connections 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.760+0000 7f0813ba6a80 1 -- 172.21.15.155:0/2954531109 wait complete. 2024-04-19T23:45:36.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.761+0000 7f0813ba6a80 1 Processor -- start 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.761+0000 7f0813ba6a80 1 -- start start 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.761+0000 7f0813ba6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.761+0000 7f0813ba6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff88ed2500 con 0x55ff88e30800 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.761+0000 7f0811b50700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.761+0000 7f0811b50700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33892/0 (socket says 172.21.15.155:33892) 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.761+0000 7f0811b50700 1 -- 172.21.15.155:0/2661881773 learned_addr learned my addr 172.21.15.155:0/2661881773 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.761+0000 7f0811b50700 1 -- 172.21.15.155:0/2661881773 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff88e59ba0 con 0x55ff88e30800 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f0811b50700 1 --2- 172.21.15.155:0/2661881773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55ff89c09740 tx=0x55ff88f21800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3da10551392d72 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f081034d700 1 -- 172.21.15.155:0/2661881773 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff88ee9760 con 0x55ff88e30800 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f081034d700 1 -- 172.21.15.155:0/2661881773 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff8915bb00 con 0x55ff88e30800 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f081034d700 1 -- 172.21.15.155:0/2661881773 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff88ee91e0 con 0x55ff88e30800 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f0813ba6a80 1 -- 172.21.15.155:0/2661881773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 msgr2=0x55ff89118580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/2661881773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55ff89c09740 tx=0x55ff88f21800 comp rx=0 tx=0).stop 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f0813ba6a80 1 -- 172.21.15.155:0/2661881773 shutdown_connections 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/2661881773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f0813ba6a80 1 -- 172.21.15.155:0/2661881773 >> 172.21.15.155:0/2661881773 conn(0x55ff88e30400 msgr2=0x55ff88f1d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f0813ba6a80 1 -- 172.21.15.155:0/2661881773 shutdown_connections 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f0813ba6a80 1 -- 172.21.15.155:0/2661881773 wait complete. 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.762+0000 7f0813ba6a80 1 Processor -- start 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f0813ba6a80 1 -- start start 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f0813ba6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f0813ba6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff88ed23c0 con 0x55ff88e30800 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f0811b50700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f0811b50700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33904/0 (socket says 172.21.15.155:33904) 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f0811b50700 1 -- 172.21.15.155:0/692377755 learned_addr learned my addr 172.21.15.155:0/692377755 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f0811b50700 1 -- 172.21.15.155:0/692377755 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff88e59a00 con 0x55ff88e30800 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f0811b50700 1 --2- 172.21.15.155:0/692377755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55ff89c095f0 tx=0x55ff88f21920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f080eb4a700 1 -- 172.21.15.155:0/692377755 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff88ee94a0 con 0x55ff88e30800 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f080eb4a700 1 -- 172.21.15.155:0/692377755 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff8915bc80 con 0x55ff88e30800 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f0813ba6a80 1 -- 172.21.15.155:0/692377755 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ff88e59860 con 0x55ff88e30800 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f080eb4a700 1 -- 172.21.15.155:0/692377755 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff88ee9600 con 0x55ff88e30800 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.763+0000 7f0813ba6a80 1 -- 172.21.15.155:0/692377755 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff88e596c0 con 0x55ff88e30800 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.764+0000 7f0813ba6a80 1 Processor -- start 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.764+0000 7f0813ba6a80 1 -- start start 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.764+0000 7f080eb4a700 1 -- 172.21.15.155:0/692377755 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ff89bd2b00 con 0x55ff88e30800 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.764+0000 7f0813ba6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 0x55ff89118b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.764+0000 7f0813ba6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff88e6c640 con 0x55ff88e31400 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.764+0000 7f080eb4a700 1 --2- 172.21.15.155:0/692377755 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff891b4000 0x55ff89119080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.764+0000 7f080eb4a700 1 -- 172.21.15.155:0/692377755 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ff88eab180 con 0x55ff88e30800 2024-04-19T23:45:36.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.764+0000 7f0811b50700 1 --2- 172.21.15.155:0/692377755 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff891b4000 0x55ff89119080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.765+0000 7f0812351700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 0x55ff89118b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.765+0000 7f0812351700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 0x55ff89118b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33920/0 (socket says 172.21.15.155:33920) 2024-04-19T23:45:36.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.765+0000 7f0812351700 1 -- 172.21.15.155:0/196270471 learned_addr learned my addr 172.21.15.155:0/196270471 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.765+0000 7f0811b50700 1 --2- 172.21.15.155:0/692377755 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff891b4000 0x55ff89119080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55ff89cc2ed0 tx=0x55ff8917a540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.765+0000 7f0812351700 1 -- 172.21.15.155:0/196270471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff88e58000 con 0x55ff88e31400 2024-04-19T23:45:36.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.765+0000 7f0812351700 1 --2- 172.21.15.155:0/196270471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 0x55ff89118b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55ff89cc21e0 tx=0x55ff8917a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1164cbb91b62e1f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.765+0000 7f080c345700 1 -- 172.21.15.155:0/196270471 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff88ee94a0 con 0x55ff88e31400 2024-04-19T23:45:36.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.765+0000 7f080c345700 1 -- 172.21.15.155:0/196270471 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff88ed1c80 con 0x55ff88e31400 2024-04-19T23:45:36.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.765+0000 7f080c345700 1 -- 172.21.15.155:0/196270471 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff88ee9600 con 0x55ff88e31400 2024-04-19T23:45:36.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.765+0000 7f0813ba6a80 1 -- 172.21.15.155:0/196270471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 msgr2=0x55ff89118b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.765+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/196270471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 0x55ff89118b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55ff89cc21e0 tx=0x55ff8917a720 comp rx=0 tx=0).stop 2024-04-19T23:45:36.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0813ba6a80 1 -- 172.21.15.155:0/196270471 shutdown_connections 2024-04-19T23:45:36.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/196270471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 0x55ff89118b00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0813ba6a80 1 -- 172.21.15.155:0/196270471 >> 172.21.15.155:0/196270471 conn(0x55ff88e30c00 msgr2=0x55ff88f1d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0813ba6a80 1 -- 172.21.15.155:0/196270471 shutdown_connections 2024-04-19T23:45:36.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0813ba6a80 1 -- 172.21.15.155:0/196270471 wait complete. 2024-04-19T23:45:36.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0813ba6a80 1 Processor -- start 2024-04-19T23:45:36.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0813ba6a80 1 -- start start 2024-04-19T23:45:36.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0813ba6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 0x55ff89118b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0813ba6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff88e6c8c0 con 0x55ff88e31400 2024-04-19T23:45:36.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0812351700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 0x55ff89118b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0812351700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 0x55ff89118b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33924/0 (socket says 172.21.15.155:33924) 2024-04-19T23:45:36.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 learned_addr learned my addr 172.21.15.155:0/3601068142 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.766+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff88e58ea0 con 0x55ff88e31400 2024-04-19T23:45:36.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.767+0000 7f0812351700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 0x55ff89118b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55ff89cc25a0 tx=0x55ff88f218c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.767+0000 7f080ab42700 1 -- 172.21.15.155:0/3601068142 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff88ee9760 con 0x55ff88e31400 2024-04-19T23:45:36.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.767+0000 7f080ab42700 1 -- 172.21.15.155:0/3601068142 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff88ed1b00 con 0x55ff88e31400 2024-04-19T23:45:36.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.767+0000 7f080ab42700 1 -- 172.21.15.155:0/3601068142 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff88ee94a0 con 0x55ff88e31400 2024-04-19T23:45:36.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.767+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ff88e58820 con 0x55ff88e31400 2024-04-19T23:45:36.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.767+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff88e589c0 con 0x55ff88e31400 2024-04-19T23:45:36.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.767+0000 7f080ab42700 1 -- 172.21.15.155:0/3601068142 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ff89bd2dc0 con 0x55ff88e31400 2024-04-19T23:45:36.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.768+0000 7f080ab42700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff891b4c00 0x55ff89119600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.768+0000 7f080ab42700 1 -- 172.21.15.155:0/3601068142 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ff88eab340 con 0x55ff88e31400 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.768+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.768+0000 7f081134f700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff891b4c00 0x55ff89119600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.768+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ff88e31800 0x55ff89119b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.768+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff88e31c00 con 0x55ff88e31800 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.768+0000 7f0812351700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ff88e31800 0x55ff89119b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.768+0000 7f081134f700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff891b4c00 0x55ff89119600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55ff891c3d70 tx=0x55ff8917b320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.768+0000 7f0812351700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ff88e31800 0x55ff89119b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.768+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 20 realm 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff891b5000 con 0x55ff88e31800 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff891b5400 con 0x55ff88e31800 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff891b5800 con 0x55ff88e31800 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.769+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff891b5c00 con 0x55ff88e31800 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.770+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.770+0000 7f0813ba6a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:36.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.770+0000 7f0813ba6a80 20 searching for the correct realm 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.770+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ff891b5000 0x55ff8911a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.770+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff891b5400 con 0x55ff891b5000 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.770+0000 7f0811b50700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ff891b5000 0x55ff8911a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.770+0000 7f0811b50700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ff891b5000 0x55ff8911a100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.770+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.770+0000 7f0811b50700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ff891b5400 0x55ff8911ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.770+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e000 con 0x55ff891b5400 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.771+0000 7f081134f700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ff891b5400 0x55ff8911ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.771+0000 7f081134f700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ff891b5400 0x55ff8911ac00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.771+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.771+0000 7f081134f700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ff8915e000 0x55ff8911b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.771+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff8915e000 2024-04-19T23:45:36.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.771+0000 7f0812351700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ff8915e000 0x55ff8911b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.771+0000 7f0812351700 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ff8915e000 0x55ff8911b180 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.772+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.772+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff88e31800 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.772+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.772+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff88e31800 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.772+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.772+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff8915e000 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.772+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.772+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff8915e000 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.773+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.773+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5400 2024-04-19T23:45:36.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.773+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.773+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5000 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.773+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.773+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff88e31800 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.773+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.773+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff8915e000 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.774+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.774+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff88e31800 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.774+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.774+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5400 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.774+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.774+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5000 2024-04-19T23:45:36.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.774+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.774+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5000 2024-04-19T23:45:36.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.774+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.775+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff8915e000 2024-04-19T23:45:36.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.775+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.775+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5000 2024-04-19T23:45:36.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.775+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.775+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5000 2024-04-19T23:45:36.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.775+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.775+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff88e31800 2024-04-19T23:45:36.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.776+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.776+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff88e31800 2024-04-19T23:45:36.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.776+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.776+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff8915e000 2024-04-19T23:45:36.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.776+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.776+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5000 2024-04-19T23:45:36.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.776+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.776+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5400 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.777+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.777+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff88e31800 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.777+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.777+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff8915e000 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.777+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.777+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5000 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.777+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.777+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff8915e000 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.778+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.778+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5400 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.778+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.778+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5000 2024-04-19T23:45:36.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.778+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.778+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff8915e000 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.778+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.778+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff88e31800 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.778+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.778+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5400 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff88e31c00 con 0x55ff88e31800 2024-04-19T23:45:36.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915ec00 con 0x55ff88e31800 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915f000 con 0x55ff891b5400 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.779+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 20 zone default found 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 4 Realm: () 2024-04-19T23:45:36.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 20 zonegroup default 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915f400 con 0x55ff8915e000 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915f800 con 0x55ff891b5000 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915fc00 con 0x55ff891b5000 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 20 started sync module instance, tier type = 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.780+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915ec00 con 0x55ff891b5400 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.781+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.781+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94556004612864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff88e31c00 con 0x55ff891b5400 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.781+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff891b5800 con 0x55ff88e31800 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.782+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94556004612864] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.783+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.783+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94556004614016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff891b5c00 con 0x55ff88e31800 2024-04-19T23:45:36.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.783+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff891b5000 2024-04-19T23:45:36.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.788+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.788+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94556004614016] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.788+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94556004615168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915f000 con 0x55ff891b5000 2024-04-19T23:45:36.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.788+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915ec00 con 0x55ff891b5400 2024-04-19T23:45:36.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.789+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94556004615168] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.792+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.792+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94556004616320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e400 con 0x55ff891b5400 2024-04-19T23:45:36.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.792+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915f800 con 0x55ff88e31800 2024-04-19T23:45:36.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.793+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94556004616320] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.795+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.795+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94556004617472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915fc00 con 0x55ff88e31800 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.795+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915e800 con 0x55ff8915e000 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.796+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94556004617472] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.797+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.797+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94556004618624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915f400 con 0x55ff8915e000 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.797+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915f800 con 0x55ff8915e000 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.798+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94556004618624] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.798+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.798+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94556004619776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915fc00 con 0x55ff8915e000 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.798+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff891b5800 con 0x55ff8915e000 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.799+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94556004619776] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.799+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.799+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94556004620928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff891b5c00 con 0x55ff8915e000 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.799+0000 7f0813ba6a80 20 add_watcher() i=0 2024-04-19T23:45:36.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.799+0000 7f0813ba6a80 20 add_watcher() i=1 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.799+0000 7f0813ba6a80 20 add_watcher() i=2 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.799+0000 7f0813ba6a80 20 add_watcher() i=3 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.799+0000 7f0813ba6a80 20 add_watcher() i=4 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.799+0000 7f0813ba6a80 20 add_watcher() i=5 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.799+0000 7f0813ba6a80 20 add_watcher() i=6 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.800+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94556004620928] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.800+0000 7f0813ba6a80 20 add_watcher() i=7 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.800+0000 7f0813ba6a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.800+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff891b5800 con 0x55ff88e31800 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.800+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.800+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94556006129664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff891b5c00 con 0x55ff88e31800 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.804+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94556006129664] v30'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.804+0000 7f07f8b1e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.804+0000 7f0813ba6a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:36.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.804+0000 7f0813ba6a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.804+0000 7f0813ba6a80 1 Processor -- start 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.804+0000 7f0813ba6a80 1 -- start start 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.804+0000 7f0813ba6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.804+0000 7f0813ba6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff88ed23c0 con 0x55ff8915f400 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.805+0000 7f081134f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.805+0000 7f081134f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33940/0 (socket says 172.21.15.155:33940) 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.805+0000 7f081134f700 1 -- 172.21.15.155:0/1416820330 learned_addr learned my addr 172.21.15.155:0/1416820330 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.805+0000 7f081134f700 1 -- 172.21.15.155:0/1416820330 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff88e58b60 con 0x55ff8915f400 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.805+0000 7f081134f700 1 --2- 172.21.15.155:0/1416820330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55ff8928a0c0 tx=0x55ff8917b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906e91c2d48f4b10 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.805+0000 7f07f831d700 1 -- 172.21.15.155:0/1416820330 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff8929a000 con 0x55ff8915f400 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.805+0000 7f07f831d700 1 -- 172.21.15.155:0/1416820330 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff8929c000 con 0x55ff8915f400 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.805+0000 7f07f831d700 1 -- 172.21.15.155:0/1416820330 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff8929a160 con 0x55ff8915f400 2024-04-19T23:45:36.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f0813ba6a80 1 -- 172.21.15.155:0/1416820330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 msgr2=0x55ff8911a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/1416820330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55ff8928a0c0 tx=0x55ff8917b680 comp rx=0 tx=0).stop 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f0813ba6a80 1 -- 172.21.15.155:0/1416820330 shutdown_connections 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/1416820330 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f0813ba6a80 1 -- 172.21.15.155:0/1416820330 >> 172.21.15.155:0/1416820330 conn(0x55ff8915e800 msgr2=0x55ff88f1e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f0813ba6a80 1 -- 172.21.15.155:0/1416820330 shutdown_connections 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f0813ba6a80 1 -- 172.21.15.155:0/1416820330 wait complete. 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f0813ba6a80 1 Processor -- start 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f0813ba6a80 1 -- start start 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f0813ba6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f0813ba6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff88ed2500 con 0x55ff8915f400 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f081134f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f081134f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33944/0 (socket says 172.21.15.155:33944) 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.806+0000 7f081134f700 1 -- 172.21.15.155:0/3024712183 learned_addr learned my addr 172.21.15.155:0/3024712183 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.807+0000 7f081134f700 1 -- 172.21.15.155:0/3024712183 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff88e58d00 con 0x55ff8915f400 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.807+0000 7f081134f700 1 --2- 172.21.15.155:0/3024712183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55ff8928b380 tx=0x55ff8917b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.807+0000 7f07f6b1a700 1 -- 172.21.15.155:0/3024712183 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff8929a2c0 con 0x55ff8915f400 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.807+0000 7f07f6b1a700 1 -- 172.21.15.155:0/3024712183 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff8929c180 con 0x55ff8915f400 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.807+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3024712183 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ff88e58340 con 0x55ff8915f400 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.807+0000 7f07f6b1a700 1 -- 172.21.15.155:0/3024712183 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ff8929a000 con 0x55ff8915f400 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.807+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3024712183 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff88e58b60 con 0x55ff8915f400 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.808+0000 7f07f6b1a700 1 -- 172.21.15.155:0/3024712183 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ff89bd3b80 con 0x55ff8915f400 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.808+0000 7f07f6b1a700 1 --2- 172.21.15.155:0/3024712183 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff8931e000 0x55ff8911b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.808+0000 7f07f6b1a700 1 -- 172.21.15.155:0/3024712183 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ff88eab500 con 0x55ff8915f400 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.808+0000 7f0812351700 1 --2- 172.21.15.155:0/3024712183 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff8931e000 0x55ff8911b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.808+0000 7f0813ba6a80 5 note: GC not initialized 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.808+0000 7f0812351700 1 --2- 172.21.15.155:0/3024712183 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff8931e000 0x55ff8911b700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55ff891c3350 tx=0x55ff8917b4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.809+0000 7f07f4315700 20 reqs_thread_entry: start 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.809+0000 7f0813ba6a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.809+0000 7f0813ba6a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.809+0000 7f07f2311700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:07 2024 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.809+0000 7f07f1aef700 20 reqs_thread_entry: start 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.809+0000 7f0813ba6a80 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.809+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.809+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8915fc00 con 0x55ff8915e000 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:45:36.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-19T23:45:36.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8931e400 con 0x55ff88e31800 2024-04-19T23:45:36.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+23 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 20 rados_obj.operate() r=0 bl.length=7 2024-04-19T23:45:36.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-04-19T23:45:36.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-19T23:45:36.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:36.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.810+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8931e800 con 0x55ff88e31800 2024-04-19T23:45:36.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.811+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 foo [call out=48b,read 0~357 out=357b] v0'0 uv1 ondisk = 0) v8 ==== 189+0+405 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.811+0000 7f0813ba6a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:36.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.811+0000 7f0813ba6a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2024-04-19T23:45:36.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.811+0000 7f0813ba6a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:36.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.811+0000 7f0813ba6a80 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-04-19T23:45:36.819 INFO:teuthology.orchestra.run.smithi155.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-04-19T23:45:36.831 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-04-19T23:45:36.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.812+0000 7f07f8b1e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.812+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94556006129664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8931ec00 con 0x55ff88e31800 2024-04-19T23:45:36.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.813+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94556006129664] v30'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.813+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94556004612864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8931f000 con 0x55ff891b5400 2024-04-19T23:45:36.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.814+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94556004612864] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.814+0000 7f0813ba6a80 20 remove_watcher() i=0 2024-04-19T23:45:36.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.814+0000 7f0813ba6a80 2 removed watcher, disabling cache 2024-04-19T23:45:36.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.814+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94556004614016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8931f400 con 0x55ff88e31800 2024-04-19T23:45:36.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.815+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94556004614016] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.815+0000 7f0813ba6a80 20 remove_watcher() i=1 2024-04-19T23:45:36.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.815+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94556004615168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8931f800 con 0x55ff891b5000 2024-04-19T23:45:36.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.816+0000 7f0811b50700 1 -- 172.21.15.155:0/3601068142 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94556004615168] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926f200 con 0x55ff891b5000 2024-04-19T23:45:36.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.816+0000 7f0813ba6a80 20 remove_watcher() i=2 2024-04-19T23:45:36.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.816+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94556004616320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8931fc00 con 0x55ff891b5400 2024-04-19T23:45:36.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.817+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94556004616320] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926f440 con 0x55ff891b5400 2024-04-19T23:45:36.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.817+0000 7f0813ba6a80 20 remove_watcher() i=3 2024-04-19T23:45:36.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.817+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94556004617472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8931f000 con 0x55ff88e31800 2024-04-19T23:45:36.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.818+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94556004617472] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff88e31800 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.818+0000 7f0813ba6a80 20 remove_watcher() i=4 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.818+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94556004618624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8931fc00 con 0x55ff8915e000 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.819+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94556004618624] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.819+0000 7f0813ba6a80 20 remove_watcher() i=5 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.819+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94556004619776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8931e400 con 0x55ff8915e000 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.820+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94556004619776] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.820+0000 7f0813ba6a80 20 remove_watcher() i=6 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.820+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94556004620928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff8931e800 con 0x55ff8915e000 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0812351700 1 -- 172.21.15.155:0/3601068142 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94556004620928] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ff8926eb40 con 0x55ff8915e000 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 20 remove_watcher() i=7 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ff8915e000 msgr2=0x55ff8911b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ff8915e000 0x55ff8911b180 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ff88e31800 msgr2=0x55ff89119b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ff88e31800 0x55ff89119b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ff891b5400 msgr2=0x55ff8911ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ff891b5400 0x55ff8911ac00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ff891b5000 msgr2=0x55ff8911a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ff891b5000 0x55ff8911a100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff891b4c00 msgr2=0x55ff89119600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff891b4c00 0x55ff89119600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55ff891c3d70 tx=0x55ff8917b320 comp rx=0 tx=0).stop 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 msgr2=0x55ff89118b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3601068142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e31400 0x55ff89118b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55ff89cc25a0 tx=0x55ff88f218c0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 reap_dead start 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f081134f700 1 -- 172.21.15.155:0/3601068142 reap_dead start 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 shutdown_connections 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 >> 172.21.15.155:0/3601068142 conn(0x55ff88e30c00 msgr2=0x55ff88f1d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 shutdown_connections 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.821+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3601068142 wait complete. 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3024712183 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff8931e000 msgr2=0x55ff8911b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3024712183 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff8931e000 0x55ff8911b700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55ff891c3350 tx=0x55ff8917b4a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3024712183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 msgr2=0x55ff8911a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3024712183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55ff8928b380 tx=0x55ff8917b7a0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3024712183 shutdown_connections 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3024712183 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff8931e000 0x55ff8911b700 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/3024712183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff8915f400 0x55ff8911a680 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3024712183 >> 172.21.15.155:0/3024712183 conn(0x55ff8915e800 msgr2=0x55ff88f1e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3024712183 shutdown_connections 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/3024712183 wait complete. 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/692377755 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff891b4000 msgr2=0x55ff89119080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/692377755 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff891b4000 0x55ff89119080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55ff89cc2ed0 tx=0x55ff8917a540 comp rx=0 tx=0).stop 2024-04-19T23:45:36.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/692377755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 msgr2=0x55ff89118580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/692377755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55ff89c095f0 tx=0x55ff88f21920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/692377755 shutdown_connections 2024-04-19T23:45:36.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/692377755 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ff891b4000 0x55ff89119080 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 --2- 172.21.15.155:0/692377755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ff88e30800 0x55ff89118580 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/692377755 >> 172.21.15.155:0/692377755 conn(0x55ff88e30400 msgr2=0x55ff88f1d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/692377755 shutdown_connections 2024-04-19T23:45:36.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.822+0000 7f0813ba6a80 1 -- 172.21.15.155:0/692377755 wait complete. 2024-04-19T23:45:36.837 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-19T23:45:36.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-19T23:45:36.838 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-19T23:45:36.882 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:36.883 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:36.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.883+0000 7fd225590a80 1 Processor -- start 2024-04-19T23:45:36.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.883+0000 7fd225590a80 1 -- start start 2024-04-19T23:45:36.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.883+0000 7fd225590a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55bb0d77ac00 0x55bb0da62580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd225590a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bb0daa5500 con 0x55bb0d77a800 2024-04-19T23:45:36.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd225590a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bb0d81ca00 con 0x55bb0d77ac00 2024-04-19T23:45:36.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd222d39700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55bb0d77ac00 0x55bb0da62580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd22353a700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55bb0d77a800 0x55bb0d866800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46520/0 (socket says 172.21.15.155:46520) 2024-04-19T23:45:36.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd22353a700 1 -- 172.21.15.155:0/3522148134 learned_addr learned my addr 172.21.15.155:0/3522148134 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd222d39700 1 -- 172.21.15.155:0/3522148134 >> v1:172.21.15.76:6789/0 conn(0x55bb0d77a800 legacy=0x55bb0d866800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd222d39700 1 -- 172.21.15.155:0/3522148134 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb0d7a3d40 con 0x55bb0d77ac00 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd222538700 1 -- 172.21.15.155:0/3522148134 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191508861 0 0) 0x55bb0e548000 con 0x55bb0d77a800 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd222d39700 1 --2- 172.21.15.155:0/3522148134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77ac00 0x55bb0da62580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55bb0da5d890 tx=0x55bb0d86b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79daf93146d2220c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd222538700 1 -- 172.21.15.155:0/3522148134 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0d8334a0 con 0x55bb0d77ac00 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd222538700 1 -- 172.21.15.155:0/3522148134 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb0daa5800 con 0x55bb0d77ac00 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.884+0000 7fd222538700 1 -- 172.21.15.155:0/3522148134 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0d833600 con 0x55bb0d77ac00 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.885+0000 7fd225590a80 1 -- 172.21.15.155:0/3522148134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77ac00 msgr2=0x55bb0da62580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.885+0000 7fd225590a80 1 --2- 172.21.15.155:0/3522148134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77ac00 0x55bb0da62580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55bb0da5d890 tx=0x55bb0d86b920 comp rx=0 tx=0).stop 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.885+0000 7fd225590a80 1 -- 172.21.15.155:0/3522148134 shutdown_connections 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.885+0000 7fd225590a80 1 --2- 172.21.15.155:0/3522148134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77ac00 0x55bb0da62580 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.885+0000 7fd225590a80 1 -- 172.21.15.155:0/3522148134 >> 172.21.15.155:0/3522148134 conn(0x55bb0d77a400 msgr2=0x55bb0d866000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.885+0000 7fd225590a80 1 -- 172.21.15.155:0/3522148134 shutdown_connections 2024-04-19T23:45:36.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.885+0000 7fd225590a80 1 -- 172.21.15.155:0/3522148134 wait complete. 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd225590a80 1 Processor -- start 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd225590a80 1 -- start start 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd225590a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd225590a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0d81c500 con 0x55bb0d77a800 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd22353a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd22353a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33962/0 (socket says 172.21.15.155:33962) 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd22353a700 1 -- 172.21.15.155:0/1164883614 learned_addr learned my addr 172.21.15.155:0/1164883614 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd22353a700 1 -- 172.21.15.155:0/1164883614 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb0d7a3ba0 con 0x55bb0d77a800 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd22353a700 1 --2- 172.21.15.155:0/1164883614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55bb0e54b770 tx=0x55bb0d86bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804da2c3d0bd6629 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd221d37700 1 -- 172.21.15.155:0/1164883614 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0d8334a0 con 0x55bb0d77a800 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd221d37700 1 -- 172.21.15.155:0/1164883614 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb0daa5b00 con 0x55bb0d77a800 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.886+0000 7fd221d37700 1 -- 172.21.15.155:0/1164883614 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0d833600 con 0x55bb0d77a800 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.887+0000 7fd225590a80 1 -- 172.21.15.155:0/1164883614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 msgr2=0x55bb0da62580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.887+0000 7fd225590a80 1 --2- 172.21.15.155:0/1164883614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55bb0e54b770 tx=0x55bb0d86bb60 comp rx=0 tx=0).stop 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.887+0000 7fd225590a80 1 -- 172.21.15.155:0/1164883614 shutdown_connections 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.887+0000 7fd225590a80 1 --2- 172.21.15.155:0/1164883614 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.887+0000 7fd225590a80 1 -- 172.21.15.155:0/1164883614 >> 172.21.15.155:0/1164883614 conn(0x55bb0d77a400 msgr2=0x55bb0d867000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.887+0000 7fd225590a80 1 -- 172.21.15.155:0/1164883614 shutdown_connections 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.887+0000 7fd225590a80 1 -- 172.21.15.155:0/1164883614 wait complete. 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.887+0000 7fd225590a80 1 Processor -- start 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.887+0000 7fd225590a80 1 -- start start 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.887+0000 7fd225590a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.887+0000 7fd225590a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0d81c3c0 con 0x55bb0d77a800 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.888+0000 7fd22353a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.888+0000 7fd22353a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33972/0 (socket says 172.21.15.155:33972) 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.888+0000 7fd22353a700 1 -- 172.21.15.155:0/1975967353 learned_addr learned my addr 172.21.15.155:0/1975967353 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.888+0000 7fd22353a700 1 -- 172.21.15.155:0/1975967353 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb0d7a3a00 con 0x55bb0d77a800 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.888+0000 7fd22353a700 1 --2- 172.21.15.155:0/1975967353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55bb0e54be30 tx=0x55bb0d86ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.888+0000 7fd220534700 1 -- 172.21.15.155:0/1975967353 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0d8338c0 con 0x55bb0d77a800 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.888+0000 7fd220534700 1 -- 172.21.15.155:0/1975967353 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb0d81bc80 con 0x55bb0d77a800 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.888+0000 7fd220534700 1 -- 172.21.15.155:0/1975967353 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0d8334a0 con 0x55bb0d77a800 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.888+0000 7fd225590a80 1 -- 172.21.15.155:0/1975967353 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bb0d7a3860 con 0x55bb0d77a800 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.888+0000 7fd225590a80 1 -- 172.21.15.155:0/1975967353 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb0d7a36c0 con 0x55bb0d77a800 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd225590a80 1 Processor -- start 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd225590a80 1 -- start start 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd220534700 1 -- 172.21.15.155:0/1975967353 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55bb0e51cb00 con 0x55bb0d77a800 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd225590a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 0x55bb0da62b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd225590a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0d81c000 con 0x55bb0d77b400 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd220534700 1 --2- 172.21.15.155:0/1975967353 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0db00000 0x55bb0da63080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd220534700 1 -- 172.21.15.155:0/1975967353 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55bb0d7f5180 con 0x55bb0d77a800 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd223d3b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 0x55bb0da62b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd22353a700 1 --2- 172.21.15.155:0/1975967353 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0db00000 0x55bb0da63080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd223d3b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 0x55bb0da62b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33974/0 (socket says 172.21.15.155:33974) 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd223d3b700 1 -- 172.21.15.155:0/2359597939 learned_addr learned my addr 172.21.15.155:0/2359597939 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd223d3b700 1 -- 172.21.15.155:0/2359597939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb0d7a2000 con 0x55bb0d77b400 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd22353a700 1 --2- 172.21.15.155:0/1975967353 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0db00000 0x55bb0da63080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55bb0e60cf00 tx=0x55bb0dac6240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.889+0000 7fd223d3b700 1 --2- 172.21.15.155:0/2359597939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 0x55bb0da62b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55bb0e60c870 tx=0x55bb0dac69c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259f050dbf8e084a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.890+0000 7fd21dd2f700 1 -- 172.21.15.155:0/2359597939 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0d8338c0 con 0x55bb0d77b400 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.890+0000 7fd21dd2f700 1 -- 172.21.15.155:0/2359597939 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb0daa4300 con 0x55bb0d77b400 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.890+0000 7fd21dd2f700 1 -- 172.21.15.155:0/2359597939 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0d8334a0 con 0x55bb0d77b400 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.890+0000 7fd225590a80 1 -- 172.21.15.155:0/2359597939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 msgr2=0x55bb0da62b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.890+0000 7fd225590a80 1 --2- 172.21.15.155:0/2359597939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 0x55bb0da62b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55bb0e60c870 tx=0x55bb0dac69c0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.890+0000 7fd225590a80 1 -- 172.21.15.155:0/2359597939 shutdown_connections 2024-04-19T23:45:36.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.890+0000 7fd225590a80 1 --2- 172.21.15.155:0/2359597939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 0x55bb0da62b00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.890+0000 7fd225590a80 1 -- 172.21.15.155:0/2359597939 >> 172.21.15.155:0/2359597939 conn(0x55bb0d77ac00 msgr2=0x55bb0d867800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.890+0000 7fd225590a80 1 -- 172.21.15.155:0/2359597939 shutdown_connections 2024-04-19T23:45:36.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.890+0000 7fd225590a80 1 -- 172.21.15.155:0/2359597939 wait complete. 2024-04-19T23:45:36.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.890+0000 7fd225590a80 1 Processor -- start 2024-04-19T23:45:36.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd225590a80 1 -- start start 2024-04-19T23:45:36.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd225590a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 0x55bb0da62b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd225590a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0d7b6640 con 0x55bb0d77b400 2024-04-19T23:45:36.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd223d3b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 0x55bb0da62b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd223d3b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 0x55bb0da62b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33978/0 (socket says 172.21.15.155:33978) 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 learned_addr learned my addr 172.21.15.155:0/891633986 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb0d7a2ea0 con 0x55bb0d77b400 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd223d3b700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 0x55bb0da62b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55bb0e60def0 tx=0x55bb0dac6120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd21c52c700 1 -- 172.21.15.155:0/891633986 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0d833b80 con 0x55bb0d77b400 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd21c52c700 1 -- 172.21.15.155:0/891633986 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb0d81bc80 con 0x55bb0d77b400 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bb0d7a2820 con 0x55bb0d77b400 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd21c52c700 1 -- 172.21.15.155:0/891633986 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0d8338c0 con 0x55bb0d77b400 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.891+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb0d7a29c0 con 0x55bb0d77b400 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.892+0000 7fd21c52c700 1 -- 172.21.15.155:0/891633986 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55bb0e51cdc0 con 0x55bb0d77b400 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.892+0000 7fd21c52c700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0db00c00 0x55bb0da63600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.892+0000 7fd21c52c700 1 -- 172.21.15.155:0/891633986 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55bb0d7f5340 con 0x55bb0d77b400 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.892+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd222d39700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0db00c00 0x55bb0da63600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd225590a80 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bb0d77b800 0x55bb0da63b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0d77bc00 con 0x55bb0d77b800 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd223d3b700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bb0d77b800 0x55bb0da63b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd222d39700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0db00c00 0x55bb0da63600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55bb0da5d890 tx=0x55bb0d86b800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd223d3b700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bb0d77b800 0x55bb0da63b80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd225590a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd225590a80 20 realm 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0db01000 con 0x55bb0d77b800 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.893+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0db01400 con 0x55bb0d77b800 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0db01800 con 0x55bb0d77b800 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0db01c00 con 0x55bb0d77b800 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 20 searching for the correct realm 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bb0db01000 0x55bb0da64100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0db01400 con 0x55bb0db01000 2024-04-19T23:45:36.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.894+0000 7fd22353a700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bb0db01000 0x55bb0da64100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.895+0000 7fd22353a700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bb0db01000 0x55bb0da64100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.895+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.895+0000 7fd22353a700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bb0db01400 0x55bb0da64c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.895+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2000 con 0x55bb0db01400 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.895+0000 7fd222d39700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bb0db01400 0x55bb0da64c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.895+0000 7fd222d39700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bb0db01400 0x55bb0da64c00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.896+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.896+0000 7fd222d39700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bb0dbc2000 0x55bb0da65180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.896+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0dbc2000 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.896+0000 7fd223d3b700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bb0dbc2000 0x55bb0da65180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.896+0000 7fd223d3b700 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bb0dbc2000 0x55bb0da65180 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.897+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.897+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0d77b800 2024-04-19T23:45:36.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.897+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.897+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0d77b800 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.897+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.897+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0dbc2000 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.897+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.897+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0dbc2000 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.897+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.897+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01400 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.898+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.898+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01000 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.898+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.898+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0d77b800 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.898+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.898+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0dbc2000 2024-04-19T23:45:36.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.898+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.898+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0d77b800 2024-04-19T23:45:36.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.899+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.899+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01400 2024-04-19T23:45:36.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.899+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.899+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01000 2024-04-19T23:45:36.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.899+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.899+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01000 2024-04-19T23:45:36.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.899+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.899+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0dbc2000 2024-04-19T23:45:36.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.900+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.900+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01000 2024-04-19T23:45:36.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.900+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.900+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01000 2024-04-19T23:45:36.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.900+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.900+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0d77b800 2024-04-19T23:45:36.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.900+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.900+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0d77b800 2024-04-19T23:45:36.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.900+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.900+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0dbc2000 2024-04-19T23:45:36.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.901+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.901+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01000 2024-04-19T23:45:36.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.901+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.901+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01400 2024-04-19T23:45:36.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.901+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.901+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0d77b800 2024-04-19T23:45:36.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.902+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.902+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0dbc2000 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.902+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.902+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01000 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.902+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.902+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0dbc2000 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.903+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.903+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01400 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.903+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.903+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01000 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.903+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.903+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0dbc2000 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.903+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.903+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0d77b800 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.903+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.903+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01400 2024-04-19T23:45:36.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:36.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:36.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:36.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:36.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0d77bc00 con 0x55bb0d77b800 2024-04-19T23:45:36.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2c00 con 0x55bb0d77b800 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc3000 con 0x55bb0db01400 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.904+0000 7fd225590a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 20 zone default found 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 4 Realm: () 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 20 zonegroup default 2024-04-19T23:45:36.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc3400 con 0x55bb0dbc2000 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc3800 con 0x55bb0db01000 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc3c00 con 0x55bb0db01000 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 20 started sync module instance, tier type = 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.905+0000 7fd225590a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:36.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.906+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2c00 con 0x55bb0db01400 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.906+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.907+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94261876202240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0d77bc00 con 0x55bb0db01400 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.907+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0db01800 con 0x55bb0d77b800 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.908+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94261876202240] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.908+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.908+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94261876203392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0db01c00 con 0x55bb0d77b800 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.908+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0db01000 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.909+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.909+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94261876204544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc3000 con 0x55bb0db01000 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.909+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2c00 con 0x55bb0db01400 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.910+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94261876203392] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.910+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.910+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94261876205696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2400 con 0x55bb0db01400 2024-04-19T23:45:36.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.910+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc3800 con 0x55bb0d77b800 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.911+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94261876204544] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.913+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94261876205696] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.915+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.915+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94261876206848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc3c00 con 0x55bb0d77b800 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.915+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc2800 con 0x55bb0dbc2000 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.916+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94261876206848] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.917+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.917+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94261876208000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc3400 con 0x55bb0dbc2000 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.917+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc3800 con 0x55bb0dbc2000 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.918+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.918+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94261876209152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc3c00 con 0x55bb0dbc2000 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.918+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0db01800 con 0x55bb0dbc2000 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.919+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94261876208000] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94261876209152] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94261876210304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0db01c00 con 0x55bb0dbc2000 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd225590a80 20 add_watcher() i=0 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd225590a80 20 add_watcher() i=1 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd225590a80 20 add_watcher() i=2 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd225590a80 20 add_watcher() i=3 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd225590a80 20 add_watcher() i=4 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd225590a80 20 add_watcher() i=5 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd225590a80 20 add_watcher() i=6 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94261876210304] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd225590a80 20 add_watcher() i=7 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd225590a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.920+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0db01800 con 0x55bb0d77b800 2024-04-19T23:45:36.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.921+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.921+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94261877743616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0db01c00 con 0x55bb0d77b800 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.922+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94261877743616] v30'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.922+0000 7fd20a508700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.922+0000 7fd225590a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.922+0000 7fd225590a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.922+0000 7fd225590a80 1 Processor -- start 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.922+0000 7fd225590a80 1 -- start start 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.922+0000 7fd225590a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.922+0000 7fd225590a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0d7b6780 con 0x55bb0dbc3400 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.923+0000 7fd222d39700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.923+0000 7fd222d39700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33982/0 (socket says 172.21.15.155:33982) 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.923+0000 7fd222d39700 1 -- 172.21.15.155:0/1522814230 learned_addr learned my addr 172.21.15.155:0/1522814230 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.923+0000 7fd222d39700 1 -- 172.21.15.155:0/1522814230 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb0d7a2b60 con 0x55bb0dbc3400 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.923+0000 7fd222d39700 1 --2- 172.21.15.155:0/1522814230 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55bb0db15440 tx=0x55bb0dac76e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f77cf3fe7e667f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.923+0000 7fd209d07700 1 -- 172.21.15.155:0/1522814230 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0d833760 con 0x55bb0dbc3400 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.923+0000 7fd209d07700 1 -- 172.21.15.155:0/1522814230 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb0dbea000 con 0x55bb0dbc3400 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.923+0000 7fd209d07700 1 -- 172.21.15.155:0/1522814230 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0dbec000 con 0x55bb0dbc3400 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.924+0000 7fd225590a80 1 -- 172.21.15.155:0/1522814230 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 msgr2=0x55bb0da64680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.924+0000 7fd225590a80 1 --2- 172.21.15.155:0/1522814230 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55bb0db15440 tx=0x55bb0dac76e0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.924+0000 7fd225590a80 1 -- 172.21.15.155:0/1522814230 shutdown_connections 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.924+0000 7fd225590a80 1 --2- 172.21.15.155:0/1522814230 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.924+0000 7fd225590a80 1 -- 172.21.15.155:0/1522814230 >> 172.21.15.155:0/1522814230 conn(0x55bb0dbc2800 msgr2=0x55bb0d868000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.924+0000 7fd225590a80 1 -- 172.21.15.155:0/1522814230 shutdown_connections 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.924+0000 7fd225590a80 1 -- 172.21.15.155:0/1522814230 wait complete. 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.924+0000 7fd225590a80 1 Processor -- start 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.924+0000 7fd225590a80 1 -- start start 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd225590a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd225590a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb0d81c000 con 0x55bb0dbc3400 2024-04-19T23:45:36.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd222d39700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd222d39700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:33998/0 (socket says 172.21.15.155:33998) 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd222d39700 1 -- 172.21.15.155:0/2891110459 learned_addr learned my addr 172.21.15.155:0/2891110459 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd222d39700 1 -- 172.21.15.155:0/2891110459 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb0d7a2d00 con 0x55bb0dbc3400 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd222d39700 1 --2- 172.21.15.155:0/2891110459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55bb0dbd7200 tx=0x55bb0dac7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd208504700 1 -- 172.21.15.155:0/2891110459 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0dbec160 con 0x55bb0dbc3400 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd208504700 1 -- 172.21.15.155:0/2891110459 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb0dbea180 con 0x55bb0dbc3400 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd208504700 1 -- 172.21.15.155:0/2891110459 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb0dbec2c0 con 0x55bb0dbc3400 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd225590a80 1 -- 172.21.15.155:0/2891110459 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bb0d7a2340 con 0x55bb0dbc3400 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.925+0000 7fd225590a80 1 -- 172.21.15.155:0/2891110459 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb0d7a3d40 con 0x55bb0dbc3400 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.926+0000 7fd208504700 1 -- 172.21.15.155:0/2891110459 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55bb0e51db80 con 0x55bb0dbc3400 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.926+0000 7fd208504700 1 --2- 172.21.15.155:0/2891110459 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0dc66000 0x55bb0da65700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.926+0000 7fd208504700 1 -- 172.21.15.155:0/2891110459 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55bb0d7f5500 con 0x55bb0dbc3400 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.926+0000 7fd223d3b700 1 --2- 172.21.15.155:0/2891110459 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0dc66000 0x55bb0da65700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.926+0000 7fd225590a80 5 note: GC not initialized 2024-04-19T23:45:36.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.927+0000 7fd223d3b700 1 --2- 172.21.15.155:0/2891110459 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0dc66000 0x55bb0da65700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55bb0db69f50 tx=0x55bb0dac6a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:36.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.927+0000 7fd205cff700 20 reqs_thread_entry: start 2024-04-19T23:45:36.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.927+0000 7fd225590a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:36.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.927+0000 7fd225590a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:36.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.927+0000 7fd203cfb700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:07 2024 2024-04-19T23:45:36.946 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:36.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.927+0000 7fd2034d9700 20 reqs_thread_entry: start 2024-04-19T23:45:36.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.927+0000 7fd225590a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:36.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.928+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dbc3c00 con 0x55bb0d77b800 2024-04-19T23:45:36.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.928+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.928+0000 7fd225590a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:36.946 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:36.947 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:36.948 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:36.949 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:36.949 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:36.949 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:36.949 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:36.949 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:36.949 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:36.949 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:36.949 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:36.949 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:36.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.928+0000 7fd20a508700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:36.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.928+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94261877743616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dc66400 con 0x55bb0d77b800 2024-04-19T23:45:36.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.930+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94261877743616] v30'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.930+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94261876202240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dc66800 con 0x55bb0db01400 2024-04-19T23:45:36.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.931+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94261876202240] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.931+0000 7fd225590a80 20 remove_watcher() i=0 2024-04-19T23:45:36.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.931+0000 7fd225590a80 2 removed watcher, disabling cache 2024-04-19T23:45:36.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.931+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94261876203392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dc66c00 con 0x55bb0d77b800 2024-04-19T23:45:36.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.932+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94261876203392] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.932+0000 7fd225590a80 20 remove_watcher() i=1 2024-04-19T23:45:36.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.932+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94261876204544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dc67000 con 0x55bb0db01000 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.933+0000 7fd22353a700 1 -- 172.21.15.155:0/891633986 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94261876204544] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb9200 con 0x55bb0db01000 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.933+0000 7fd225590a80 20 remove_watcher() i=2 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.933+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94261876205696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dc67400 con 0x55bb0db01400 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.934+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94261876205696] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb9440 con 0x55bb0db01400 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.934+0000 7fd225590a80 20 remove_watcher() i=3 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.934+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94261876206848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dc67800 con 0x55bb0d77b800 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.935+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94261876206848] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0d77b800 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.935+0000 7fd225590a80 20 remove_watcher() i=4 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.935+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94261876208000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dc67c00 con 0x55bb0dbc2000 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.937+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94261876208000] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.937+0000 7fd225590a80 20 remove_watcher() i=5 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.937+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94261876209152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dc66400 con 0x55bb0dbc2000 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.938+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94261876209152] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.938+0000 7fd225590a80 20 remove_watcher() i=6 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.938+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94261876210304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bb0dc66c00 con 0x55bb0dbc2000 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd223d3b700 1 -- 172.21.15.155:0/891633986 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94261876210304] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb0dbb8b40 con 0x55bb0dbc2000 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 20 remove_watcher() i=7 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bb0dbc2000 msgr2=0x55bb0da65180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bb0dbc2000 0x55bb0da65180 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bb0d77b800 msgr2=0x55bb0da63b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bb0d77b800 0x55bb0da63b80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bb0db01400 msgr2=0x55bb0da64c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bb0db01400 0x55bb0da64c00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bb0db01000 msgr2=0x55bb0da64100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bb0db01000 0x55bb0da64100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0db00c00 msgr2=0x55bb0da63600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0db00c00 0x55bb0da63600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55bb0da5d890 tx=0x55bb0d86b800 comp rx=0 tx=0).stop 2024-04-19T23:45:36.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 msgr2=0x55bb0da62b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 --2- 172.21.15.155:0/891633986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77b400 0x55bb0da62b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55bb0e60def0 tx=0x55bb0dac6120 comp rx=0 tx=0).stop 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 reap_dead start 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd222d39700 1 -- 172.21.15.155:0/891633986 reap_dead start 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 shutdown_connections 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 >> 172.21.15.155:0/891633986 conn(0x55bb0d77ac00 msgr2=0x55bb0d867800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 shutdown_connections 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.939+0000 7fd225590a80 1 -- 172.21.15.155:0/891633986 wait complete. 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/2891110459 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0dc66000 msgr2=0x55bb0da65700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 --2- 172.21.15.155:0/2891110459 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0dc66000 0x55bb0da65700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55bb0db69f50 tx=0x55bb0dac6a20 comp rx=0 tx=0).stop 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/2891110459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 msgr2=0x55bb0da64680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 --2- 172.21.15.155:0/2891110459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55bb0dbd7200 tx=0x55bb0dac7800 comp rx=0 tx=0).stop 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/2891110459 shutdown_connections 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 --2- 172.21.15.155:0/2891110459 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0dc66000 0x55bb0da65700 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 --2- 172.21.15.155:0/2891110459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0dbc3400 0x55bb0da64680 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/2891110459 >> 172.21.15.155:0/2891110459 conn(0x55bb0dbc2800 msgr2=0x55bb0d868000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/2891110459 shutdown_connections 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/2891110459 wait complete. 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/1975967353 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0db00000 msgr2=0x55bb0da63080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 --2- 172.21.15.155:0/1975967353 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0db00000 0x55bb0da63080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55bb0e60cf00 tx=0x55bb0dac6240 comp rx=0 tx=0).stop 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/1975967353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 msgr2=0x55bb0da62580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 --2- 172.21.15.155:0/1975967353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55bb0e54be30 tx=0x55bb0d86ba40 comp rx=0 tx=0).stop 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/1975967353 shutdown_connections 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 --2- 172.21.15.155:0/1975967353 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bb0db00000 0x55bb0da63080 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 --2- 172.21.15.155:0/1975967353 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bb0d77a800 0x55bb0da62580 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/1975967353 >> 172.21.15.155:0/1975967353 conn(0x55bb0d77a400 msgr2=0x55bb0d867000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/1975967353 shutdown_connections 2024-04-19T23:45:36.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:36.940+0000 7fd225590a80 1 -- 172.21.15.155:0/1975967353 wait complete. 2024-04-19T23:45:36.960 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:36.960 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-19T23:45:36.960 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-19T23:45:36.960 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-19T23:45:37.005 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:37.005 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.006+0000 7fecb164aa80 1 Processor -- start 2024-04-19T23:45:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.006+0000 7fecb164aa80 1 -- start start 2024-04-19T23:45:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.006+0000 7fecb164aa80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x558a7f60ac00 0x558a7f8f2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.006+0000 7fecb164aa80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558a7f935500 con 0x558a7f60a800 2024-04-19T23:45:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.006+0000 7fecb164aa80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x558a7f6aca00 con 0x558a7f60ac00 2024-04-19T23:45:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.007+0000 7fecaedf3700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x558a7f60ac00 0x558a7f8f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.007+0000 7fecaf5f4700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x558a7f60a800 0x558a7f6f6800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46524/0 (socket says 172.21.15.155:46524) 2024-04-19T23:45:37.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.007+0000 7fecaf5f4700 1 -- 172.21.15.155:0/3041446679 learned_addr learned my addr 172.21.15.155:0/3041446679 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:37.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.007+0000 7fecaedf3700 1 -- 172.21.15.155:0/3041446679 >> v1:172.21.15.76:6789/0 conn(0x558a7f60a800 legacy=0x558a7f6f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.007+0000 7fecaedf3700 1 -- 172.21.15.155:0/3041446679 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7f633d40 con 0x558a7f60ac00 2024-04-19T23:45:37.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.007+0000 7fecaedf3700 1 --2- 172.21.15.155:0/3041446679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60ac00 0x558a7f8f2580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x558a7f8ed890 tx=0x558a7f6fb920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f69ceebb979fcb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.007+0000 7fecae5f2700 1 -- 172.21.15.155:0/3041446679 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7f6c34a0 con 0x558a7f60ac00 2024-04-19T23:45:37.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.007+0000 7fecae5f2700 1 -- 172.21.15.155:0/3041446679 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a7f935800 con 0x558a7f60ac00 2024-04-19T23:45:37.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.007+0000 7fecae5f2700 1 -- 172.21.15.155:0/3041446679 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7f6c3600 con 0x558a7f60ac00 2024-04-19T23:45:37.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.007+0000 7fecb164aa80 1 -- 172.21.15.155:0/3041446679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60ac00 msgr2=0x558a7f8f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.007+0000 7fecb164aa80 1 --2- 172.21.15.155:0/3041446679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60ac00 0x558a7f8f2580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x558a7f8ed890 tx=0x558a7f6fb920 comp rx=0 tx=0).stop 2024-04-19T23:45:37.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.008+0000 7fecb164aa80 1 -- 172.21.15.155:0/3041446679 shutdown_connections 2024-04-19T23:45:37.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.008+0000 7fecb164aa80 1 --2- 172.21.15.155:0/3041446679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60ac00 0x558a7f8f2580 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.008+0000 7fecb164aa80 1 -- 172.21.15.155:0/3041446679 >> 172.21.15.155:0/3041446679 conn(0x558a7f60a400 msgr2=0x558a7f6f6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.008+0000 7fecb164aa80 1 -- 172.21.15.155:0/3041446679 shutdown_connections 2024-04-19T23:45:37.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.008+0000 7fecb164aa80 1 -- 172.21.15.155:0/3041446679 wait complete. 2024-04-19T23:45:37.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.008+0000 7fecb164aa80 1 Processor -- start 2024-04-19T23:45:37.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.008+0000 7fecb164aa80 1 -- start start 2024-04-19T23:45:37.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.008+0000 7fecb164aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.008+0000 7fecb164aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7f6ac500 con 0x558a7f60a800 2024-04-19T23:45:37.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecaf5f4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecaf5f4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34020/0 (socket says 172.21.15.155:34020) 2024-04-19T23:45:37.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecaf5f4700 1 -- 172.21.15.155:0/3297614791 learned_addr learned my addr 172.21.15.155:0/3297614791 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecaf5f4700 1 -- 172.21.15.155:0/3297614791 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7f633ba0 con 0x558a7f60a800 2024-04-19T23:45:37.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecaf5f4700 1 --2- 172.21.15.155:0/3297614791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x558a803e3800 tx=0x558a7f6fbb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9374d251e7672480 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecaddf1700 1 -- 172.21.15.155:0/3297614791 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7f6c34a0 con 0x558a7f60a800 2024-04-19T23:45:37.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecaddf1700 1 -- 172.21.15.155:0/3297614791 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a7f935b00 con 0x558a7f60a800 2024-04-19T23:45:37.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecaddf1700 1 -- 172.21.15.155:0/3297614791 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7f6c3600 con 0x558a7f60a800 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecb164aa80 1 -- 172.21.15.155:0/3297614791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 msgr2=0x558a7f8f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecb164aa80 1 --2- 172.21.15.155:0/3297614791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x558a803e3800 tx=0x558a7f6fbb60 comp rx=0 tx=0).stop 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecb164aa80 1 -- 172.21.15.155:0/3297614791 shutdown_connections 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecb164aa80 1 --2- 172.21.15.155:0/3297614791 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecb164aa80 1 -- 172.21.15.155:0/3297614791 >> 172.21.15.155:0/3297614791 conn(0x558a7f60a400 msgr2=0x558a7f6f7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.009+0000 7fecb164aa80 1 -- 172.21.15.155:0/3297614791 shutdown_connections 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.010+0000 7fecb164aa80 1 -- 172.21.15.155:0/3297614791 wait complete. 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.010+0000 7fecb164aa80 1 Processor -- start 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.010+0000 7fecb164aa80 1 -- start start 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.010+0000 7fecb164aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.010+0000 7fecb164aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7f6ac3c0 con 0x558a7f60a800 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.010+0000 7fecaf5f4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.010+0000 7fecaf5f4700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34032/0 (socket says 172.21.15.155:34032) 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.010+0000 7fecaf5f4700 1 -- 172.21.15.155:0/1205593655 learned_addr learned my addr 172.21.15.155:0/1205593655 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.010+0000 7fecaf5f4700 1 -- 172.21.15.155:0/1205593655 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7f633a00 con 0x558a7f60a800 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.011+0000 7fecaf5f4700 1 --2- 172.21.15.155:0/1205593655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x558a803e3a40 tx=0x558a7f6fba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.011+0000 7fecac5ee700 1 -- 172.21.15.155:0/1205593655 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7f6c38c0 con 0x558a7f60a800 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.011+0000 7fecac5ee700 1 -- 172.21.15.155:0/1205593655 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a7f6abc80 con 0x558a7f60a800 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.011+0000 7fecb164aa80 1 -- 172.21.15.155:0/1205593655 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a7f633860 con 0x558a7f60a800 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.011+0000 7fecac5ee700 1 -- 172.21.15.155:0/1205593655 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7f6c34a0 con 0x558a7f60a800 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.011+0000 7fecb164aa80 1 -- 172.21.15.155:0/1205593655 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a7f6336c0 con 0x558a7f60a800 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.011+0000 7fecb164aa80 1 Processor -- start 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecac5ee700 1 -- 172.21.15.155:0/1205593655 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558a803acb00 con 0x558a7f60a800 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecb164aa80 1 -- start start 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecb164aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 0x558a7f8f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecb164aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7f646640 con 0x558a7f60b400 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecac5ee700 1 --2- 172.21.15.155:0/1205593655 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7f994000 0x558a7f8f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecac5ee700 1 -- 172.21.15.155:0/1205593655 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558a7f685180 con 0x558a7f60a800 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecafdf5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 0x558a7f8f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecafdf5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 0x558a7f8f2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34046/0 (socket says 172.21.15.155:34046) 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecafdf5700 1 -- 172.21.15.155:0/3937036491 learned_addr learned my addr 172.21.15.155:0/3937036491 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecaf5f4700 1 --2- 172.21.15.155:0/1205593655 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7f994000 0x558a7f8f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecafdf5700 1 -- 172.21.15.155:0/3937036491 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7f632000 con 0x558a7f60b400 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecaf5f4700 1 --2- 172.21.15.155:0/1205593655 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7f994000 0x558a7f8f3080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x558a8048cf90 tx=0x558a7f95a240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7fecafdf5700 1 --2- 172.21.15.155:0/3937036491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 0x558a7f8f2b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x558a8048c810 tx=0x558a7f95a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da28db06f7e7554a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7feca9de9700 1 -- 172.21.15.155:0/3937036491 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7f6c38c0 con 0x558a7f60b400 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7feca9de9700 1 -- 172.21.15.155:0/3937036491 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a7f934300 con 0x558a7f60b400 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.012+0000 7feca9de9700 1 -- 172.21.15.155:0/3937036491 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7f6c34a0 con 0x558a7f60b400 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecb164aa80 1 -- 172.21.15.155:0/3937036491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 msgr2=0x558a7f8f2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecb164aa80 1 --2- 172.21.15.155:0/3937036491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 0x558a7f8f2b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x558a8048c810 tx=0x558a7f95a9c0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecb164aa80 1 -- 172.21.15.155:0/3937036491 shutdown_connections 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecb164aa80 1 --2- 172.21.15.155:0/3937036491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 0x558a7f8f2b00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecb164aa80 1 -- 172.21.15.155:0/3937036491 >> 172.21.15.155:0/3937036491 conn(0x558a7f60ac00 msgr2=0x558a7f6f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecb164aa80 1 -- 172.21.15.155:0/3937036491 shutdown_connections 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecb164aa80 1 -- 172.21.15.155:0/3937036491 wait complete. 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecb164aa80 1 Processor -- start 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecb164aa80 1 -- start start 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecb164aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 0x558a7f8f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecb164aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7f6468c0 con 0x558a7f60b400 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecafdf5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 0x558a7f8f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecafdf5700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 0x558a7f8f2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34054/0 (socket says 172.21.15.155:34054) 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.013+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 learned_addr learned my addr 172.21.15.155:0/2595006722 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.014+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7f632ea0 con 0x558a7f60b400 2024-04-19T23:45:37.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.014+0000 7fecafdf5700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 0x558a7f8f2b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x558a8048c900 tx=0x558a7f95a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.014+0000 7feca85e6700 1 -- 172.21.15.155:0/2595006722 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7f6c3b80 con 0x558a7f60b400 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.014+0000 7feca85e6700 1 -- 172.21.15.155:0/2595006722 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a7f6abc80 con 0x558a7f60b400 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.014+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a7f632820 con 0x558a7f60b400 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.014+0000 7feca85e6700 1 -- 172.21.15.155:0/2595006722 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7f6c38c0 con 0x558a7f60b400 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.014+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a7f6329c0 con 0x558a7f60b400 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.015+0000 7feca85e6700 1 -- 172.21.15.155:0/2595006722 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558a803acdc0 con 0x558a7f60b400 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.015+0000 7feca85e6700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7f994c00 0x558a7f8f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.015+0000 7feca85e6700 1 -- 172.21.15.155:0/2595006722 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558a7f685340 con 0x558a7f60b400 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.015+0000 7fecaedf3700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7f994c00 0x558a7f8f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.015+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.015+0000 7fecb164aa80 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558a7f60b800 0x558a7f8f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.015+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f60bc00 con 0x558a7f60b800 2024-04-19T23:45:37.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecafdf5700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558a7f60b800 0x558a7f8f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecaedf3700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7f994c00 0x558a7f8f3600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x558a7f8ed890 tx=0x558a7f6fb800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecafdf5700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558a7f60b800 0x558a7f8f3b80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecb164aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecb164aa80 20 realm 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f995000 con 0x558a7f60b800 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecb164aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecb164aa80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.016+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f995400 con 0x558a7f60b800 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecb164aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f995800 con 0x558a7f60b800 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecb164aa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f995c00 con 0x558a7f60b800 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecb164aa80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecb164aa80 20 searching for the correct realm 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecb164aa80 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558a7f995000 0x558a7f8f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f995400 con 0x558a7f995000 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.017+0000 7fecaf5f4700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558a7f995000 0x558a7f8f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.018+0000 7fecaf5f4700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558a7f995000 0x558a7f8f4100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.018+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.018+0000 7fecaf5f4700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558a7f995400 0x558a7f8f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.018+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54000 con 0x558a7f995400 2024-04-19T23:45:37.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.018+0000 7fecaedf3700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558a7f995400 0x558a7f8f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.018+0000 7fecaedf3700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558a7f995400 0x558a7f8f4c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.019+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.019+0000 7fecaedf3700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558a7fa54000 0x558a7f8f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.019+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7fa54000 2024-04-19T23:45:37.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.019+0000 7fecafdf5700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558a7fa54000 0x558a7f8f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.019+0000 7fecafdf5700 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558a7fa54000 0x558a7f8f5180 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.019+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.019+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f60b800 2024-04-19T23:45:37.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.020+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.020+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f60b800 2024-04-19T23:45:37.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.020+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.020+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7fa54000 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.020+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.020+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7fa54000 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.020+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.020+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995400 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.021+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.021+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995000 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.021+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.021+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f60b800 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.021+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.021+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7fa54000 2024-04-19T23:45:37.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.021+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.021+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f60b800 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.022+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.022+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995400 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.022+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.022+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995000 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.022+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.022+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995000 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.022+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.022+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7fa54000 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.023+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.023+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995000 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.023+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.023+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995000 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.023+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.023+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f60b800 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.023+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.023+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f60b800 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.023+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.023+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7fa54000 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.024+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.024+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995000 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.024+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.024+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995400 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.024+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.024+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f60b800 2024-04-19T23:45:37.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.024+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.024+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7fa54000 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.025+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.025+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995000 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.025+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.025+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7fa54000 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.025+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.025+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995400 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.025+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.025+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995000 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.025+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7fa54000 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f60b800 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995400 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecb164aa80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecb164aa80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecb164aa80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecb164aa80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f60bc00 con 0x558a7f60b800 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecb164aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.026+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54c00 con 0x558a7f60b800 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa55000 con 0x558a7f995400 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 20 zone default found 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 4 Realm: () 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 20 zonegroup default 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa55400 con 0x558a7fa54000 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.027+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa55800 con 0x558a7f995000 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.028+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.028+0000 7fecb164aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.028+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.028+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa55c00 con 0x558a7f995000 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.028+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.028+0000 7fecb164aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.028+0000 7fecb164aa80 20 started sync module instance, tier type = 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.028+0000 7fecb164aa80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:37.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.028+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54c00 con 0x558a7f995400 2024-04-19T23:45:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.029+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.029+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94053333900032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f60bc00 con 0x558a7f995400 2024-04-19T23:45:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.029+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f995800 con 0x558a7f60b800 2024-04-19T23:45:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.030+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.030+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94053333901184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f995c00 con 0x558a7f60b800 2024-04-19T23:45:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.030+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7f995000 2024-04-19T23:45:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.031+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94053333901184] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.032+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94053333900032] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.032+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.032+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94053333902336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa55000 con 0x558a7f995000 2024-04-19T23:45:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.032+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54c00 con 0x558a7f995400 2024-04-19T23:45:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.034+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94053333902336] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.034+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.034+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94053333903488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54400 con 0x558a7f995400 2024-04-19T23:45:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.034+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa55800 con 0x558a7f60b800 2024-04-19T23:45:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.035+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.035+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94053333904640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa55c00 con 0x558a7f60b800 2024-04-19T23:45:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.035+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa54800 con 0x558a7fa54000 2024-04-19T23:45:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.037+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94053333903488] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.037+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94053333904640] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.040+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.040+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94053333905792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa55400 con 0x558a7fa54000 2024-04-19T23:45:37.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.040+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa55800 con 0x558a7fa54000 2024-04-19T23:45:37.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.043+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94053333905792] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.045+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.045+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94053333906944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa55c00 con 0x558a7fa54000 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.045+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f995800 con 0x558a7fa54000 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.048+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.048+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94053333906944] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.048+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94053333908096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f995c00 con 0x558a7fa54000 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.048+0000 7fecb164aa80 20 add_watcher() i=0 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.048+0000 7fecb164aa80 20 add_watcher() i=1 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.048+0000 7fecb164aa80 20 add_watcher() i=2 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.048+0000 7fecb164aa80 20 add_watcher() i=3 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.048+0000 7fecb164aa80 20 add_watcher() i=4 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.048+0000 7fecb164aa80 20 add_watcher() i=5 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.048+0000 7fecb164aa80 20 add_watcher() i=6 2024-04-19T23:45:37.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.049+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94053333908096] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.049+0000 7fecb164aa80 20 add_watcher() i=7 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.049+0000 7fecb164aa80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.049+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f995800 con 0x558a7f60b800 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.049+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.049+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94053335457792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7f995c00 con 0x558a7f60b800 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.051+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94053335457792] v30'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.052+0000 7fec965c2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.052+0000 7fecb164aa80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.052+0000 7fecb164aa80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.052+0000 7fecb164aa80 1 Processor -- start 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.052+0000 7fecb164aa80 1 -- start start 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.052+0000 7fecb164aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.052+0000 7fecb164aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7f6ac3c0 con 0x558a7fa55400 2024-04-19T23:45:37.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.052+0000 7fecaedf3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.052+0000 7fecaedf3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34060/0 (socket says 172.21.15.155:34060) 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.052+0000 7fecaedf3700 1 -- 172.21.15.155:0/4264579898 learned_addr learned my addr 172.21.15.155:0/4264579898 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.052+0000 7fecaedf3700 1 -- 172.21.15.155:0/4264579898 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7f632b60 con 0x558a7fa55400 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.053+0000 7fecaedf3700 1 --2- 172.21.15.155:0/4264579898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x558a7fa6e000 tx=0x558a7f95b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b58973a3d01114d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.053+0000 7fec95dc1700 1 -- 172.21.15.155:0/4264579898 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7f6c3760 con 0x558a7fa55400 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.053+0000 7fec95dc1700 1 -- 172.21.15.155:0/4264579898 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a7fa7e000 con 0x558a7fa55400 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.053+0000 7fec95dc1700 1 -- 172.21.15.155:0/4264579898 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7fa80000 con 0x558a7fa55400 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.053+0000 7fecb164aa80 1 -- 172.21.15.155:0/4264579898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 msgr2=0x558a7f8f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.053+0000 7fecb164aa80 1 --2- 172.21.15.155:0/4264579898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x558a7fa6e000 tx=0x558a7f95b6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.053+0000 7fecb164aa80 1 -- 172.21.15.155:0/4264579898 shutdown_connections 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.053+0000 7fecb164aa80 1 --2- 172.21.15.155:0/4264579898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.053+0000 7fecb164aa80 1 -- 172.21.15.155:0/4264579898 >> 172.21.15.155:0/4264579898 conn(0x558a7fa54800 msgr2=0x558a7f6f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.054+0000 7fecb164aa80 1 -- 172.21.15.155:0/4264579898 shutdown_connections 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.054+0000 7fecb164aa80 1 -- 172.21.15.155:0/4264579898 wait complete. 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.054+0000 7fecb164aa80 1 Processor -- start 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.054+0000 7fecb164aa80 1 -- start start 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.054+0000 7fecb164aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.054+0000 7fecb164aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7f6ac500 con 0x558a7fa55400 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.054+0000 7fecaedf3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.054+0000 7fecaedf3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34066/0 (socket says 172.21.15.155:34066) 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.054+0000 7fecaedf3700 1 -- 172.21.15.155:0/3934900112 learned_addr learned my addr 172.21.15.155:0/3934900112 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.054+0000 7fecaedf3700 1 -- 172.21.15.155:0/3934900112 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7f632d00 con 0x558a7fa55400 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.055+0000 7fecaedf3700 1 --2- 172.21.15.155:0/3934900112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x558a7fa6e210 tx=0x558a7f95b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.055+0000 7fec945be700 1 -- 172.21.15.155:0/3934900112 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7fa80160 con 0x558a7fa55400 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.055+0000 7fec945be700 1 -- 172.21.15.155:0/3934900112 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a7fa7e180 con 0x558a7fa55400 2024-04-19T23:45:37.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.055+0000 7fecb164aa80 1 -- 172.21.15.155:0/3934900112 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a7f632340 con 0x558a7fa55400 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.055+0000 7fec945be700 1 -- 172.21.15.155:0/3934900112 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558a7fa802c0 con 0x558a7fa55400 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.055+0000 7fecb164aa80 1 -- 172.21.15.155:0/3934900112 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a7f633d40 con 0x558a7fa55400 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.056+0000 7fec945be700 1 -- 172.21.15.155:0/3934900112 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558a803adb80 con 0x558a7fa55400 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.056+0000 7fec945be700 1 --2- 172.21.15.155:0/3934900112 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7faf6000 0x558a7f8f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.056+0000 7fec945be700 1 -- 172.21.15.155:0/3934900112 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558a7f685500 con 0x558a7fa55400 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.056+0000 7fecb164aa80 5 note: GC not initialized 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.056+0000 7fecafdf5700 1 --2- 172.21.15.155:0/3934900112 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7faf6000 0x558a7f8f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.056+0000 7fecafdf5700 1 --2- 172.21.15.155:0/3934900112 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7faf6000 0x558a7f8f5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x558a7f9f7d40 tx=0x558a7f95aa20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.057+0000 7fec91db9700 20 reqs_thread_entry: start 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.057+0000 7fecb164aa80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.057+0000 7fecb164aa80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.057+0000 7fec8fdb5700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:07 2024 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:37.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.057+0000 7fec8f593700 20 reqs_thread_entry: start 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.057+0000 7fecb164aa80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.057+0000 7fecb164aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.057+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fa55c00 con 0x558a7f60b800 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.057+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.058+0000 7fecb164aa80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.058+0000 7fecb164aa80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.058+0000 7fecb164aa80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.058+0000 7fecb164aa80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.058+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7faf6400 con 0x558a7f995400 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.058+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.058+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7faf6c00 con 0x558a7f60b800 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.059+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v30'2 uv2 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.059+0000 7fecb164aa80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:37.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.059+0000 7fecb164aa80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.059+0000 7fecb164aa80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.059+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94053335460096 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7faf7000 con 0x558a7f60b800 2024-04-19T23:45:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.059+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94053333904640 notify 128849018881 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x558a7f9fbd40 con 0x558a7f60b800 2024-04-19T23:45:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.060+0000 7feca9de9700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94053333904640 notifier 4317 bl.length()=533 2024-04-19T23:45:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.060+0000 7feca9de9700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.060+0000 7feca9de9700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.060+0000 7feca9de9700 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fb5e000 con 0x558a7f60b800 2024-04-19T23:45:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.060+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(65 notify.4 [notify cookie 94053335460096 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.060+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.060+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 94053335460096 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558a7fabdba0 con 0x558a7f60b800 2024-04-19T23:45:37.067 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 1, 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:37.068 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.069 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:37.070 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:37.070 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:37.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.061+0000 7fec965c2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.061+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94053335457792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7faf7400 con 0x558a7f60b800 2024-04-19T23:45:37.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.062+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94053335457792] v30'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.062+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94053333900032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7faf7800 con 0x558a7f995400 2024-04-19T23:45:37.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.065+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94053333900032] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.065+0000 7fecb164aa80 20 remove_watcher() i=0 2024-04-19T23:45:37.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.065+0000 7fecb164aa80 2 removed watcher, disabling cache 2024-04-19T23:45:37.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.065+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94053333901184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7faf7c00 con 0x558a7f60b800 2024-04-19T23:45:37.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.066+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94053333901184] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.066+0000 7fecb164aa80 20 remove_watcher() i=1 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.066+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94053333902336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fb5e000 con 0x558a7f995000 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.067+0000 7fecaf5f4700 1 -- 172.21.15.155:0/2595006722 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94053333902336] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4d200 con 0x558a7f995000 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.067+0000 7fecb164aa80 20 remove_watcher() i=2 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.067+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94053333903488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fb5e800 con 0x558a7f995400 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.070+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94053333903488] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4d440 con 0x558a7f995400 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.070+0000 7fecb164aa80 20 remove_watcher() i=3 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.070+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94053333904640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7fb5ec00 con 0x558a7f60b800 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.071+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94053333904640] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7f60b800 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.071+0000 7fecb164aa80 20 remove_watcher() i=4 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.071+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94053333905792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7faf6400 con 0x558a7fa54000 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.072+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94053333905792] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.072+0000 7fecb164aa80 20 remove_watcher() i=5 2024-04-19T23:45:37.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.072+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94053333906944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7faf7800 con 0x558a7fa54000 2024-04-19T23:45:37.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.073+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94053333906944] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.073+0000 7fecb164aa80 20 remove_watcher() i=6 2024-04-19T23:45:37.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.073+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94053333908096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558a7faf6c00 con 0x558a7fa54000 2024-04-19T23:45:37.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecafdf5700 1 -- 172.21.15.155:0/2595006722 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94053333908096] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558a7fa4cb40 con 0x558a7fa54000 2024-04-19T23:45:37.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 20 remove_watcher() i=7 2024-04-19T23:45:37.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558a7fa54000 msgr2=0x558a7f8f5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558a7fa54000 0x558a7f8f5180 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558a7f60b800 msgr2=0x558a7f8f3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558a7f60b800 0x558a7f8f3b80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558a7f995400 msgr2=0x558a7f8f4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558a7f995400 0x558a7f8f4c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558a7f995000 msgr2=0x558a7f8f4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558a7f995000 0x558a7f8f4100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7f994c00 msgr2=0x558a7f8f3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7f994c00 0x558a7f8f3600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x558a7f8ed890 tx=0x558a7f6fb800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 msgr2=0x558a7f8f2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 --2- 172.21.15.155:0/2595006722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60b400 0x558a7f8f2b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x558a8048c900 tx=0x558a7f95a120 comp rx=0 tx=0).stop 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 reap_dead start 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecaedf3700 1 -- 172.21.15.155:0/2595006722 reap_dead start 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 shutdown_connections 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 >> 172.21.15.155:0/2595006722 conn(0x558a7f60ac00 msgr2=0x558a7f6f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 shutdown_connections 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.074+0000 7fecb164aa80 1 -- 172.21.15.155:0/2595006722 wait complete. 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/3934900112 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7faf6000 msgr2=0x558a7f8f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 --2- 172.21.15.155:0/3934900112 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7faf6000 0x558a7f8f5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x558a7f9f7d40 tx=0x558a7f95aa20 comp rx=0 tx=0).stop 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/3934900112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 msgr2=0x558a7f8f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 --2- 172.21.15.155:0/3934900112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x558a7fa6e210 tx=0x558a7f95b800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/3934900112 shutdown_connections 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 --2- 172.21.15.155:0/3934900112 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7faf6000 0x558a7f8f5700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 --2- 172.21.15.155:0/3934900112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7fa55400 0x558a7f8f4680 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/3934900112 >> 172.21.15.155:0/3934900112 conn(0x558a7fa54800 msgr2=0x558a7f6f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/3934900112 shutdown_connections 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/3934900112 wait complete. 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/1205593655 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7f994000 msgr2=0x558a7f8f3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 --2- 172.21.15.155:0/1205593655 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7f994000 0x558a7f8f3080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x558a8048cf90 tx=0x558a7f95a240 comp rx=0 tx=0).stop 2024-04-19T23:45:37.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/1205593655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 msgr2=0x558a7f8f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 --2- 172.21.15.155:0/1205593655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x558a803e3a40 tx=0x558a7f6fba40 comp rx=0 tx=0).stop 2024-04-19T23:45:37.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/1205593655 shutdown_connections 2024-04-19T23:45:37.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 --2- 172.21.15.155:0/1205593655 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558a7f994000 0x558a7f8f3080 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 --2- 172.21.15.155:0/1205593655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558a7f60a800 0x558a7f8f2580 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/1205593655 >> 172.21.15.155:0/1205593655 conn(0x558a7f60a400 msgr2=0x558a7f6f7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/1205593655 shutdown_connections 2024-04-19T23:45:37.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.075+0000 7fecb164aa80 1 -- 172.21.15.155:0/1205593655 wait complete. 2024-04-19T23:45:37.081 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:37.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-19T23:45:37.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-19T23:45:37.082 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-19T23:45:37.127 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:37.127 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:37.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.128+0000 7faa40043a80 1 Processor -- start 2024-04-19T23:45:37.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.128+0000 7faa40043a80 1 -- start start 2024-04-19T23:45:37.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.128+0000 7faa40043a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55df8182ec00 0x55df81b16580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.128+0000 7faa40043a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55df81b59500 con 0x55df8182e800 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.128+0000 7faa40043a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55df818d0a00 con 0x55df8182ec00 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.128+0000 7faa3d7ec700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55df8182ec00 0x55df81b16580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.128+0000 7faa3dfed700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55df8182e800 0x55df8191a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46538/0 (socket says 172.21.15.155:46538) 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.128+0000 7faa3d7ec700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55df8182ec00 0x55df81b16580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34074/0 (socket says 172.21.15.155:34074) 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.128+0000 7faa3dfed700 1 -- 172.21.15.155:0/3045023237 learned_addr learned my addr 172.21.15.155:0/3045023237 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa3d7ec700 1 -- 172.21.15.155:0/3045023237 >> v1:172.21.15.76:6789/0 conn(0x55df8182e800 legacy=0x55df8191a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa3d7ec700 1 -- 172.21.15.155:0/3045023237 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df81857d40 con 0x55df8182ec00 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa3d7ec700 1 --2- 172.21.15.155:0/3045023237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182ec00 0x55df81b16580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55df81b11890 tx=0x55df8191f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d1493012f57d83 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa3cfeb700 1 -- 172.21.15.155:0/3045023237 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df818e74a0 con 0x55df8182ec00 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa3cfeb700 1 -- 172.21.15.155:0/3045023237 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55df81b59800 con 0x55df8182ec00 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa3cfeb700 1 -- 172.21.15.155:0/3045023237 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df818e7600 con 0x55df8182ec00 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa40043a80 1 -- 172.21.15.155:0/3045023237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182ec00 msgr2=0x55df81b16580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa40043a80 1 --2- 172.21.15.155:0/3045023237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182ec00 0x55df81b16580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55df81b11890 tx=0x55df8191f920 comp rx=0 tx=0).stop 2024-04-19T23:45:37.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa40043a80 1 -- 172.21.15.155:0/3045023237 shutdown_connections 2024-04-19T23:45:37.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa40043a80 1 --2- 172.21.15.155:0/3045023237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182ec00 0x55df81b16580 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa40043a80 1 -- 172.21.15.155:0/3045023237 >> 172.21.15.155:0/3045023237 conn(0x55df8182e400 msgr2=0x55df8191a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa40043a80 1 -- 172.21.15.155:0/3045023237 shutdown_connections 2024-04-19T23:45:37.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.129+0000 7faa40043a80 1 -- 172.21.15.155:0/3045023237 wait complete. 2024-04-19T23:45:37.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.130+0000 7faa40043a80 1 Processor -- start 2024-04-19T23:45:37.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.130+0000 7faa40043a80 1 -- start start 2024-04-19T23:45:37.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.130+0000 7faa40043a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.130+0000 7faa40043a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df818d0500 con 0x55df8182e800 2024-04-19T23:45:37.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.130+0000 7faa3dfed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.130+0000 7faa3dfed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34080/0 (socket says 172.21.15.155:34080) 2024-04-19T23:45:37.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.130+0000 7faa3dfed700 1 -- 172.21.15.155:0/1708346375 learned_addr learned my addr 172.21.15.155:0/1708346375 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa3dfed700 1 -- 172.21.15.155:0/1708346375 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df81857ba0 con 0x55df8182e800 2024-04-19T23:45:37.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa3dfed700 1 --2- 172.21.15.155:0/1708346375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55df825f5890 tx=0x55df8191fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462c1b68dac7b448 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa3c7ea700 1 -- 172.21.15.155:0/1708346375 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df818e74a0 con 0x55df8182e800 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa3c7ea700 1 -- 172.21.15.155:0/1708346375 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55df81b59b00 con 0x55df8182e800 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa3c7ea700 1 -- 172.21.15.155:0/1708346375 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df818e7600 con 0x55df8182e800 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa40043a80 1 -- 172.21.15.155:0/1708346375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 msgr2=0x55df81b16580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa40043a80 1 --2- 172.21.15.155:0/1708346375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55df825f5890 tx=0x55df8191fb60 comp rx=0 tx=0).stop 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa40043a80 1 -- 172.21.15.155:0/1708346375 shutdown_connections 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa40043a80 1 --2- 172.21.15.155:0/1708346375 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa40043a80 1 -- 172.21.15.155:0/1708346375 >> 172.21.15.155:0/1708346375 conn(0x55df8182e400 msgr2=0x55df8191b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa40043a80 1 -- 172.21.15.155:0/1708346375 shutdown_connections 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.131+0000 7faa40043a80 1 -- 172.21.15.155:0/1708346375 wait complete. 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.132+0000 7faa40043a80 1 Processor -- start 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.132+0000 7faa40043a80 1 -- start start 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.132+0000 7faa40043a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.132+0000 7faa40043a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df818d03c0 con 0x55df8182e800 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.132+0000 7faa3dfed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.132+0000 7faa3dfed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34082/0 (socket says 172.21.15.155:34082) 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.132+0000 7faa3dfed700 1 -- 172.21.15.155:0/3846000442 learned_addr learned my addr 172.21.15.155:0/3846000442 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.132+0000 7faa3dfed700 1 -- 172.21.15.155:0/3846000442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df81857a00 con 0x55df8182e800 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.132+0000 7faa3dfed700 1 --2- 172.21.15.155:0/3846000442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55df825f5aa0 tx=0x55df8191fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.132+0000 7faa3afe7700 1 -- 172.21.15.155:0/3846000442 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df818e78c0 con 0x55df8182e800 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.132+0000 7faa3afe7700 1 -- 172.21.15.155:0/3846000442 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55df818cfc80 con 0x55df8182e800 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa40043a80 1 -- 172.21.15.155:0/3846000442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55df81857860 con 0x55df8182e800 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa3afe7700 1 -- 172.21.15.155:0/3846000442 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df818e74a0 con 0x55df8182e800 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa40043a80 1 -- 172.21.15.155:0/3846000442 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df818576c0 con 0x55df8182e800 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa40043a80 1 Processor -- start 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa40043a80 1 -- start start 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa3afe7700 1 -- 172.21.15.155:0/3846000442 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55df825d0b00 con 0x55df8182e800 2024-04-19T23:45:37.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa40043a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 0x55df81b16b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa40043a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df818d0000 con 0x55df8182f400 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa3afe7700 1 --2- 172.21.15.155:0/3846000442 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81bb4000 0x55df81b17080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa3afe7700 1 -- 172.21.15.155:0/3846000442 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55df818a9180 con 0x55df8182e800 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa3e7ee700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 0x55df81b16b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa3dfed700 1 --2- 172.21.15.155:0/3846000442 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81bb4000 0x55df81b17080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa3e7ee700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 0x55df81b16b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34088/0 (socket says 172.21.15.155:34088) 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.133+0000 7faa3e7ee700 1 -- 172.21.15.155:0/3925582202 learned_addr learned my addr 172.21.15.155:0/3925582202 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.134+0000 7faa3dfed700 1 --2- 172.21.15.155:0/3846000442 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81bb4000 0x55df81b17080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55df826acbd0 tx=0x55df81b7a240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.134+0000 7faa3e7ee700 1 -- 172.21.15.155:0/3925582202 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df81856000 con 0x55df8182f400 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.134+0000 7faa3e7ee700 1 --2- 172.21.15.155:0/3925582202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 0x55df81b16b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55df826ac660 tx=0x55df81b7a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759f0ece648fb416 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.134+0000 7faa387e2700 1 -- 172.21.15.155:0/3925582202 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df818e78c0 con 0x55df8182f400 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.134+0000 7faa387e2700 1 -- 172.21.15.155:0/3925582202 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55df81b58300 con 0x55df8182f400 2024-04-19T23:45:37.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.134+0000 7faa387e2700 1 -- 172.21.15.155:0/3925582202 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df818e74a0 con 0x55df8182f400 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.134+0000 7faa40043a80 1 -- 172.21.15.155:0/3925582202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 msgr2=0x55df81b16b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.134+0000 7faa40043a80 1 --2- 172.21.15.155:0/3925582202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 0x55df81b16b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55df826ac660 tx=0x55df81b7a9c0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa40043a80 1 -- 172.21.15.155:0/3925582202 shutdown_connections 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa40043a80 1 --2- 172.21.15.155:0/3925582202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 0x55df81b16b00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa40043a80 1 -- 172.21.15.155:0/3925582202 >> 172.21.15.155:0/3925582202 conn(0x55df8182ec00 msgr2=0x55df8191b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa40043a80 1 -- 172.21.15.155:0/3925582202 shutdown_connections 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa40043a80 1 -- 172.21.15.155:0/3925582202 wait complete. 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa40043a80 1 Processor -- start 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa40043a80 1 -- start start 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa40043a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 0x55df81b16b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa40043a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8186a640 con 0x55df8182f400 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa3e7ee700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 0x55df81b16b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa3e7ee700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 0x55df81b16b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34104/0 (socket says 172.21.15.155:34104) 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 learned_addr learned my addr 172.21.15.155:0/4271870655 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.135+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df81856ea0 con 0x55df8182f400 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.136+0000 7faa3e7ee700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 0x55df81b16b00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55df826ac4b0 tx=0x55df81b7a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.136+0000 7faa36fdf700 1 -- 172.21.15.155:0/4271870655 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df818e7b80 con 0x55df8182f400 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.136+0000 7faa36fdf700 1 -- 172.21.15.155:0/4271870655 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55df818cfc80 con 0x55df8182f400 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.136+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55df81856820 con 0x55df8182f400 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.136+0000 7faa36fdf700 1 -- 172.21.15.155:0/4271870655 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df818e78c0 con 0x55df8182f400 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.136+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df818569c0 con 0x55df8182f400 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.137+0000 7faa36fdf700 1 -- 172.21.15.155:0/4271870655 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55df825d0dc0 con 0x55df8182f400 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.137+0000 7faa36fdf700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81bb4c00 0x55df81b17600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.137+0000 7faa36fdf700 1 -- 172.21.15.155:0/4271870655 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55df818a9340 con 0x55df8182f400 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.137+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.137+0000 7faa3d7ec700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81bb4c00 0x55df81b17600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.137+0000 7faa40043a80 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55df8182f800 0x55df81b17b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.137+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df8182fc00 con 0x55df8182f800 2024-04-19T23:45:37.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.137+0000 7faa3e7ee700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55df8182f800 0x55df81b17b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.137+0000 7faa3d7ec700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81bb4c00 0x55df81b17600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55df81b11890 tx=0x55df8191f800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.137+0000 7faa3e7ee700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55df8182f800 0x55df81b17b80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 20 realm 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81bb5000 con 0x55df8182f800 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81bb5400 con 0x55df8182f800 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81bb5800 con 0x55df8182f800 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.138+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81bb5c00 con 0x55df8182f800 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.139+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.139+0000 7faa40043a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.139+0000 7faa40043a80 20 searching for the correct realm 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.139+0000 7faa40043a80 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55df81bb5000 0x55df81b18100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.139+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81bb5400 con 0x55df81bb5000 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.139+0000 7faa3dfed700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55df81bb5000 0x55df81b18100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.139+0000 7faa3dfed700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55df81bb5000 0x55df81b18100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.139+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.139+0000 7faa3dfed700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55df81bb5400 0x55df81b18c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.139+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76000 con 0x55df81bb5400 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.140+0000 7faa3d7ec700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55df81bb5400 0x55df81b18c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.140+0000 7faa3d7ec700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55df81bb5400 0x55df81b18c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.140+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.140+0000 7faa3d7ec700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55df81c76000 0x55df81b19180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.140+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81c76000 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.140+0000 7faa3e7ee700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55df81c76000 0x55df81b19180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.140+0000 7faa3e7ee700 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55df81c76000 0x55df81b19180 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.141+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.141+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df8182f800 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.141+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.141+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df8182f800 2024-04-19T23:45:37.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.141+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.141+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81c76000 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.141+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.141+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81c76000 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.141+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.142+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5400 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.142+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.142+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5000 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.142+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.142+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df8182f800 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.142+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.142+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81c76000 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.142+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.142+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df8182f800 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.143+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.143+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5400 2024-04-19T23:45:37.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.143+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.143+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5000 2024-04-19T23:45:37.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.143+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.143+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5000 2024-04-19T23:45:37.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.143+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.143+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81c76000 2024-04-19T23:45:37.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.144+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.144+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5000 2024-04-19T23:45:37.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.144+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.144+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5000 2024-04-19T23:45:37.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.144+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.144+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df8182f800 2024-04-19T23:45:37.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.144+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.144+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df8182f800 2024-04-19T23:45:37.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.144+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.144+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81c76000 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.145+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.145+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5000 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.145+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.145+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5400 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.145+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.145+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df8182f800 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.146+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.146+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81c76000 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.146+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.146+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5000 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.146+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.146+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81c76000 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.146+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.146+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5400 2024-04-19T23:45:37.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.147+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.147+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5000 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.147+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.147+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81c76000 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.147+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.147+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df8182f800 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.147+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.147+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5400 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df8182fc00 con 0x55df8182f800 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76c00 con 0x55df8182f800 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c77000 con 0x55df81bb5400 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 zone default found 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 4 Realm: () 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:37.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 zonegroup default 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.148+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c77400 con 0x55df81c76000 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.149+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.149+0000 7faa40043a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.149+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.149+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c77800 con 0x55df81bb5000 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.149+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.149+0000 7faa40043a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.149+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.149+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c77c00 con 0x55df81bb5000 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.149+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.150+0000 7faa40043a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.150+0000 7faa40043a80 20 started sync module instance, tier type = 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.150+0000 7faa40043a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.150+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76c00 con 0x55df81bb5400 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.150+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.151+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94418441919232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df8182fc00 con 0x55df81bb5400 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.151+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81bb5800 con 0x55df8182f800 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.153+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.153+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94418441920384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81bb5c00 con 0x55df8182f800 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.153+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81bb5000 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.153+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94418441919232] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.156+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94418441920384] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.159+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.159+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94418441921536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c77000 con 0x55df81bb5000 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.159+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76c00 con 0x55df81bb5400 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.160+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94418441921536] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.160+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.160+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94418441922688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76400 con 0x55df81bb5400 2024-04-19T23:45:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.160+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c77800 con 0x55df8182f800 2024-04-19T23:45:37.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.161+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.161+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94418441923840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c77c00 con 0x55df8182f800 2024-04-19T23:45:37.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.161+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c76800 con 0x55df81c76000 2024-04-19T23:45:37.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.161+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94418441922688] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.164+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.164+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94418441924992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c77400 con 0x55df81c76000 2024-04-19T23:45:37.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.164+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c77800 con 0x55df81c76000 2024-04-19T23:45:37.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.166+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94418441923840] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.172+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.172+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94418441924992] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.172+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94418441926144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c77c00 con 0x55df81c76000 2024-04-19T23:45:37.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.172+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81bb5800 con 0x55df81c76000 2024-04-19T23:45:37.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.173+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94418441926144] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.173+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.173+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94418441927296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81bb5c00 con 0x55df81c76000 2024-04-19T23:45:37.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.173+0000 7faa40043a80 20 add_watcher() i=0 2024-04-19T23:45:37.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.173+0000 7faa40043a80 20 add_watcher() i=1 2024-04-19T23:45:37.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.173+0000 7faa40043a80 20 add_watcher() i=2 2024-04-19T23:45:37.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.173+0000 7faa40043a80 20 add_watcher() i=3 2024-04-19T23:45:37.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.173+0000 7faa40043a80 20 add_watcher() i=4 2024-04-19T23:45:37.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.173+0000 7faa40043a80 20 add_watcher() i=5 2024-04-19T23:45:37.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.173+0000 7faa40043a80 20 add_watcher() i=6 2024-04-19T23:45:37.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.176+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94418441927296] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.176+0000 7faa40043a80 20 add_watcher() i=7 2024-04-19T23:45:37.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.176+0000 7faa40043a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:37.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.176+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81bb5800 con 0x55df8182f800 2024-04-19T23:45:37.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.176+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.176+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94418443468800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81bb5c00 con 0x55df8182f800 2024-04-19T23:45:37.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.177+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94418443468800] v30'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.177+0000 7faa24fbb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.177+0000 7faa40043a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:37.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.177+0000 7faa40043a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:37.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.177+0000 7faa40043a80 1 Processor -- start 2024-04-19T23:45:37.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.177+0000 7faa40043a80 1 -- start start 2024-04-19T23:45:37.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.178+0000 7faa40043a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.178+0000 7faa40043a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8186a780 con 0x55df81c77400 2024-04-19T23:45:37.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.178+0000 7faa3d7ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.178+0000 7faa3d7ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34116/0 (socket says 172.21.15.155:34116) 2024-04-19T23:45:37.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.178+0000 7faa3d7ec700 1 -- 172.21.15.155:0/1340805776 learned_addr learned my addr 172.21.15.155:0/1340805776 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.178+0000 7faa3d7ec700 1 -- 172.21.15.155:0/1340805776 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df81856b60 con 0x55df81c77400 2024-04-19T23:45:37.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.178+0000 7faa3d7ec700 1 --2- 172.21.15.155:0/1340805776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55df81bcf3e0 tx=0x55df81b7b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47ad0dd446522f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.178+0000 7faa247ba700 1 -- 172.21.15.155:0/1340805776 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df818e7760 con 0x55df81c77400 2024-04-19T23:45:37.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.178+0000 7faa247ba700 1 -- 172.21.15.155:0/1340805776 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55df81ca0000 con 0x55df81c77400 2024-04-19T23:45:37.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.178+0000 7faa247ba700 1 -- 172.21.15.155:0/1340805776 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df81ca2000 con 0x55df81c77400 2024-04-19T23:45:37.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.179+0000 7faa40043a80 1 -- 172.21.15.155:0/1340805776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 msgr2=0x55df81b18680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.179+0000 7faa40043a80 1 --2- 172.21.15.155:0/1340805776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55df81bcf3e0 tx=0x55df81b7b6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.179+0000 7faa40043a80 1 -- 172.21.15.155:0/1340805776 shutdown_connections 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.179+0000 7faa40043a80 1 --2- 172.21.15.155:0/1340805776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.179+0000 7faa40043a80 1 -- 172.21.15.155:0/1340805776 >> 172.21.15.155:0/1340805776 conn(0x55df81c76800 msgr2=0x55df8191c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.179+0000 7faa40043a80 1 -- 172.21.15.155:0/1340805776 shutdown_connections 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.179+0000 7faa40043a80 1 -- 172.21.15.155:0/1340805776 wait complete. 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.179+0000 7faa40043a80 1 Processor -- start 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.179+0000 7faa40043a80 1 -- start start 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.180+0000 7faa40043a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.180+0000 7faa40043a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df818d0000 con 0x55df81c77400 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.180+0000 7faa3d7ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.180+0000 7faa3d7ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34130/0 (socket says 172.21.15.155:34130) 2024-04-19T23:45:37.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.180+0000 7faa3d7ec700 1 -- 172.21.15.155:0/3955256038 learned_addr learned my addr 172.21.15.155:0/3955256038 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.180+0000 7faa3d7ec700 1 -- 172.21.15.155:0/3955256038 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df81856d00 con 0x55df81c77400 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.180+0000 7faa3d7ec700 1 --2- 172.21.15.155:0/3955256038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55df81c8d230 tx=0x55df81b7b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.180+0000 7faa22fb7700 1 -- 172.21.15.155:0/3955256038 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df81ca2160 con 0x55df81c77400 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.180+0000 7faa22fb7700 1 -- 172.21.15.155:0/3955256038 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55df81ca0180 con 0x55df81c77400 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.180+0000 7faa40043a80 1 -- 172.21.15.155:0/3955256038 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55df81856340 con 0x55df81c77400 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.180+0000 7faa22fb7700 1 -- 172.21.15.155:0/3955256038 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55df81ca22c0 con 0x55df81c77400 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.181+0000 7faa40043a80 1 -- 172.21.15.155:0/3955256038 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df81857d40 con 0x55df81c77400 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.181+0000 7faa22fb7700 1 -- 172.21.15.155:0/3955256038 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55df825d1b80 con 0x55df81c77400 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.181+0000 7faa22fb7700 1 --2- 172.21.15.155:0/3955256038 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81d1a000 0x55df81b19700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.181+0000 7faa22fb7700 1 -- 172.21.15.155:0/3955256038 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55df818a9500 con 0x55df81c77400 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.181+0000 7faa40043a80 5 note: GC not initialized 2024-04-19T23:45:37.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.181+0000 7faa3e7ee700 1 --2- 172.21.15.155:0/3955256038 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81d1a000 0x55df81b19700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.182+0000 7faa3e7ee700 1 --2- 172.21.15.155:0/3955256038 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81d1a000 0x55df81b19700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55df81c1de60 tx=0x55df81b7aa20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.182+0000 7faa207b2700 20 reqs_thread_entry: start 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.182+0000 7faa40043a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.183+0000 7faa40043a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.183+0000 7faa1e7ae700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:07 2024 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.183+0000 7faa1df8c700 20 reqs_thread_entry: start 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.183+0000 7faa40043a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.183+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81c77c00 con 0x55df8182f800 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.183+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.183+0000 7faa40043a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:37.185 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 1, 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:37.186 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.187 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.188 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.188 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:37.188 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:37.188 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:37.188 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:37.188 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:37.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.184+0000 7faa24fbb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.184+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94418443468800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81d1a400 con 0x55df8182f800 2024-04-19T23:45:37.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.185+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94418443468800] v30'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.185+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94418441919232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81d1a800 con 0x55df81bb5400 2024-04-19T23:45:37.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.187+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94418441919232] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.187+0000 7faa40043a80 20 remove_watcher() i=0 2024-04-19T23:45:37.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.187+0000 7faa40043a80 2 removed watcher, disabling cache 2024-04-19T23:45:37.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.187+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94418441920384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81d1ac00 con 0x55df8182f800 2024-04-19T23:45:37.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.188+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94418441920384] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.188+0000 7faa40043a80 20 remove_watcher() i=1 2024-04-19T23:45:37.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.188+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94418441921536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81d1b000 con 0x55df81bb5000 2024-04-19T23:45:37.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.191+0000 7faa3dfed700 1 -- 172.21.15.155:0/4271870655 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94418441921536] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6f200 con 0x55df81bb5000 2024-04-19T23:45:37.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.191+0000 7faa40043a80 20 remove_watcher() i=2 2024-04-19T23:45:37.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.191+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94418441922688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81d1b400 con 0x55df81bb5400 2024-04-19T23:45:37.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.192+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94418441922688] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6f440 con 0x55df81bb5400 2024-04-19T23:45:37.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.192+0000 7faa40043a80 20 remove_watcher() i=3 2024-04-19T23:45:37.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.192+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94418441923840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81d1b800 con 0x55df8182f800 2024-04-19T23:45:37.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.194+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94418441923840] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df8182f800 2024-04-19T23:45:37.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.194+0000 7faa40043a80 20 remove_watcher() i=4 2024-04-19T23:45:37.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.194+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94418441924992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81d1bc00 con 0x55df81c76000 2024-04-19T23:45:37.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.197+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94418441924992] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.197+0000 7faa40043a80 20 remove_watcher() i=5 2024-04-19T23:45:37.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.197+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94418441926144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81d1a400 con 0x55df81c76000 2024-04-19T23:45:37.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.198+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94418441926144] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.198+0000 7faa40043a80 20 remove_watcher() i=6 2024-04-19T23:45:37.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.198+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94418441927296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55df81d1ac00 con 0x55df81c76000 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa3e7ee700 1 -- 172.21.15.155:0/4271870655 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94418441927296] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55df81c6eb40 con 0x55df81c76000 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 20 remove_watcher() i=7 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55df81c76000 msgr2=0x55df81b19180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55df81c76000 0x55df81b19180 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55df8182f800 msgr2=0x55df81b17b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55df8182f800 0x55df81b17b80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55df81bb5400 msgr2=0x55df81b18c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55df81bb5400 0x55df81b18c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55df81bb5000 msgr2=0x55df81b18100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55df81bb5000 0x55df81b18100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81bb4c00 msgr2=0x55df81b17600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81bb4c00 0x55df81b17600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55df81b11890 tx=0x55df8191f800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 msgr2=0x55df81b16b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 --2- 172.21.15.155:0/4271870655 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182f400 0x55df81b16b00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55df826ac4b0 tx=0x55df81b7a120 comp rx=0 tx=0).stop 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 reap_dead start 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa3d7ec700 1 -- 172.21.15.155:0/4271870655 reap_dead start 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 shutdown_connections 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 >> 172.21.15.155:0/4271870655 conn(0x55df8182ec00 msgr2=0x55df8191b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 shutdown_connections 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.199+0000 7faa40043a80 1 -- 172.21.15.155:0/4271870655 wait complete. 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3955256038 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81d1a000 msgr2=0x55df81b19700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 --2- 172.21.15.155:0/3955256038 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81d1a000 0x55df81b19700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55df81c1de60 tx=0x55df81b7aa20 comp rx=0 tx=0).stop 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3955256038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 msgr2=0x55df81b18680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 --2- 172.21.15.155:0/3955256038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55df81c8d230 tx=0x55df81b7b800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3955256038 shutdown_connections 2024-04-19T23:45:37.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 --2- 172.21.15.155:0/3955256038 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81d1a000 0x55df81b19700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 --2- 172.21.15.155:0/3955256038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df81c77400 0x55df81b18680 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3955256038 >> 172.21.15.155:0/3955256038 conn(0x55df81c76800 msgr2=0x55df8191c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3955256038 shutdown_connections 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3955256038 wait complete. 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3846000442 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81bb4000 msgr2=0x55df81b17080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 --2- 172.21.15.155:0/3846000442 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81bb4000 0x55df81b17080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55df826acbd0 tx=0x55df81b7a240 comp rx=0 tx=0).stop 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3846000442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 msgr2=0x55df81b16580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 --2- 172.21.15.155:0/3846000442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55df825f5aa0 tx=0x55df8191fa40 comp rx=0 tx=0).stop 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3846000442 shutdown_connections 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 --2- 172.21.15.155:0/3846000442 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55df81bb4000 0x55df81b17080 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 --2- 172.21.15.155:0/3846000442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55df8182e800 0x55df81b16580 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3846000442 >> 172.21.15.155:0/3846000442 conn(0x55df8182e400 msgr2=0x55df8191b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3846000442 shutdown_connections 2024-04-19T23:45:37.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.200+0000 7faa40043a80 1 -- 172.21.15.155:0/3846000442 wait complete. 2024-04-19T23:45:37.204 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:37.204 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-19T23:45:37.204 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-19T23:45:37.205 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-19T23:45:37.250 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:37.250 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:37.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.251+0000 7f6249ec7a80 1 Processor -- start 2024-04-19T23:45:37.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.251+0000 7f6249ec7a80 1 -- start start 2024-04-19T23:45:37.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.251+0000 7f6249ec7a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.251+0000 7f6249ec7a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ca629bb500 con 0x55ca62690c00 2024-04-19T23:45:37.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.251+0000 7f6249ec7a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ca62732a00 con 0x55ca62690800 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.251+0000 7f6247e71700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.251+0000 7f6247670700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55ca62690c00 0x55ca6277c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46552/0 (socket says 172.21.15.155:46552) 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.251+0000 7f6247670700 1 -- 172.21.15.155:0/2168306442 learned_addr learned my addr 172.21.15.155:0/2168306442 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.251+0000 7f6247e71700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34144/0 (socket says 172.21.15.155:34144) 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6247e71700 1 -- 172.21.15.155:0/2168306442 >> v1:172.21.15.76:6789/0 conn(0x55ca62690c00 legacy=0x55ca6277c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6247e71700 1 -- 172.21.15.155:0/2168306442 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca626b9d40 con 0x55ca62690800 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6246e6f700 1 -- 172.21.15.155:0/2168306442 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289413899 0 0) 0x55ca6345e000 con 0x55ca62690c00 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6247e71700 1 --2- 172.21.15.155:0/2168306442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55ca629739e0 tx=0x55ca62781920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a83ff45b6005d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6246e6f700 1 -- 172.21.15.155:0/2168306442 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca627494a0 con 0x55ca62690800 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6246e6f700 1 -- 172.21.15.155:0/2168306442 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca629bb800 con 0x55ca62690800 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6246e6f700 1 -- 172.21.15.155:0/2168306442 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca62749600 con 0x55ca62690800 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6249ec7a80 1 -- 172.21.15.155:0/2168306442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 msgr2=0x55ca62978580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/2168306442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55ca629739e0 tx=0x55ca62781920 comp rx=0 tx=0).stop 2024-04-19T23:45:37.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6249ec7a80 1 -- 172.21.15.155:0/2168306442 shutdown_connections 2024-04-19T23:45:37.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/2168306442 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.252+0000 7f6249ec7a80 1 -- 172.21.15.155:0/2168306442 >> 172.21.15.155:0/2168306442 conn(0x55ca62690400 msgr2=0x55ca6277c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.253+0000 7f6249ec7a80 1 -- 172.21.15.155:0/2168306442 shutdown_connections 2024-04-19T23:45:37.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.253+0000 7f6249ec7a80 1 -- 172.21.15.155:0/2168306442 wait complete. 2024-04-19T23:45:37.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.253+0000 7f6249ec7a80 1 Processor -- start 2024-04-19T23:45:37.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.253+0000 7f6249ec7a80 1 -- start start 2024-04-19T23:45:37.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.253+0000 7f6249ec7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.253+0000 7f6249ec7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca62732500 con 0x55ca62690800 2024-04-19T23:45:37.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.253+0000 7f6247e71700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.253+0000 7f6247e71700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34158/0 (socket says 172.21.15.155:34158) 2024-04-19T23:45:37.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.253+0000 7f6247e71700 1 -- 172.21.15.155:0/839443414 learned_addr learned my addr 172.21.15.155:0/839443414 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.254+0000 7f6247e71700 1 -- 172.21.15.155:0/839443414 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca626b9ba0 con 0x55ca62690800 2024-04-19T23:45:37.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.254+0000 7f6247e71700 1 --2- 172.21.15.155:0/839443414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55ca63461800 tx=0x55ca62781800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a5563f9ef12779 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.254+0000 7f624666e700 1 -- 172.21.15.155:0/839443414 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca62749760 con 0x55ca62690800 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.254+0000 7f624666e700 1 -- 172.21.15.155:0/839443414 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca629bbb00 con 0x55ca62690800 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.254+0000 7f624666e700 1 -- 172.21.15.155:0/839443414 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca627494a0 con 0x55ca62690800 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.254+0000 7f6249ec7a80 1 -- 172.21.15.155:0/839443414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 msgr2=0x55ca62978580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.254+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/839443414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55ca63461800 tx=0x55ca62781800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6249ec7a80 1 -- 172.21.15.155:0/839443414 shutdown_connections 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/839443414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6249ec7a80 1 -- 172.21.15.155:0/839443414 >> 172.21.15.155:0/839443414 conn(0x55ca62690400 msgr2=0x55ca6277d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6249ec7a80 1 -- 172.21.15.155:0/839443414 shutdown_connections 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6249ec7a80 1 -- 172.21.15.155:0/839443414 wait complete. 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6249ec7a80 1 Processor -- start 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6249ec7a80 1 -- start start 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6249ec7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6249ec7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca627323c0 con 0x55ca62690800 2024-04-19T23:45:37.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6247e71700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6247e71700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34164/0 (socket says 172.21.15.155:34164) 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.255+0000 7f6247e71700 1 -- 172.21.15.155:0/4221714124 learned_addr learned my addr 172.21.15.155:0/4221714124 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.256+0000 7f6247e71700 1 -- 172.21.15.155:0/4221714124 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca626b9a00 con 0x55ca62690800 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.256+0000 7f6247e71700 1 --2- 172.21.15.155:0/4221714124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55ca63461ec0 tx=0x55ca62781920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.256+0000 7f6244e6b700 1 -- 172.21.15.155:0/4221714124 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca62749600 con 0x55ca62690800 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.256+0000 7f6244e6b700 1 -- 172.21.15.155:0/4221714124 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca629bbc80 con 0x55ca62690800 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.256+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4221714124 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca626b9860 con 0x55ca62690800 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.256+0000 7f6244e6b700 1 -- 172.21.15.155:0/4221714124 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca627498c0 con 0x55ca62690800 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.256+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4221714124 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca626b96c0 con 0x55ca62690800 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.256+0000 7f6249ec7a80 1 Processor -- start 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6249ec7a80 1 -- start start 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6244e6b700 1 -- 172.21.15.155:0/4221714124 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ca63432b00 con 0x55ca62690800 2024-04-19T23:45:37.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6249ec7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 0x55ca62978b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6249ec7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca626cc640 con 0x55ca62691400 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6244e6b700 1 --2- 172.21.15.155:0/4221714124 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62a0e000 0x55ca62979080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6244e6b700 1 -- 172.21.15.155:0/4221714124 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ca6270b180 con 0x55ca62690800 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6247e71700 1 --2- 172.21.15.155:0/4221714124 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62a0e000 0x55ca62979080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6248672700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 0x55ca62978b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6248672700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 0x55ca62978b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34176/0 (socket says 172.21.15.155:34176) 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6248672700 1 -- 172.21.15.155:0/1317538112 learned_addr learned my addr 172.21.15.155:0/1317538112 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6248672700 1 -- 172.21.15.155:0/1317538112 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca626b8000 con 0x55ca62691400 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6247e71700 1 --2- 172.21.15.155:0/4221714124 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62a0e000 0x55ca62979080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55ca6351cf90 tx=0x55ca629d4540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6248672700 1 --2- 172.21.15.155:0/1317538112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 0x55ca62978b00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55ca6351c210 tx=0x55ca629d4720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d449589e6590238f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.257+0000 7f6242666700 1 -- 172.21.15.155:0/1317538112 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca62749600 con 0x55ca62691400 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6242666700 1 -- 172.21.15.155:0/1317538112 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca62731c80 con 0x55ca62691400 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6242666700 1 -- 172.21.15.155:0/1317538112 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca627498c0 con 0x55ca62691400 2024-04-19T23:45:37.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1317538112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 msgr2=0x55ca62978b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1317538112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 0x55ca62978b00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55ca6351c210 tx=0x55ca629d4720 comp rx=0 tx=0).stop 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1317538112 shutdown_connections 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1317538112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 0x55ca62978b00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1317538112 >> 172.21.15.155:0/1317538112 conn(0x55ca62690c00 msgr2=0x55ca6277d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1317538112 shutdown_connections 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1317538112 wait complete. 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6249ec7a80 1 Processor -- start 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6249ec7a80 1 -- start start 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6249ec7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 0x55ca62978b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.258+0000 7f6249ec7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca626cc8c0 con 0x55ca62691400 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.259+0000 7f6248672700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 0x55ca62978b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.259+0000 7f6248672700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 0x55ca62978b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34184/0 (socket says 172.21.15.155:34184) 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.259+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 learned_addr learned my addr 172.21.15.155:0/1812409979 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.259+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca626b8ea0 con 0x55ca62691400 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.259+0000 7f6248672700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 0x55ca62978b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55ca634619b0 tx=0x55ca627818c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.259+0000 7f6240e63700 1 -- 172.21.15.155:0/1812409979 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca62749760 con 0x55ca62691400 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.259+0000 7f6240e63700 1 -- 172.21.15.155:0/1812409979 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca62731b00 con 0x55ca62691400 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.259+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca626b8820 con 0x55ca62691400 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.259+0000 7f6240e63700 1 -- 172.21.15.155:0/1812409979 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca62749600 con 0x55ca62691400 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.259+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca626b89c0 con 0x55ca62691400 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.260+0000 7f6240e63700 1 -- 172.21.15.155:0/1812409979 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ca63432dc0 con 0x55ca62691400 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.260+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.260+0000 7f6240e63700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62a0ec00 0x55ca62979600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.260+0000 7f6240e63700 1 -- 172.21.15.155:0/1812409979 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ca6270b340 con 0x55ca62691400 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.260+0000 7f6247670700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62a0ec00 0x55ca62979600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.260+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ca62691800 0x55ca62979b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.260+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62691c00 con 0x55ca62691800 2024-04-19T23:45:37.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.260+0000 7f6248672700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ca62691800 0x55ca62979b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.260+0000 7f6247670700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62a0ec00 0x55ca62979600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55ca63460030 tx=0x55ca629d5320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6248672700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ca62691800 0x55ca62979b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6249ec7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6249ec7a80 20 realm 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62a0f000 con 0x55ca62691800 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6249ec7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6249ec7a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62a0f400 con 0x55ca62691800 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6249ec7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.261+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62a0f800 con 0x55ca62691800 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.262+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.262+0000 7f6249ec7a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.262+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.262+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62a0fc00 con 0x55ca62691800 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.262+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.262+0000 7f6249ec7a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.262+0000 7f6249ec7a80 20 searching for the correct realm 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.262+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ca62a0f000 0x55ca6297a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.262+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62a0f400 con 0x55ca62a0f000 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.262+0000 7f6247e71700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ca62a0f000 0x55ca6297a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.262+0000 7f6247e71700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ca62a0f000 0x55ca6297a100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.263+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.263+0000 7f6247e71700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ca62a0f400 0x55ca6297ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.263+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530000 con 0x55ca62a0f400 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.263+0000 7f6247670700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ca62a0f400 0x55ca6297ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.263+0000 7f6247670700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ca62a0f400 0x55ca6297ac00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.263+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.263+0000 7f6247670700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ca63530000 0x55ca6297b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.263+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca63530000 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.263+0000 7f6248672700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ca63530000 0x55ca6297b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.264+0000 7f6248672700 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ca63530000 0x55ca6297b180 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.264+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.264+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62691800 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.264+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.264+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62691800 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.264+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.264+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca63530000 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.265+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.265+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca63530000 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.265+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.265+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f400 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.265+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.265+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f000 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.265+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.265+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62691800 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.265+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.265+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca63530000 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.266+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.266+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62691800 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.266+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.266+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f400 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.266+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.266+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f000 2024-04-19T23:45:37.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.266+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.266+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f000 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.267+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.267+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca63530000 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.267+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.267+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f000 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.267+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.267+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f000 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.267+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.267+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62691800 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.267+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.267+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62691800 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.268+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.268+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca63530000 2024-04-19T23:45:37.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.268+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.268+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f000 2024-04-19T23:45:37.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.268+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.268+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f400 2024-04-19T23:45:37.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.269+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.269+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62691800 2024-04-19T23:45:37.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.269+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.269+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca63530000 2024-04-19T23:45:37.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.269+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.269+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f000 2024-04-19T23:45:37.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.269+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.269+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca63530000 2024-04-19T23:45:37.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.270+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.270+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f400 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.270+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.270+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f000 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.270+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.270+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca63530000 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.270+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.270+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62691800 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.270+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.270+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f400 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:37.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62691c00 con 0x55ca62691800 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530c00 con 0x55ca62691800 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63531000 con 0x55ca62a0f400 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 zone default found 2024-04-19T23:45:37.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 4 Realm: () 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 zonegroup default 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.271+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63531400 con 0x55ca63530000 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.272+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.272+0000 7f6249ec7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.272+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.272+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63531800 con 0x55ca62a0f000 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.272+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.272+0000 7f6249ec7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.272+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.272+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63531c00 con 0x55ca62a0f000 2024-04-19T23:45:37.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.273+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.273+0000 7f6249ec7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.273+0000 7f6249ec7a80 20 started sync module instance, tier type = 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.273+0000 7f6249ec7a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.273+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530c00 con 0x55ca62a0f400 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.274+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.274+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94327725816576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62691c00 con 0x55ca62a0f400 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.274+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62a0f800 con 0x55ca62691800 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.276+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.276+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94327725817728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62a0fc00 con 0x55ca62691800 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.276+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca62a0f000 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.276+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94327725816576] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.279+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94327725817728] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.279+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.279+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94327725818880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63531000 con 0x55ca62a0f000 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.279+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530c00 con 0x55ca62a0f400 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.281+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94327725818880] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.281+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.281+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94327725820032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530400 con 0x55ca62a0f400 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.281+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63531800 con 0x55ca62691800 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.282+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94327725820032] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.283+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.283+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94327725821184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63531c00 con 0x55ca62691800 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.283+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63530800 con 0x55ca63530000 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.284+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94327725821184] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.284+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.284+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94327725822336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63531400 con 0x55ca63530000 2024-04-19T23:45:37.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.284+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63531800 con 0x55ca63530000 2024-04-19T23:45:37.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.287+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94327725822336] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.289+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.289+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94327725823488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63531c00 con 0x55ca63530000 2024-04-19T23:45:37.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.289+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62a0f800 con 0x55ca63530000 2024-04-19T23:45:37.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.291+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.291+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94327725823488] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.292+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94327725824640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62a0fc00 con 0x55ca63530000 2024-04-19T23:45:37.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.292+0000 7f6249ec7a80 20 add_watcher() i=0 2024-04-19T23:45:37.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.292+0000 7f6249ec7a80 20 add_watcher() i=1 2024-04-19T23:45:37.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.292+0000 7f6249ec7a80 20 add_watcher() i=2 2024-04-19T23:45:37.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.292+0000 7f6249ec7a80 20 add_watcher() i=3 2024-04-19T23:45:37.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.292+0000 7f6249ec7a80 20 add_watcher() i=4 2024-04-19T23:45:37.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.292+0000 7f6249ec7a80 20 add_watcher() i=5 2024-04-19T23:45:37.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.292+0000 7f6249ec7a80 20 add_watcher() i=6 2024-04-19T23:45:37.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.293+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94327725824640] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.293+0000 7f6249ec7a80 20 add_watcher() i=7 2024-04-19T23:45:37.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.293+0000 7f6249ec7a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:37.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.293+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62a0f800 con 0x55ca62691800 2024-04-19T23:45:37.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.293+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.293+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94327727333376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62a0fc00 con 0x55ca62691800 2024-04-19T23:45:37.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.294+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94327727333376] v30'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.294+0000 7f622ee3f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.294+0000 7f6249ec7a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.294+0000 7f6249ec7a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.295+0000 7f6249ec7a80 1 Processor -- start 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.295+0000 7f6249ec7a80 1 -- start start 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.295+0000 7f6249ec7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.295+0000 7f6249ec7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca627323c0 con 0x55ca63531400 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.295+0000 7f6247670700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.295+0000 7f6247670700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34192/0 (socket says 172.21.15.155:34192) 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.295+0000 7f6247670700 1 -- 172.21.15.155:0/4004997830 learned_addr learned my addr 172.21.15.155:0/4004997830 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.296+0000 7f6247670700 1 -- 172.21.15.155:0/4004997830 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca626b8b60 con 0x55ca63531400 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.296+0000 7f6247670700 1 --2- 172.21.15.155:0/4004997830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55ca62aea0c0 tx=0x55ca629d5680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d5386c4d828c4e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.296+0000 7f622e63e700 1 -- 172.21.15.155:0/4004997830 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca62afa000 con 0x55ca63531400 2024-04-19T23:45:37.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.296+0000 7f622e63e700 1 -- 172.21.15.155:0/4004997830 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca62afc000 con 0x55ca63531400 2024-04-19T23:45:37.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.296+0000 7f622e63e700 1 -- 172.21.15.155:0/4004997830 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca62afa160 con 0x55ca63531400 2024-04-19T23:45:37.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.296+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4004997830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 msgr2=0x55ca6297a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.296+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/4004997830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55ca62aea0c0 tx=0x55ca629d5680 comp rx=0 tx=0).stop 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4004997830 shutdown_connections 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/4004997830 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4004997830 >> 172.21.15.155:0/4004997830 conn(0x55ca63530800 msgr2=0x55ca6277e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4004997830 shutdown_connections 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4004997830 wait complete. 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6249ec7a80 1 Processor -- start 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6249ec7a80 1 -- start start 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6249ec7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6249ec7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca62732500 con 0x55ca63531400 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6247670700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6247670700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34204/0 (socket says 172.21.15.155:34204) 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.297+0000 7f6247670700 1 -- 172.21.15.155:0/1369823463 learned_addr learned my addr 172.21.15.155:0/1369823463 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.298+0000 7f6247670700 1 -- 172.21.15.155:0/1369823463 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca626b8d00 con 0x55ca63531400 2024-04-19T23:45:37.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.298+0000 7f6247670700 1 --2- 172.21.15.155:0/1369823463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55ca62aea2d0 tx=0x55ca629d57a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.298+0000 7f622ce3b700 1 -- 172.21.15.155:0/1369823463 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca62afa2c0 con 0x55ca63531400 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.298+0000 7f622ce3b700 1 -- 172.21.15.155:0/1369823463 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca62afc180 con 0x55ca63531400 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.298+0000 7f622ce3b700 1 -- 172.21.15.155:0/1369823463 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ca62afa000 con 0x55ca63531400 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.298+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1369823463 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca626b8340 con 0x55ca63531400 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.298+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1369823463 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca626b8b60 con 0x55ca63531400 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.299+0000 7f622ce3b700 1 -- 172.21.15.155:0/1369823463 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ca63433b80 con 0x55ca63531400 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.299+0000 7f622ce3b700 1 --2- 172.21.15.155:0/1369823463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62b7e000 0x55ca6297b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.299+0000 7f622ce3b700 1 -- 172.21.15.155:0/1369823463 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ca6270b500 con 0x55ca63531400 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.299+0000 7f6249ec7a80 5 note: GC not initialized 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.299+0000 7f6248672700 1 --2- 172.21.15.155:0/1369823463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62b7e000 0x55ca6297b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.299+0000 7f6248672700 1 --2- 172.21.15.155:0/1369823463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62b7e000 0x55ca6297b700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55ca62a1f2c0 tx=0x55ca629d54a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f622a636700 20 reqs_thread_entry: start 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6249ec7a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6249ec7a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:37.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6228632700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:07 2024 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6227e10700 20 reqs_thread_entry: start 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6249ec7a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6249ec7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca63531c00 con 0x55ca62691800 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6249ec7a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6249ec7a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6249ec7a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6249ec7a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.300+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62b7e400 con 0x55ca62a0f400 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.301+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.301+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62b7ec00 con 0x55ca62691800 2024-04-19T23:45:37.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.302+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v30'3 uv3 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.302+0000 7f6249ec7a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.302+0000 7f6249ec7a80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.302+0000 7f6249ec7a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.302+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94327727335680 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62b7f000 con 0x55ca62691800 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.302+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94327725821184 notify 128849018882 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55ca62a7bd40 con 0x55ca62691800 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.302+0000 7f6242666700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94327725821184 notifier 4333 bl.length()=533 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.302+0000 7f6242666700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.302+0000 7f6242666700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.302+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(65 notify.4 [notify cookie 94327727335680 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.302+0000 7f6242666700 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62be6000 con 0x55ca62691800 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.303+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.303+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 94327727335680 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ca62a7ba00 con 0x55ca62691800 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:37.306 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:37.307 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.308 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.308 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.308 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.308 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.308 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.308 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:37.308 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:37.308 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:37.308 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:37.308 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.303+0000 7f622ee3f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.303+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94327727333376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62b7f800 con 0x55ca62691800 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.304+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94327727333376] v30'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.304+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94327725816576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62b7fc00 con 0x55ca62a0f400 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.305+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94327725816576] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.305+0000 7f6249ec7a80 20 remove_watcher() i=0 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.305+0000 7f6249ec7a80 2 removed watcher, disabling cache 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.305+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94327725817728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62be6000 con 0x55ca62691800 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.306+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94327725817728] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.306+0000 7f6249ec7a80 20 remove_watcher() i=1 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.306+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94327725818880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62be6800 con 0x55ca62a0f000 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.309+0000 7f6247e71700 1 -- 172.21.15.155:0/1812409979 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94327725818880] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac9200 con 0x55ca62a0f000 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.309+0000 7f6249ec7a80 20 remove_watcher() i=2 2024-04-19T23:45:37.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.309+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94327725820032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62b7e400 con 0x55ca62a0f400 2024-04-19T23:45:37.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.310+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94327725820032] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac9440 con 0x55ca62a0f400 2024-04-19T23:45:37.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.310+0000 7f6249ec7a80 20 remove_watcher() i=3 2024-04-19T23:45:37.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.310+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94327725821184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62b7fc00 con 0x55ca62691800 2024-04-19T23:45:37.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.312+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94327725821184] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca62691800 2024-04-19T23:45:37.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.312+0000 7f6249ec7a80 20 remove_watcher() i=4 2024-04-19T23:45:37.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.312+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94327725822336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62b7f400 con 0x55ca63530000 2024-04-19T23:45:37.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.314+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94327725822336] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.314+0000 7f6249ec7a80 20 remove_watcher() i=5 2024-04-19T23:45:37.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.314+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94327725823488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62b7ec00 con 0x55ca63530000 2024-04-19T23:45:37.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.317+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94327725823488] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.318+0000 7f6249ec7a80 20 remove_watcher() i=6 2024-04-19T23:45:37.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.318+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94327725824640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca62b7e800 con 0x55ca63530000 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6248672700 1 -- 172.21.15.155:0/1812409979 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94327725824640] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ca62ac8b40 con 0x55ca63530000 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 20 remove_watcher() i=7 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ca63530000 msgr2=0x55ca6297b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ca63530000 0x55ca6297b180 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ca62691800 msgr2=0x55ca62979b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ca62691800 0x55ca62979b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ca62a0f400 msgr2=0x55ca6297ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ca62a0f400 0x55ca6297ac00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ca62a0f000 msgr2=0x55ca6297a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ca62a0f000 0x55ca6297a100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62a0ec00 msgr2=0x55ca62979600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62a0ec00 0x55ca62979600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55ca63460030 tx=0x55ca629d5320 comp rx=0 tx=0).stop 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 msgr2=0x55ca62978b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1812409979 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62691400 0x55ca62978b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55ca634619b0 tx=0x55ca627818c0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 reap_dead start 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6247670700 1 -- 172.21.15.155:0/1812409979 reap_dead start 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 shutdown_connections 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 >> 172.21.15.155:0/1812409979 conn(0x55ca62690c00 msgr2=0x55ca6277d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 shutdown_connections 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.320+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1812409979 wait complete. 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1369823463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62b7e000 msgr2=0x55ca6297b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1369823463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62b7e000 0x55ca6297b700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55ca62a1f2c0 tx=0x55ca629d54a0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1369823463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 msgr2=0x55ca6297a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1369823463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55ca62aea2d0 tx=0x55ca629d57a0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1369823463 shutdown_connections 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1369823463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62b7e000 0x55ca6297b700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/1369823463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca63531400 0x55ca6297a680 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1369823463 >> 172.21.15.155:0/1369823463 conn(0x55ca63530800 msgr2=0x55ca6277e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1369823463 shutdown_connections 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/1369823463 wait complete. 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4221714124 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62a0e000 msgr2=0x55ca62979080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/4221714124 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62a0e000 0x55ca62979080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55ca6351cf90 tx=0x55ca629d4540 comp rx=0 tx=0).stop 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4221714124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 msgr2=0x55ca62978580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/4221714124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55ca63461ec0 tx=0x55ca62781920 comp rx=0 tx=0).stop 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4221714124 shutdown_connections 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/4221714124 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ca62a0e000 0x55ca62979080 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 --2- 172.21.15.155:0/4221714124 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ca62690800 0x55ca62978580 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4221714124 >> 172.21.15.155:0/4221714124 conn(0x55ca62690400 msgr2=0x55ca6277d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4221714124 shutdown_connections 2024-04-19T23:45:37.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.321+0000 7f6249ec7a80 1 -- 172.21.15.155:0/4221714124 wait complete. 2024-04-19T23:45:37.325 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:37.325 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-19T23:45:37.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-19T23:45:37.326 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-19T23:45:37.371 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:37.371 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:37.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f469fa80 1 Processor -- start 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f469fa80 1 -- start start 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f469fa80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x564765e28c00 0x564766110580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f469fa80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564766153500 con 0x564765e28800 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f469fa80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x564765ecaa00 con 0x564765e28c00 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f1e48700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x564765e28c00 0x564766110580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f2649700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x564765e28800 0x564765f14800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46556/0 (socket says 172.21.15.155:46556) 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f2649700 1 -- 172.21.15.155:0/2359136298 learned_addr learned my addr 172.21.15.155:0/2359136298 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f1e48700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x564765e28c00 0x564766110580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34206/0 (socket says 172.21.15.155:34206) 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f1e48700 1 -- 172.21.15.155:0/2359136298 >> v1:172.21.15.76:6789/0 conn(0x564765e28800 legacy=0x564765f14800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f1e48700 1 -- 172.21.15.155:0/2359136298 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564765e51d40 con 0x564765e28c00 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.372+0000 7fd3f1647700 1 -- 172.21.15.155:0/2359136298 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366758720 0 0) 0x564766bee000 con 0x564765e28800 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.373+0000 7fd3f1e48700 1 --2- 172.21.15.155:0/2359136298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28c00 0x564766110580 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56476610b890 tx=0x564765f19920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa71710a71e98d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.373+0000 7fd3f1647700 1 -- 172.21.15.155:0/2359136298 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564765ee14a0 con 0x564765e28c00 2024-04-19T23:45:37.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.373+0000 7fd3f1647700 1 -- 172.21.15.155:0/2359136298 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564766153800 con 0x564765e28c00 2024-04-19T23:45:37.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.373+0000 7fd3f1647700 1 -- 172.21.15.155:0/2359136298 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564765ee1600 con 0x564765e28c00 2024-04-19T23:45:37.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.373+0000 7fd3f469fa80 1 -- 172.21.15.155:0/2359136298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28c00 msgr2=0x564766110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.373+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/2359136298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28c00 0x564766110580 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56476610b890 tx=0x564765f19920 comp rx=0 tx=0).stop 2024-04-19T23:45:37.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.373+0000 7fd3f469fa80 1 -- 172.21.15.155:0/2359136298 shutdown_connections 2024-04-19T23:45:37.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.373+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/2359136298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28c00 0x564766110580 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.373+0000 7fd3f469fa80 1 -- 172.21.15.155:0/2359136298 >> 172.21.15.155:0/2359136298 conn(0x564765e28400 msgr2=0x564765f14000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.373+0000 7fd3f469fa80 1 -- 172.21.15.155:0/2359136298 shutdown_connections 2024-04-19T23:45:37.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.373+0000 7fd3f469fa80 1 -- 172.21.15.155:0/2359136298 wait complete. 2024-04-19T23:45:37.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.374+0000 7fd3f469fa80 1 Processor -- start 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.374+0000 7fd3f469fa80 1 -- start start 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.374+0000 7fd3f469fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.374+0000 7fd3f469fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564765eca500 con 0x564765e28800 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.374+0000 7fd3f2649700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.374+0000 7fd3f2649700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34216/0 (socket says 172.21.15.155:34216) 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.374+0000 7fd3f2649700 1 -- 172.21.15.155:0/2235696430 learned_addr learned my addr 172.21.15.155:0/2235696430 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.374+0000 7fd3f2649700 1 -- 172.21.15.155:0/2235696430 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564765e51ba0 con 0x564765e28800 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f2649700 1 --2- 172.21.15.155:0/2235696430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x564766bf1770 tx=0x564765f19b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ae91d62518585a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f0e46700 1 -- 172.21.15.155:0/2235696430 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564765ee14a0 con 0x564765e28800 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f0e46700 1 -- 172.21.15.155:0/2235696430 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564766153b00 con 0x564765e28800 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f0e46700 1 -- 172.21.15.155:0/2235696430 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564765ee1600 con 0x564765e28800 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f469fa80 1 -- 172.21.15.155:0/2235696430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 msgr2=0x564766110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/2235696430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x564766bf1770 tx=0x564765f19b60 comp rx=0 tx=0).stop 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f469fa80 1 -- 172.21.15.155:0/2235696430 shutdown_connections 2024-04-19T23:45:37.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/2235696430 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f469fa80 1 -- 172.21.15.155:0/2235696430 >> 172.21.15.155:0/2235696430 conn(0x564765e28400 msgr2=0x564765f15000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f469fa80 1 -- 172.21.15.155:0/2235696430 shutdown_connections 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f469fa80 1 -- 172.21.15.155:0/2235696430 wait complete. 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f469fa80 1 Processor -- start 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.375+0000 7fd3f469fa80 1 -- start start 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3f469fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3f469fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564765eca3c0 con 0x564765e28800 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3f2649700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3f2649700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34230/0 (socket says 172.21.15.155:34230) 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3f2649700 1 -- 172.21.15.155:0/3065226930 learned_addr learned my addr 172.21.15.155:0/3065226930 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3f2649700 1 -- 172.21.15.155:0/3065226930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564765e51a00 con 0x564765e28800 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3f2649700 1 --2- 172.21.15.155:0/3065226930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x564766bf1e30 tx=0x564765f19a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3ef643700 1 -- 172.21.15.155:0/3065226930 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564765ee18c0 con 0x564765e28800 2024-04-19T23:45:37.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3ef643700 1 -- 172.21.15.155:0/3065226930 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564765ec9c80 con 0x564765e28800 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3065226930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564765e51860 con 0x564765e28800 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3ef643700 1 -- 172.21.15.155:0/3065226930 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564765ee14a0 con 0x564765e28800 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.376+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3065226930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564765e516c0 con 0x564765e28800 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.377+0000 7fd3f469fa80 1 Processor -- start 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.377+0000 7fd3f469fa80 1 -- start start 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.377+0000 7fd3ef643700 1 -- 172.21.15.155:0/3065226930 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x564766bcab00 con 0x564765e28800 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.377+0000 7fd3f469fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 0x564766110b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.377+0000 7fd3f469fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564765eca000 con 0x564765e29400 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.377+0000 7fd3ef643700 1 --2- 172.21.15.155:0/3065226930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5647661a6000 0x564766111080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.377+0000 7fd3ef643700 1 -- 172.21.15.155:0/3065226930 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x564765ea3180 con 0x564765e28800 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.377+0000 7fd3f2e4a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 0x564766110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.377+0000 7fd3f2649700 1 --2- 172.21.15.155:0/3065226930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5647661a6000 0x564766111080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.377+0000 7fd3f2e4a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 0x564766110b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34244/0 (socket says 172.21.15.155:34244) 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.377+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/3719192615 learned_addr learned my addr 172.21.15.155:0/3719192615 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/3719192615 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564765e50000 con 0x564765e29400 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3f2649700 1 --2- 172.21.15.155:0/3065226930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5647661a6000 0x564766111080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x564766cb6f00 tx=0x56476616e240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3f2e4a700 1 --2- 172.21.15.155:0/3719192615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 0x564766110b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x564766cb6360 tx=0x56476616e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3242ce08b6be9ecf server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3ece3e700 1 -- 172.21.15.155:0/3719192615 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564765ee18c0 con 0x564765e29400 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3ece3e700 1 -- 172.21.15.155:0/3719192615 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564766152300 con 0x564765e29400 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3ece3e700 1 -- 172.21.15.155:0/3719192615 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564765ee14a0 con 0x564765e29400 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3719192615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 msgr2=0x564766110b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/3719192615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 0x564766110b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x564766cb6360 tx=0x56476616e9c0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3719192615 shutdown_connections 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/3719192615 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 0x564766110b00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3719192615 >> 172.21.15.155:0/3719192615 conn(0x564765e28c00 msgr2=0x564765f15800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3719192615 shutdown_connections 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.378+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3719192615 wait complete. 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.379+0000 7fd3f469fa80 1 Processor -- start 2024-04-19T23:45:37.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.379+0000 7fd3f469fa80 1 -- start start 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.379+0000 7fd3f469fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 0x564766110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.379+0000 7fd3f469fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564765e64640 con 0x564765e29400 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.379+0000 7fd3f2e4a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 0x564766110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.379+0000 7fd3f2e4a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 0x564766110b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34260/0 (socket says 172.21.15.155:34260) 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.379+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 learned_addr learned my addr 172.21.15.155:0/1082513496 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.379+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564765e50ea0 con 0x564765e29400 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.379+0000 7fd3f2e4a700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 0x564766110b00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x564766bf1f50 tx=0x56476616e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.379+0000 7fd3eb63b700 1 -- 172.21.15.155:0/1082513496 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564765ee1b80 con 0x564765e29400 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.380+0000 7fd3eb63b700 1 -- 172.21.15.155:0/1082513496 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564765ec9c80 con 0x564765e29400 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.380+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564765e50820 con 0x564765e29400 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.380+0000 7fd3eb63b700 1 -- 172.21.15.155:0/1082513496 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564765ee18c0 con 0x564765e29400 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.380+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564765e509c0 con 0x564765e29400 2024-04-19T23:45:37.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.380+0000 7fd3eb63b700 1 -- 172.21.15.155:0/1082513496 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x564766bcadc0 con 0x564765e29400 2024-04-19T23:45:37.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3eb63b700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5647661a6c00 0x564766111600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3eb63b700 1 -- 172.21.15.155:0/1082513496 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x564765ea3340 con 0x564765e29400 2024-04-19T23:45:37.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f1e48700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5647661a6c00 0x564766111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564765e29800 0x564766111b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564765e29c00 con 0x564765e29800 2024-04-19T23:45:37.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f2e4a700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564765e29800 0x564766111b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f1e48700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5647661a6c00 0x564766111600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x56476610b890 tx=0x564765f19800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f2e4a700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564765e29800 0x564766111b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f469fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f469fa80 20 realm 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.381+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647661a7000 con 0x564765e29800 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647661a7400 con 0x564765e29800 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647661a7800 con 0x564765e29800 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647661a7c00 con 0x564765e29800 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 20 searching for the correct realm 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5647661a7000 0x564766112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.382+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647661a7400 con 0x5647661a7000 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.383+0000 7fd3f2649700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5647661a7000 0x564766112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.383+0000 7fd3f2649700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5647661a7000 0x564766112100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.383+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.383+0000 7fd3f2649700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5647661a7400 0x564766112c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.383+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274000 con 0x5647661a7400 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.383+0000 7fd3f1e48700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5647661a7400 0x564766112c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.384+0000 7fd3f1e48700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5647661a7400 0x564766112c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.384+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.384+0000 7fd3f1e48700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564766274000 0x564766113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.384+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564766274000 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.384+0000 7fd3f2e4a700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564766274000 0x564766113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.384+0000 7fd3f2e4a700 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564766274000 0x564766113180 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.385+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.385+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564765e29800 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.385+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.385+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564765e29800 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.385+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.385+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564766274000 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.385+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.385+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564766274000 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.385+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.385+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7400 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.386+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.386+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7000 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.386+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.386+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564765e29800 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.386+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.386+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564766274000 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.387+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.387+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564765e29800 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.387+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.387+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7400 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.387+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.387+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7000 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.387+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.387+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7000 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.387+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.387+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564766274000 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.388+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.388+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7000 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.388+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.388+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7000 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.388+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.388+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564765e29800 2024-04-19T23:45:37.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.388+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.388+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564765e29800 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.389+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.389+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564766274000 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.389+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.389+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7000 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.389+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.389+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7400 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.389+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.389+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564765e29800 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.390+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.390+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564766274000 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.390+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.390+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7000 2024-04-19T23:45:37.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.390+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.390+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564766274000 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.391+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.391+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7400 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.391+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.391+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7000 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.391+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.391+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564766274000 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.391+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.391+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564765e29800 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.391+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.391+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7400 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:37.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564765e29c00 con 0x564765e29800 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274c00 con 0x564765e29800 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766275000 con 0x5647661a7400 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.392+0000 7fd3f469fa80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 20 zone default found 2024-04-19T23:45:37.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 4 Realm: () 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 20 zonegroup default 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766275400 con 0x564766274000 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766275800 con 0x5647661a7000 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766275c00 con 0x5647661a7000 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 20 started sync module instance, tier type = 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.393+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274c00 con 0x5647661a7400 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.395+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.395+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94864655022848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564765e29c00 con 0x5647661a7400 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.395+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647661a7800 con 0x564765e29800 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.397+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.397+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94864655022848] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.397+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94864655024000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647661a7c00 con 0x564765e29800 2024-04-19T23:45:37.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.397+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x5647661a7000 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.398+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.398+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94864655025152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766275000 con 0x5647661a7000 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.398+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274c00 con 0x5647661a7400 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.400+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.400+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94864655026304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274400 con 0x5647661a7400 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.400+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766275800 con 0x564765e29800 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.401+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94864655024000] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.402+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94864655026304] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.404+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94864655025152] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.404+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.404+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94864655027456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766275c00 con 0x564765e29800 2024-04-19T23:45:37.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.404+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766274800 con 0x564766274000 2024-04-19T23:45:37.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.407+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.407+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94864655028608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766275400 con 0x564766274000 2024-04-19T23:45:37.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.407+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766275800 con 0x564766274000 2024-04-19T23:45:37.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.409+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94864655027456] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.412+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94864655028608] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.412+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.412+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94864655029760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766275c00 con 0x564766274000 2024-04-19T23:45:37.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.412+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647661a7800 con 0x564766274000 2024-04-19T23:45:37.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.414+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.414+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94864655030912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647661a7c00 con 0x564766274000 2024-04-19T23:45:37.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.414+0000 7fd3f469fa80 20 add_watcher() i=0 2024-04-19T23:45:37.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.414+0000 7fd3f469fa80 20 add_watcher() i=1 2024-04-19T23:45:37.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.414+0000 7fd3f469fa80 20 add_watcher() i=2 2024-04-19T23:45:37.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.414+0000 7fd3f469fa80 20 add_watcher() i=3 2024-04-19T23:45:37.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.414+0000 7fd3f469fa80 20 add_watcher() i=4 2024-04-19T23:45:37.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.414+0000 7fd3f469fa80 20 add_watcher() i=5 2024-04-19T23:45:37.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.417+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94864655029760] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.417+0000 7fd3f469fa80 20 add_watcher() i=6 2024-04-19T23:45:37.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.420+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94864655030912] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.420+0000 7fd3f469fa80 20 add_watcher() i=7 2024-04-19T23:45:37.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.420+0000 7fd3f469fa80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:37.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.420+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647661a7800 con 0x564765e29800 2024-04-19T23:45:37.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.420+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.420+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94864656564224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647661a7c00 con 0x564765e29800 2024-04-19T23:45:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.421+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94864656564224] v30'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.421+0000 7fd3d9617700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.421+0000 7fd3f469fa80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.421+0000 7fd3f469fa80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.421+0000 7fd3f469fa80 1 Processor -- start 2024-04-19T23:45:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.421+0000 7fd3f469fa80 1 -- start start 2024-04-19T23:45:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.422+0000 7fd3f469fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.422+0000 7fd3f469fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564765e64780 con 0x564766275400 2024-04-19T23:45:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.422+0000 7fd3f1e48700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.422+0000 7fd3f1e48700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34264/0 (socket says 172.21.15.155:34264) 2024-04-19T23:45:37.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.422+0000 7fd3f1e48700 1 -- 172.21.15.155:0/889790894 learned_addr learned my addr 172.21.15.155:0/889790894 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.422+0000 7fd3f1e48700 1 -- 172.21.15.155:0/889790894 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564765e50b60 con 0x564766275400 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.422+0000 7fd3f1e48700 1 --2- 172.21.15.155:0/889790894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5647661bf440 tx=0x56476616f6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a383cb2fb8b44a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.422+0000 7fd3d8e16700 1 -- 172.21.15.155:0/889790894 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564765ee1760 con 0x564766275400 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.422+0000 7fd3d8e16700 1 -- 172.21.15.155:0/889790894 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564766296000 con 0x564766275400 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.422+0000 7fd3d8e16700 1 -- 172.21.15.155:0/889790894 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56476629e000 con 0x564766275400 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.423+0000 7fd3f469fa80 1 -- 172.21.15.155:0/889790894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 msgr2=0x564766112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.423+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/889790894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5647661bf440 tx=0x56476616f6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.423+0000 7fd3f469fa80 1 -- 172.21.15.155:0/889790894 shutdown_connections 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.423+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/889790894 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.423+0000 7fd3f469fa80 1 -- 172.21.15.155:0/889790894 >> 172.21.15.155:0/889790894 conn(0x564766274800 msgr2=0x564765f16000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.423+0000 7fd3f469fa80 1 -- 172.21.15.155:0/889790894 shutdown_connections 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.423+0000 7fd3f469fa80 1 -- 172.21.15.155:0/889790894 wait complete. 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.423+0000 7fd3f469fa80 1 Processor -- start 2024-04-19T23:45:37.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3f469fa80 1 -- start start 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3f469fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3f469fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564765eca000 con 0x564766275400 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3f1e48700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3f1e48700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34266/0 (socket says 172.21.15.155:34266) 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3f1e48700 1 -- 172.21.15.155:0/3458403629 learned_addr learned my addr 172.21.15.155:0/3458403629 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3f1e48700 1 -- 172.21.15.155:0/3458403629 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564765e50d00 con 0x564766275400 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3f1e48700 1 --2- 172.21.15.155:0/3458403629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x564766285200 tx=0x56476616f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3d7613700 1 -- 172.21.15.155:0/3458403629 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56476629e160 con 0x564766275400 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3d7613700 1 -- 172.21.15.155:0/3458403629 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564766296180 con 0x564766275400 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3458403629 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564765e50340 con 0x564766275400 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.424+0000 7fd3d7613700 1 -- 172.21.15.155:0/3458403629 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56476629e2c0 con 0x564766275400 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.425+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3458403629 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564765e51d40 con 0x564766275400 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.425+0000 7fd3d7613700 1 -- 172.21.15.155:0/3458403629 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x564766bcbb80 con 0x564766275400 2024-04-19T23:45:37.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.425+0000 7fd3d7613700 1 --2- 172.21.15.155:0/3458403629 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564766318000 0x564766113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.425+0000 7fd3d7613700 1 -- 172.21.15.155:0/3458403629 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x564765ea3500 con 0x564766275400 2024-04-19T23:45:37.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.426+0000 7fd3f2e4a700 1 --2- 172.21.15.155:0/3458403629 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564766318000 0x564766113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.426+0000 7fd3f469fa80 5 note: GC not initialized 2024-04-19T23:45:37.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.426+0000 7fd3f2e4a700 1 --2- 172.21.15.155:0/3458403629 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564766318000 0x564766113700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x564766211f50 tx=0x56476616ea20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.426+0000 7fd3d4e0e700 20 reqs_thread_entry: start 2024-04-19T23:45:37.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.427+0000 7fd3f469fa80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:37.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.427+0000 7fd3f469fa80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:37.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.427+0000 7fd3d2e0a700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:07 2024 2024-04-19T23:45:37.429 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:37.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.427+0000 7fd3d25e8700 20 reqs_thread_entry: start 2024-04-19T23:45:37.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.427+0000 7fd3f469fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.427+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766275c00 con 0x564765e29800 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.427+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.427+0000 7fd3f469fa80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:37.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.431 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:37.432 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:37.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.428+0000 7fd3d9617700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.428+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94864656564224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766318400 con 0x564765e29800 2024-04-19T23:45:37.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.429+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94864656564224] v30'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.429+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94864655022848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766318800 con 0x5647661a7400 2024-04-19T23:45:37.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.432+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94864655022848] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.432+0000 7fd3f469fa80 20 remove_watcher() i=0 2024-04-19T23:45:37.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.432+0000 7fd3f469fa80 2 removed watcher, disabling cache 2024-04-19T23:45:37.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.432+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94864655024000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766318c00 con 0x564765e29800 2024-04-19T23:45:37.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.433+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94864655024000] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.433+0000 7fd3f469fa80 20 remove_watcher() i=1 2024-04-19T23:45:37.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.433+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94864655025152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766319000 con 0x5647661a7000 2024-04-19T23:45:37.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.436+0000 7fd3f2649700 1 -- 172.21.15.155:0/1082513496 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94864655025152] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766265200 con 0x5647661a7000 2024-04-19T23:45:37.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.436+0000 7fd3f469fa80 20 remove_watcher() i=2 2024-04-19T23:45:37.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.436+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94864655026304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766319400 con 0x5647661a7400 2024-04-19T23:45:37.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.437+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94864655026304] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766265440 con 0x5647661a7400 2024-04-19T23:45:37.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.437+0000 7fd3f469fa80 20 remove_watcher() i=3 2024-04-19T23:45:37.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.437+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94864655027456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766319800 con 0x564765e29800 2024-04-19T23:45:37.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.439+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94864655027456] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564765e29800 2024-04-19T23:45:37.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.439+0000 7fd3f469fa80 20 remove_watcher() i=4 2024-04-19T23:45:37.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.439+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94864655028608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766319c00 con 0x564766274000 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.440+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94864655028608] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.440+0000 7fd3f469fa80 20 remove_watcher() i=5 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.440+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94864655029760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766318400 con 0x564766274000 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.441+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94864655029760] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.441+0000 7fd3f469fa80 20 remove_watcher() i=6 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.441+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94864655030912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564766318c00 con 0x564766274000 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f2e4a700 1 -- 172.21.15.155:0/1082513496 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94864655030912] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564766264b40 con 0x564766274000 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 20 remove_watcher() i=7 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564766274000 msgr2=0x564766113180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564766274000 0x564766113180 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564765e29800 msgr2=0x564766111b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564765e29800 0x564766111b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5647661a7400 msgr2=0x564766112c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5647661a7400 0x564766112c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5647661a7000 msgr2=0x564766112100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5647661a7000 0x564766112100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5647661a6c00 msgr2=0x564766111600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5647661a6c00 0x564766111600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x56476610b890 tx=0x564765f19800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 msgr2=0x564766110b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/1082513496 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e29400 0x564766110b00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x564766bf1f50 tx=0x56476616e120 comp rx=0 tx=0).stop 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 reap_dead start 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f1e48700 1 -- 172.21.15.155:0/1082513496 reap_dead start 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 shutdown_connections 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 >> 172.21.15.155:0/1082513496 conn(0x564765e28c00 msgr2=0x564765f15800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 shutdown_connections 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.442+0000 7fd3f469fa80 1 -- 172.21.15.155:0/1082513496 wait complete. 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3458403629 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564766318000 msgr2=0x564766113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/3458403629 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564766318000 0x564766113700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x564766211f50 tx=0x56476616ea20 comp rx=0 tx=0).stop 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3458403629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 msgr2=0x564766112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/3458403629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x564766285200 tx=0x56476616f800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3458403629 shutdown_connections 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/3458403629 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564766318000 0x564766113700 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/3458403629 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564766275400 0x564766112680 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3458403629 >> 172.21.15.155:0/3458403629 conn(0x564766274800 msgr2=0x564765f16000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3458403629 shutdown_connections 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3458403629 wait complete. 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3065226930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5647661a6000 msgr2=0x564766111080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/3065226930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5647661a6000 0x564766111080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x564766cb6f00 tx=0x56476616e240 comp rx=0 tx=0).stop 2024-04-19T23:45:37.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3065226930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 msgr2=0x564766110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/3065226930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x564766bf1e30 tx=0x564765f19a40 comp rx=0 tx=0).stop 2024-04-19T23:45:37.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3065226930 shutdown_connections 2024-04-19T23:45:37.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/3065226930 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5647661a6000 0x564766111080 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 --2- 172.21.15.155:0/3065226930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564765e28800 0x564766110580 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3065226930 >> 172.21.15.155:0/3065226930 conn(0x564765e28400 msgr2=0x564765f15000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3065226930 shutdown_connections 2024-04-19T23:45:37.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.443+0000 7fd3f469fa80 1 -- 172.21.15.155:0/3065226930 wait complete. 2024-04-19T23:45:37.449 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:37.449 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-19T23:45:37.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-19T23:45:37.449 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-04-19T23:45:37.498 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:37.498 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:37.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.499+0000 7f40e1574a80 1 Processor -- start 2024-04-19T23:45:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.499+0000 7f40e1574a80 1 -- start start 2024-04-19T23:45:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.499+0000 7f40e1574a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.499+0000 7f40e1574a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ffc4bdd500 con 0x55ffc48b2c00 2024-04-19T23:45:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.499+0000 7f40e1574a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ffc4954a00 con 0x55ffc48b2800 2024-04-19T23:45:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.500+0000 7f40df51e700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.500+0000 7f40ded1d700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55ffc48b2c00 0x55ffc499e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46570/0 (socket says 172.21.15.155:46570) 2024-04-19T23:45:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.500+0000 7f40df51e700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34274/0 (socket says 172.21.15.155:34274) 2024-04-19T23:45:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.500+0000 7f40ded1d700 1 -- 172.21.15.155:0/2194308181 learned_addr learned my addr 172.21.15.155:0/2194308181 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:37.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.500+0000 7f40df51e700 1 -- 172.21.15.155:0/2194308181 >> v1:172.21.15.76:6789/0 conn(0x55ffc48b2c00 legacy=0x55ffc499e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.500+0000 7f40df51e700 1 -- 172.21.15.155:0/2194308181 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffc48dbd40 con 0x55ffc48b2800 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.500+0000 7f40df51e700 1 --2- 172.21.15.155:0/2194308181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55ffc4b959e0 tx=0x55ffc49a3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e7454ee1522211 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.500+0000 7f40de51c700 1 -- 172.21.15.155:0/2194308181 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc496b4a0 con 0x55ffc48b2800 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.500+0000 7f40de51c700 1 -- 172.21.15.155:0/2194308181 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ffc4bdd800 con 0x55ffc48b2800 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.500+0000 7f40de51c700 1 -- 172.21.15.155:0/2194308181 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc496b600 con 0x55ffc48b2800 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.501+0000 7f40e1574a80 1 -- 172.21.15.155:0/2194308181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 msgr2=0x55ffc4b9a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.501+0000 7f40e1574a80 1 --2- 172.21.15.155:0/2194308181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55ffc4b959e0 tx=0x55ffc49a3920 comp rx=0 tx=0).stop 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.501+0000 7f40e1574a80 1 -- 172.21.15.155:0/2194308181 shutdown_connections 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.501+0000 7f40e1574a80 1 --2- 172.21.15.155:0/2194308181 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.501+0000 7f40e1574a80 1 -- 172.21.15.155:0/2194308181 >> 172.21.15.155:0/2194308181 conn(0x55ffc48b2400 msgr2=0x55ffc499e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.501+0000 7f40e1574a80 1 -- 172.21.15.155:0/2194308181 shutdown_connections 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.501+0000 7f40e1574a80 1 -- 172.21.15.155:0/2194308181 wait complete. 2024-04-19T23:45:37.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.501+0000 7f40e1574a80 1 Processor -- start 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.501+0000 7f40e1574a80 1 -- start start 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.501+0000 7f40e1574a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.501+0000 7f40e1574a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc4954500 con 0x55ffc48b2800 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40df51e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40df51e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34288/0 (socket says 172.21.15.155:34288) 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40df51e700 1 -- 172.21.15.155:0/1740460407 learned_addr learned my addr 172.21.15.155:0/1740460407 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40df51e700 1 -- 172.21.15.155:0/1740460407 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffc48dbba0 con 0x55ffc48b2800 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40df51e700 1 --2- 172.21.15.155:0/1740460407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55ffc5679d40 tx=0x55ffc49a3800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65100aec6c6d9da server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40ddd1b700 1 -- 172.21.15.155:0/1740460407 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc496b760 con 0x55ffc48b2800 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40ddd1b700 1 -- 172.21.15.155:0/1740460407 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ffc4bddb00 con 0x55ffc48b2800 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40ddd1b700 1 -- 172.21.15.155:0/1740460407 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc496b4a0 con 0x55ffc48b2800 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40e1574a80 1 -- 172.21.15.155:0/1740460407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 msgr2=0x55ffc4b9a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40e1574a80 1 --2- 172.21.15.155:0/1740460407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55ffc5679d40 tx=0x55ffc49a3800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40e1574a80 1 -- 172.21.15.155:0/1740460407 shutdown_connections 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40e1574a80 1 --2- 172.21.15.155:0/1740460407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40e1574a80 1 -- 172.21.15.155:0/1740460407 >> 172.21.15.155:0/1740460407 conn(0x55ffc48b2400 msgr2=0x55ffc499f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40e1574a80 1 -- 172.21.15.155:0/1740460407 shutdown_connections 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.502+0000 7f40e1574a80 1 -- 172.21.15.155:0/1740460407 wait complete. 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.503+0000 7f40e1574a80 1 Processor -- start 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.503+0000 7f40e1574a80 1 -- start start 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.503+0000 7f40e1574a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.503+0000 7f40e1574a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc49543c0 con 0x55ffc48b2800 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.503+0000 7f40df51e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.503+0000 7f40df51e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34302/0 (socket says 172.21.15.155:34302) 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.503+0000 7f40df51e700 1 -- 172.21.15.155:0/2860700973 learned_addr learned my addr 172.21.15.155:0/2860700973 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.503+0000 7f40df51e700 1 -- 172.21.15.155:0/2860700973 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffc48dba00 con 0x55ffc48b2800 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.503+0000 7f40df51e700 1 --2- 172.21.15.155:0/2860700973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55ffc5679620 tx=0x55ffc49a3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40dc518700 1 -- 172.21.15.155:0/2860700973 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc496b600 con 0x55ffc48b2800 2024-04-19T23:45:37.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40dc518700 1 -- 172.21.15.155:0/2860700973 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ffc4bddc80 con 0x55ffc48b2800 2024-04-19T23:45:37.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40e1574a80 1 -- 172.21.15.155:0/2860700973 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ffc48db860 con 0x55ffc48b2800 2024-04-19T23:45:37.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40dc518700 1 -- 172.21.15.155:0/2860700973 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc496b8c0 con 0x55ffc48b2800 2024-04-19T23:45:37.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40e1574a80 1 -- 172.21.15.155:0/2860700973 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ffc48db6c0 con 0x55ffc48b2800 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40e1574a80 1 Processor -- start 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40dc518700 1 -- 172.21.15.155:0/2860700973 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ffc5654b00 con 0x55ffc48b2800 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40e1574a80 1 -- start start 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40e1574a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 0x55ffc4b9ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40dc518700 1 --2- 172.21.15.155:0/2860700973 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc48b3400 0x55ffc4b9b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40e1574a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc48ee640 con 0x55ffc48b3800 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.504+0000 7f40dc518700 1 -- 172.21.15.155:0/2860700973 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ffc492d180 con 0x55ffc48b2800 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.505+0000 7f40dfd1f700 1 --2- 172.21.15.155:0/2860700973 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc48b3400 0x55ffc4b9b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.505+0000 7f40df51e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 0x55ffc4b9ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.505+0000 7f40df51e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 0x55ffc4b9ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34310/0 (socket says 172.21.15.155:34310) 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.505+0000 7f40df51e700 1 -- 172.21.15.155:0/2967779488 learned_addr learned my addr 172.21.15.155:0/2967779488 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.505+0000 7f40df51e700 1 -- 172.21.15.155:0/2967779488 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffc48da000 con 0x55ffc48b3800 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.505+0000 7f40dfd1f700 1 --2- 172.21.15.155:0/2860700973 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc48b3400 0x55ffc4b9b080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55ffc573a960 tx=0x55ffc4bf6540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.505+0000 7f40df51e700 1 --2- 172.21.15.155:0/2967779488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 0x55ffc4b9ab00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55ffc573af90 tx=0x55ffc4bf64e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e0330760f0f10 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.505+0000 7f40d9d13700 1 -- 172.21.15.155:0/2967779488 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc496b600 con 0x55ffc48b3800 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.505+0000 7f40d9d13700 1 -- 172.21.15.155:0/2967779488 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ffc4bddc80 con 0x55ffc48b3800 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.505+0000 7f40d9d13700 1 -- 172.21.15.155:0/2967779488 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc496b8c0 con 0x55ffc48b3800 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40e1574a80 1 -- 172.21.15.155:0/2967779488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 msgr2=0x55ffc4b9ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40e1574a80 1 --2- 172.21.15.155:0/2967779488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 0x55ffc4b9ab00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55ffc573af90 tx=0x55ffc4bf64e0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40e1574a80 1 -- 172.21.15.155:0/2967779488 shutdown_connections 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40e1574a80 1 --2- 172.21.15.155:0/2967779488 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 0x55ffc4b9ab00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40e1574a80 1 -- 172.21.15.155:0/2967779488 >> 172.21.15.155:0/2967779488 conn(0x55ffc48b2c00 msgr2=0x55ffc499f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40e1574a80 1 -- 172.21.15.155:0/2967779488 shutdown_connections 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40e1574a80 1 -- 172.21.15.155:0/2967779488 wait complete. 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40e1574a80 1 Processor -- start 2024-04-19T23:45:37.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40e1574a80 1 -- start start 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40e1574a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 0x55ffc4b9ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40e1574a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc48ee8c0 con 0x55ffc48b3800 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40df51e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 0x55ffc4b9ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40df51e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 0x55ffc4b9ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34314/0 (socket says 172.21.15.155:34314) 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 learned_addr learned my addr 172.21.15.155:0/1993068628 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.506+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffc48daea0 con 0x55ffc48b3800 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.507+0000 7f40df51e700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 0x55ffc4b9ab00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55ffc573a5d0 tx=0x55ffc4bf6720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.507+0000 7f40d8510700 1 -- 172.21.15.155:0/1993068628 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc496b760 con 0x55ffc48b3800 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.507+0000 7f40d8510700 1 -- 172.21.15.155:0/1993068628 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ffc4953e00 con 0x55ffc48b3800 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.507+0000 7f40d8510700 1 -- 172.21.15.155:0/1993068628 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc496b4a0 con 0x55ffc48b3800 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.507+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ffc48da820 con 0x55ffc48b3800 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.507+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ffc48da9c0 con 0x55ffc48b3800 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.508+0000 7f40d8510700 1 -- 172.21.15.155:0/1993068628 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ffc5654dc0 con 0x55ffc48b3800 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.508+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.508+0000 7f40d8510700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc4c50c00 0x55ffc4b9b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.508+0000 7f40d8510700 1 -- 172.21.15.155:0/1993068628 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ffc492d340 con 0x55ffc48b3800 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.508+0000 7f40ded1d700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc4c50c00 0x55ffc4b9b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.508+0000 7f40e1574a80 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ffc48b3c00 0x55ffc4b9bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.508+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c51000 con 0x55ffc48b3c00 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.508+0000 7f40dfd1f700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ffc48b3c00 0x55ffc4b9bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.508+0000 7f40ded1d700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc4c50c00 0x55ffc4b9b600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55ffc4c4df20 tx=0x55ffc4bf66c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.508+0000 7f40dfd1f700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ffc48b3c00 0x55ffc4b9bb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 20 realm 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c51400 con 0x55ffc48b3c00 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c51800 con 0x55ffc48b3c00 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c51c00 con 0x55ffc48b3c00 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.509+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c51000 con 0x55ffc48b3c00 2024-04-19T23:45:37.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.510+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.510+0000 7f40e1574a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.510+0000 7f40e1574a80 20 searching for the correct realm 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.510+0000 7f40e1574a80 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ffc4c51400 0x55ffc4b9c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.510+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c51800 con 0x55ffc4c51400 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.510+0000 7f40df51e700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ffc4c51400 0x55ffc4b9c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.510+0000 7f40df51e700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ffc4c51400 0x55ffc4b9c100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.510+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.510+0000 7f40df51e700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ffc4c51800 0x55ffc4b9cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.510+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c50400 con 0x55ffc4c51800 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.511+0000 7f40ded1d700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ffc4c51800 0x55ffc4b9cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.511+0000 7f40ded1d700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ffc4c51800 0x55ffc4b9cc00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.511+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.511+0000 7f40ded1d700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ffc4c50400 0x55ffc4b9d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.511+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c50400 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.511+0000 7f40dfd1f700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ffc4c50400 0x55ffc4b9d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.512+0000 7f40dfd1f700 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ffc4c50400 0x55ffc4b9d180 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.512+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.512+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc48b3c00 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.512+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.512+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc48b3c00 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.512+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.512+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c50400 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.513+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.513+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c50400 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.513+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.513+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51800 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.513+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.513+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51400 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.513+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.513+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc48b3c00 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.514+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.514+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c50400 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.514+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.514+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc48b3c00 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.514+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.514+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51800 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.515+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.515+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51400 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.515+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.515+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51400 2024-04-19T23:45:37.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.515+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.515+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c50400 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.515+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.515+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51400 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.515+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.515+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51400 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.516+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.516+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc48b3c00 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.516+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.516+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc48b3c00 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.516+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.516+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c50400 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.516+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.516+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51400 2024-04-19T23:45:37.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.517+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.517+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51800 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.517+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.517+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc48b3c00 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.517+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.517+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c50400 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.517+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.517+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51400 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.517+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.517+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c50400 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.518+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.518+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51800 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.518+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.518+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51400 2024-04-19T23:45:37.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.518+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.518+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c50400 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.518+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.518+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc48b3c00 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51800 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c51c00 con 0x55ffc48b3c00 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c51000 con 0x55ffc48b3c00 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.519+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2400 con 0x55ffc4c51800 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 20 zone default found 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 4 Realm: () 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 20 zonegroup default 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2800 con 0x55ffc4c50400 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2c00 con 0x55ffc4c51400 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.520+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf3000 con 0x55ffc4c51400 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.521+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.521+0000 7f40e1574a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.521+0000 7f40e1574a80 20 started sync module instance, tier type = 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.521+0000 7f40e1574a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.521+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf3400 con 0x55ffc4c51800 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.522+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.522+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94557005486848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf3800 con 0x55ffc4c51800 2024-04-19T23:45:37.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.522+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf3c00 con 0x55ffc48b3c00 2024-04-19T23:45:37.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.524+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.524+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94557005488000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2800 con 0x55ffc48b3c00 2024-04-19T23:45:37.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.524+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf3c00 con 0x55ffc4c51400 2024-04-19T23:45:37.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.524+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94557005486848] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.527+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94557005488000] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.527+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.527+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94557005489152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c51400 2024-04-19T23:45:37.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.527+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2400 con 0x55ffc4c51800 2024-04-19T23:45:37.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.530+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94557005489152] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.530+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.530+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94557005490304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf3400 con 0x55ffc4c51800 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.530+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c51c00 con 0x55ffc48b3c00 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.531+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.531+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94557005490304] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.531+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94557005491456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c51000 con 0x55ffc48b3c00 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.531+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2c00 con 0x55ffc4c50400 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.532+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94557005491456] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.533+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.533+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94557005492608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf3000 con 0x55ffc4c50400 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.533+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf3c00 con 0x55ffc4c50400 2024-04-19T23:45:37.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.536+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94557005492608] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.538+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.539+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94557005493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc4c50400 2024-04-19T23:45:37.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.539+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2800 con 0x55ffc4c50400 2024-04-19T23:45:37.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.541+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.541+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94557005493760] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.541+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94557005494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2c00 con 0x55ffc4c50400 2024-04-19T23:45:37.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.541+0000 7f40e1574a80 20 add_watcher() i=0 2024-04-19T23:45:37.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.541+0000 7f40e1574a80 20 add_watcher() i=1 2024-04-19T23:45:37.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.541+0000 7f40e1574a80 20 add_watcher() i=2 2024-04-19T23:45:37.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.541+0000 7f40e1574a80 20 add_watcher() i=3 2024-04-19T23:45:37.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.541+0000 7f40e1574a80 20 add_watcher() i=4 2024-04-19T23:45:37.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.541+0000 7f40e1574a80 20 add_watcher() i=5 2024-04-19T23:45:37.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.541+0000 7f40e1574a80 20 add_watcher() i=6 2024-04-19T23:45:37.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.544+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94557005494912] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.544+0000 7f40e1574a80 20 add_watcher() i=7 2024-04-19T23:45:37.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.544+0000 7f40e1574a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:37.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.544+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf3000 con 0x55ffc48b3c00 2024-04-19T23:45:37.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.544+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.544+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94557006888960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4c51c00 con 0x55ffc48b3c00 2024-04-19T23:45:37.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.547+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94557006888960] v30'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.547+0000 7f40c64ec700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.547+0000 7f40e1574a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:37.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.547+0000 7f40e1574a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:37.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.547+0000 7f40e1574a80 1 Processor -- start 2024-04-19T23:45:37.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.547+0000 7f40e1574a80 1 -- start start 2024-04-19T23:45:37.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.547+0000 7f40e1574a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.547+0000 7f40e1574a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc49543c0 con 0x55ffc4c51c00 2024-04-19T23:45:37.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.548+0000 7f40ded1d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.548+0000 7f40ded1d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34316/0 (socket says 172.21.15.155:34316) 2024-04-19T23:45:37.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.548+0000 7f40ded1d700 1 -- 172.21.15.155:0/2755481142 learned_addr learned my addr 172.21.15.155:0/2755481142 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.548+0000 7f40ded1d700 1 -- 172.21.15.155:0/2755481142 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffc48dab60 con 0x55ffc4c51c00 2024-04-19T23:45:37.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.548+0000 7f40ded1d700 1 --2- 172.21.15.155:0/2755481142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55ffc4cf00c0 tx=0x55ffc4bf7500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c664306f9dc26ab8 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.548+0000 7f40c5ceb700 1 -- 172.21.15.155:0/2755481142 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc4ce6160 con 0x55ffc4c51c00 2024-04-19T23:45:37.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.548+0000 7f40c5ceb700 1 -- 172.21.15.155:0/2755481142 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ffc4d02000 con 0x55ffc4c51c00 2024-04-19T23:45:37.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.548+0000 7f40c5ceb700 1 -- 172.21.15.155:0/2755481142 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc4ce62c0 con 0x55ffc4c51c00 2024-04-19T23:45:37.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.549+0000 7f40e1574a80 1 -- 172.21.15.155:0/2755481142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 msgr2=0x55ffc4b9c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.549+0000 7f40e1574a80 1 --2- 172.21.15.155:0/2755481142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55ffc4cf00c0 tx=0x55ffc4bf7500 comp rx=0 tx=0).stop 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.549+0000 7f40e1574a80 1 -- 172.21.15.155:0/2755481142 shutdown_connections 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.549+0000 7f40e1574a80 1 --2- 172.21.15.155:0/2755481142 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.549+0000 7f40e1574a80 1 -- 172.21.15.155:0/2755481142 >> 172.21.15.155:0/2755481142 conn(0x55ffc4c51000 msgr2=0x55ffc49a0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.549+0000 7f40e1574a80 1 -- 172.21.15.155:0/2755481142 shutdown_connections 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.549+0000 7f40e1574a80 1 -- 172.21.15.155:0/2755481142 wait complete. 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.549+0000 7f40e1574a80 1 Processor -- start 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.549+0000 7f40e1574a80 1 -- start start 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.549+0000 7f40e1574a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.549+0000 7f40e1574a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffc4954500 con 0x55ffc4c51c00 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.550+0000 7f40ded1d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.550+0000 7f40ded1d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34318/0 (socket says 172.21.15.155:34318) 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.550+0000 7f40ded1d700 1 -- 172.21.15.155:0/3799259942 learned_addr learned my addr 172.21.15.155:0/3799259942 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.550+0000 7f40ded1d700 1 -- 172.21.15.155:0/3799259942 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffc48dad00 con 0x55ffc4c51c00 2024-04-19T23:45:37.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.550+0000 7f40ded1d700 1 --2- 172.21.15.155:0/3799259942 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55ffc4cf1380 tx=0x55ffc4bf7620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.550+0000 7f40c44e8700 1 -- 172.21.15.155:0/3799259942 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc4ce6420 con 0x55ffc4c51c00 2024-04-19T23:45:37.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.550+0000 7f40c44e8700 1 -- 172.21.15.155:0/3799259942 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ffc4d02180 con 0x55ffc4c51c00 2024-04-19T23:45:37.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.550+0000 7f40c44e8700 1 -- 172.21.15.155:0/3799259942 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ffc4ce6160 con 0x55ffc4c51c00 2024-04-19T23:45:37.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.550+0000 7f40e1574a80 1 -- 172.21.15.155:0/3799259942 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ffc48da340 con 0x55ffc4c51c00 2024-04-19T23:45:37.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.550+0000 7f40e1574a80 1 -- 172.21.15.155:0/3799259942 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ffc48dab60 con 0x55ffc4c51c00 2024-04-19T23:45:37.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.551+0000 7f40c44e8700 1 -- 172.21.15.155:0/3799259942 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55ffc5655b80 con 0x55ffc4c51c00 2024-04-19T23:45:37.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.551+0000 7f40c44e8700 1 --2- 172.21.15.155:0/3799259942 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc4d82000 0x55ffc4b9d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.551+0000 7f40c44e8700 1 -- 172.21.15.155:0/3799259942 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55ffc492d6c0 con 0x55ffc4c51c00 2024-04-19T23:45:37.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.551+0000 7f40e1574a80 5 note: GC not initialized 2024-04-19T23:45:37.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.551+0000 7f40dfd1f700 1 --2- 172.21.15.155:0/3799259942 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc4d82000 0x55ffc4b9d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.552+0000 7f40dfd1f700 1 --2- 172.21.15.155:0/3799259942 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc4d82000 0x55ffc4b9d700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55ffc4cf1f20 tx=0x55ffc4bf7380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.552+0000 7f40c1ce3700 20 reqs_thread_entry: start 2024-04-19T23:45:37.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.552+0000 7f40e1574a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:37.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.552+0000 7f40e1574a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:37.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.552+0000 7f40bfcdf700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:07 2024 2024-04-19T23:45:37.556 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:37.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.552+0000 7f40bf4bd700 20 reqs_thread_entry: start 2024-04-19T23:45:37.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2000 con 0x55ffc48b3c00 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf2800 con 0x55ffc4c50400 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:45:37.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.553+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~459 in=459b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4bf3000 con 0x55ffc48b3c00 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~459] v30'4 uv4 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40e1574a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40e1574a80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40e1574a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94557006891264 in=647b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4d82400 con 0x55ffc48b3c00 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94557005491456 notify 128849018883 ret 0) v3 ==== 677+0+0 (crc 0 0 0) 0x55ffc4de8000 con 0x55ffc48b3c00 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40d9d13700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94557005491456 notifier 4349 bl.length()=635 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40d9d13700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(65 notify.4 [notify cookie 94557006891264 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40d9d13700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40d9d13700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4df2000 con 0x55ffc48b3c00 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 94557006891264 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ffc4de81a0 con 0x55ffc48b3c00 2024-04-19T23:45:37.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.555+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4d82800 con 0x55ffc4c50400 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40e1574a80 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40e1574a80 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40e1574a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94557006891264 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4d82c00 con 0x55ffc4c51400 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 94557005489152 notify 128849018880 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55ffc4c6a9c0 con 0x55ffc4c51400 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40d9d13700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94557005489152 notifier 4349 bl.length()=177 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40d9d13700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40d9d13700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40d9d13700 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4df2400 con 0x55ffc4c51400 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(68 notify.2 [notify cookie 94557006891264 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== watch-notify(notify_complete (2) cookie 94557006891264 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ffc4c6ab60 con 0x55ffc4c51400 2024-04-19T23:45:37.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.557+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.561 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:37.561 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:37.561 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:37.561 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:37.561 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:37.561 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:37.561 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:37.561 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:37.561 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.561 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:37.562 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.563 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:37.564 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:37.564 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:37.564 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:37.564 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:37.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.558+0000 7f40c64ec700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.558+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94557006888960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4d83000 con 0x55ffc48b3c00 2024-04-19T23:45:37.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.559+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94557006888960] v30'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.559+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94557005486848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4d83400 con 0x55ffc4c51800 2024-04-19T23:45:37.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.564+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94557005486848] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.564+0000 7f40e1574a80 20 remove_watcher() i=0 2024-04-19T23:45:37.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.564+0000 7f40e1574a80 2 removed watcher, disabling cache 2024-04-19T23:45:37.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.564+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94557005488000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4d83800 con 0x55ffc48b3c00 2024-04-19T23:45:37.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.566+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94557005488000] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.566+0000 7f40e1574a80 20 remove_watcher() i=1 2024-04-19T23:45:37.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.566+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94557005489152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4df2000 con 0x55ffc4c51400 2024-04-19T23:45:37.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.567+0000 7f40df51e700 1 -- 172.21.15.155:0/1993068628 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94557005489152] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc1200 con 0x55ffc4c51400 2024-04-19T23:45:37.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.567+0000 7f40e1574a80 20 remove_watcher() i=2 2024-04-19T23:45:37.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.567+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94557005490304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4df2800 con 0x55ffc4c51800 2024-04-19T23:45:37.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.568+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94557005490304] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc1440 con 0x55ffc4c51800 2024-04-19T23:45:37.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.568+0000 7f40e1574a80 20 remove_watcher() i=3 2024-04-19T23:45:37.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.568+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94557005491456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4df2c00 con 0x55ffc48b3c00 2024-04-19T23:45:37.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.569+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94557005491456] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc48b3c00 2024-04-19T23:45:37.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.569+0000 7f40e1574a80 20 remove_watcher() i=4 2024-04-19T23:45:37.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.569+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94557005492608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4df3000 con 0x55ffc4c50400 2024-04-19T23:45:37.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.570+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94557005492608] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.570+0000 7f40e1574a80 20 remove_watcher() i=5 2024-04-19T23:45:37.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.570+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94557005493760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4df3400 con 0x55ffc4c50400 2024-04-19T23:45:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.573+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94557005493760] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.573+0000 7f40e1574a80 20 remove_watcher() i=6 2024-04-19T23:45:37.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.573+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94557005494912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ffc4df3800 con 0x55ffc4c50400 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40dfd1f700 1 -- 172.21.15.155:0/1993068628 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94557005494912] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ffc4cc0b40 con 0x55ffc4c50400 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 20 remove_watcher() i=7 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ffc4c50400 msgr2=0x55ffc4b9d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55ffc4c50400 0x55ffc4b9d180 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ffc48b3c00 msgr2=0x55ffc4b9bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55ffc48b3c00 0x55ffc4b9bb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ffc4c51800 msgr2=0x55ffc4b9cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55ffc4c51800 0x55ffc4b9cc00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ffc4c51400 msgr2=0x55ffc4b9c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55ffc4c51400 0x55ffc4b9c100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc4c50c00 msgr2=0x55ffc4b9b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc4c50c00 0x55ffc4b9b600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55ffc4c4df20 tx=0x55ffc4bf66c0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 msgr2=0x55ffc4b9ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 --2- 172.21.15.155:0/1993068628 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b3800 0x55ffc4b9ab00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55ffc573a5d0 tx=0x55ffc4bf6720 comp rx=0 tx=0).stop 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 reap_dead start 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40ded1d700 1 -- 172.21.15.155:0/1993068628 reap_dead start 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 shutdown_connections 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.574+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 >> 172.21.15.155:0/1993068628 conn(0x55ffc48b2c00 msgr2=0x55ffc499f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 shutdown_connections 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/1993068628 wait complete. 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/3799259942 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc4d82000 msgr2=0x55ffc4b9d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 --2- 172.21.15.155:0/3799259942 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc4d82000 0x55ffc4b9d700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55ffc4cf1f20 tx=0x55ffc4bf7380 comp rx=0 tx=0).stop 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/3799259942 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 msgr2=0x55ffc4b9c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 --2- 172.21.15.155:0/3799259942 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55ffc4cf1380 tx=0x55ffc4bf7620 comp rx=0 tx=0).stop 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/3799259942 shutdown_connections 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 --2- 172.21.15.155:0/3799259942 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc4d82000 0x55ffc4b9d700 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 --2- 172.21.15.155:0/3799259942 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc4c51c00 0x55ffc4b9c680 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/3799259942 >> 172.21.15.155:0/3799259942 conn(0x55ffc4c51000 msgr2=0x55ffc49a0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/3799259942 shutdown_connections 2024-04-19T23:45:37.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/3799259942 wait complete. 2024-04-19T23:45:37.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/2860700973 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc48b3400 msgr2=0x55ffc4b9b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 --2- 172.21.15.155:0/2860700973 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc48b3400 0x55ffc4b9b080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55ffc573a960 tx=0x55ffc4bf6540 comp rx=0 tx=0).stop 2024-04-19T23:45:37.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/2860700973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 msgr2=0x55ffc4b9a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 --2- 172.21.15.155:0/2860700973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55ffc5679620 tx=0x55ffc49a3920 comp rx=0 tx=0).stop 2024-04-19T23:45:37.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/2860700973 shutdown_connections 2024-04-19T23:45:37.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 --2- 172.21.15.155:0/2860700973 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55ffc48b3400 0x55ffc4b9b080 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 --2- 172.21.15.155:0/2860700973 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55ffc48b2800 0x55ffc4b9a580 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/2860700973 >> 172.21.15.155:0/2860700973 conn(0x55ffc48b2400 msgr2=0x55ffc499f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.575+0000 7f40e1574a80 1 -- 172.21.15.155:0/2860700973 shutdown_connections 2024-04-19T23:45:37.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.576+0000 7f40e1574a80 1 -- 172.21.15.155:0/2860700973 wait complete. 2024-04-19T23:45:37.580 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:37.580 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-19T23:45:37.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-19T23:45:37.580 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-19T23:45:37.626 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:37.626 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:37.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f99166bda80 1 Processor -- start 2024-04-19T23:45:37.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f99166bda80 1 -- start start 2024-04-19T23:45:37.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f99166bda80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55a0445c4c00 0x55a0448ac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f99166bda80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a0448ef500 con 0x55a0445c4800 2024-04-19T23:45:37.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f99166bda80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a044666a00 con 0x55a0445c4c00 2024-04-19T23:45:37.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f9913e66700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55a0445c4c00 0x55a0448ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f9913e66700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55a0445c4c00 0x55a0448ac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34334/0 (socket says 172.21.15.155:34334) 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f9914667700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55a0445c4800 0x55a0446b0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46572/0 (socket says 172.21.15.155:46572) 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f9913e66700 1 -- 172.21.15.155:0/2315787324 learned_addr learned my addr 172.21.15.155:0/2315787324 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f9913e66700 1 -- 172.21.15.155:0/2315787324 >> v1:172.21.15.76:6789/0 conn(0x55a0445c4800 legacy=0x55a0446b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f9913e66700 1 -- 172.21.15.155:0/2315787324 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0445edd40 con 0x55a0445c4c00 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.627+0000 7f9913665700 1 -- 172.21.15.155:0/2315787324 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941988771 0 0) 0x55a045392000 con 0x55a0445c4800 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.628+0000 7f9913e66700 1 --2- 172.21.15.155:0/2315787324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4c00 0x55a0448ac580 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55a0448a7890 tx=0x55a0446b5920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e5a824a76dfd81 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.628+0000 7f9913665700 1 -- 172.21.15.155:0/2315787324 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a04467d4a0 con 0x55a0445c4c00 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.628+0000 7f9913665700 1 -- 172.21.15.155:0/2315787324 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0448ef800 con 0x55a0445c4c00 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.628+0000 7f9913665700 1 -- 172.21.15.155:0/2315787324 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a04467d600 con 0x55a0445c4c00 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.628+0000 7f99166bda80 1 -- 172.21.15.155:0/2315787324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4c00 msgr2=0x55a0448ac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.628+0000 7f99166bda80 1 --2- 172.21.15.155:0/2315787324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4c00 0x55a0448ac580 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55a0448a7890 tx=0x55a0446b5920 comp rx=0 tx=0).stop 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.628+0000 7f99166bda80 1 -- 172.21.15.155:0/2315787324 shutdown_connections 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.628+0000 7f99166bda80 1 --2- 172.21.15.155:0/2315787324 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4c00 0x55a0448ac580 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.628+0000 7f99166bda80 1 -- 172.21.15.155:0/2315787324 >> 172.21.15.155:0/2315787324 conn(0x55a0445c4400 msgr2=0x55a0446b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.628+0000 7f99166bda80 1 -- 172.21.15.155:0/2315787324 shutdown_connections 2024-04-19T23:45:37.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.628+0000 7f99166bda80 1 -- 172.21.15.155:0/2315787324 wait complete. 2024-04-19T23:45:37.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.629+0000 7f99166bda80 1 Processor -- start 2024-04-19T23:45:37.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.629+0000 7f99166bda80 1 -- start start 2024-04-19T23:45:37.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.629+0000 7f99166bda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.629+0000 7f99166bda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044666500 con 0x55a0445c4800 2024-04-19T23:45:37.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.629+0000 7f9914667700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.629+0000 7f9914667700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34338/0 (socket says 172.21.15.155:34338) 2024-04-19T23:45:37.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.629+0000 7f9914667700 1 -- 172.21.15.155:0/1138468239 learned_addr learned my addr 172.21.15.155:0/1138468239 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f9914667700 1 -- 172.21.15.155:0/1138468239 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0445edba0 con 0x55a0445c4800 2024-04-19T23:45:37.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f9914667700 1 --2- 172.21.15.155:0/1138468239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55a04538b830 tx=0x55a0446b5b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8237649a7c807546 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f9912e64700 1 -- 172.21.15.155:0/1138468239 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a04467d4a0 con 0x55a0445c4800 2024-04-19T23:45:37.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f9912e64700 1 -- 172.21.15.155:0/1138468239 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0448efb00 con 0x55a0445c4800 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f9912e64700 1 -- 172.21.15.155:0/1138468239 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a04467d600 con 0x55a0445c4800 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f99166bda80 1 -- 172.21.15.155:0/1138468239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 msgr2=0x55a0448ac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f99166bda80 1 --2- 172.21.15.155:0/1138468239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55a04538b830 tx=0x55a0446b5b60 comp rx=0 tx=0).stop 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f99166bda80 1 -- 172.21.15.155:0/1138468239 shutdown_connections 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f99166bda80 1 --2- 172.21.15.155:0/1138468239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f99166bda80 1 -- 172.21.15.155:0/1138468239 >> 172.21.15.155:0/1138468239 conn(0x55a0445c4400 msgr2=0x55a0446b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f99166bda80 1 -- 172.21.15.155:0/1138468239 shutdown_connections 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.630+0000 7f99166bda80 1 -- 172.21.15.155:0/1138468239 wait complete. 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.631+0000 7f99166bda80 1 Processor -- start 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.631+0000 7f99166bda80 1 -- start start 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.631+0000 7f99166bda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.631+0000 7f99166bda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0446663c0 con 0x55a0445c4800 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.631+0000 7f9914667700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.631+0000 7f9914667700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34342/0 (socket says 172.21.15.155:34342) 2024-04-19T23:45:37.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.631+0000 7f9914667700 1 -- 172.21.15.155:0/2109588875 learned_addr learned my addr 172.21.15.155:0/2109588875 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.632+0000 7f9914667700 1 -- 172.21.15.155:0/2109588875 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0445eda00 con 0x55a0445c4800 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.632+0000 7f9914667700 1 --2- 172.21.15.155:0/2109588875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55a04538ba40 tx=0x55a0446b5a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.632+0000 7f9911661700 1 -- 172.21.15.155:0/2109588875 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a04467d8c0 con 0x55a0445c4800 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.632+0000 7f9911661700 1 -- 172.21.15.155:0/2109588875 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a044665c80 con 0x55a0445c4800 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.632+0000 7f99166bda80 1 -- 172.21.15.155:0/2109588875 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0445ed860 con 0x55a0445c4800 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.632+0000 7f9911661700 1 -- 172.21.15.155:0/2109588875 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a04467d4a0 con 0x55a0445c4800 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.632+0000 7f99166bda80 1 -- 172.21.15.155:0/2109588875 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0445ed6c0 con 0x55a0445c4800 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.632+0000 7f99166bda80 1 Processor -- start 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f99166bda80 1 -- start start 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f9911661700 1 -- 172.21.15.155:0/2109588875 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55a045366b00 con 0x55a0445c4800 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f99166bda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 0x55a0448acb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f99166bda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044666000 con 0x55a0445c5400 2024-04-19T23:45:37.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f9911661700 1 --2- 172.21.15.155:0/2109588875 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a04494c000 0x55a0448ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f9911661700 1 -- 172.21.15.155:0/2109588875 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55a04463f180 con 0x55a0445c4800 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f9914667700 1 --2- 172.21.15.155:0/2109588875 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a04494c000 0x55a0448ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f9914e68700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 0x55a0448acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f9914e68700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 0x55a0448acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34352/0 (socket says 172.21.15.155:34352) 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f9914e68700 1 -- 172.21.15.155:0/2324054126 learned_addr learned my addr 172.21.15.155:0/2324054126 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f9914e68700 1 -- 172.21.15.155:0/2324054126 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0445ec000 con 0x55a0445c5400 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f9914667700 1 --2- 172.21.15.155:0/2109588875 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a04494c000 0x55a0448ad080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55a045442fc0 tx=0x55a044910240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f9914e68700 1 --2- 172.21.15.155:0/2324054126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 0x55a0448acb00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55a045442360 tx=0x55a044910060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188cb1c117a17f9f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f990ee5c700 1 -- 172.21.15.155:0/2324054126 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a04467d8c0 con 0x55a0445c5400 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f990ee5c700 1 -- 172.21.15.155:0/2324054126 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0448ee300 con 0x55a0445c5400 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.633+0000 7f990ee5c700 1 -- 172.21.15.155:0/2324054126 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a04467d4a0 con 0x55a0445c5400 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.634+0000 7f99166bda80 1 -- 172.21.15.155:0/2324054126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 msgr2=0x55a0448acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.634+0000 7f99166bda80 1 --2- 172.21.15.155:0/2324054126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 0x55a0448acb00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55a045442360 tx=0x55a044910060 comp rx=0 tx=0).stop 2024-04-19T23:45:37.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.634+0000 7f99166bda80 1 -- 172.21.15.155:0/2324054126 shutdown_connections 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.634+0000 7f99166bda80 1 --2- 172.21.15.155:0/2324054126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 0x55a0448acb00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.634+0000 7f99166bda80 1 -- 172.21.15.155:0/2324054126 >> 172.21.15.155:0/2324054126 conn(0x55a0445c4c00 msgr2=0x55a0446b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.634+0000 7f99166bda80 1 -- 172.21.15.155:0/2324054126 shutdown_connections 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.634+0000 7f99166bda80 1 -- 172.21.15.155:0/2324054126 wait complete. 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.634+0000 7f99166bda80 1 Processor -- start 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.634+0000 7f99166bda80 1 -- start start 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.634+0000 7f99166bda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 0x55a0448acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.635+0000 7f99166bda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044600640 con 0x55a0445c5400 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.635+0000 7f9914e68700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 0x55a0448acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.635+0000 7f9914e68700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 0x55a0448acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34354/0 (socket says 172.21.15.155:34354) 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.635+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 learned_addr learned my addr 172.21.15.155:0/2402761754 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.635+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0445ecea0 con 0x55a0445c5400 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.635+0000 7f9914e68700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 0x55a0448acb00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55a045442240 tx=0x55a044910120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.635+0000 7f990d659700 1 -- 172.21.15.155:0/2402761754 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a04467db80 con 0x55a0445c5400 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.635+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0445ec820 con 0x55a0445c5400 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.635+0000 7f990d659700 1 -- 172.21.15.155:0/2402761754 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a044665c80 con 0x55a0445c5400 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.635+0000 7f990d659700 1 -- 172.21.15.155:0/2402761754 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a04467d8c0 con 0x55a0445c5400 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.635+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0445ec9c0 con 0x55a0445c5400 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.636+0000 7f990d659700 1 -- 172.21.15.155:0/2402761754 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55a045366dc0 con 0x55a0445c5400 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.636+0000 7f990d659700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a04494cc00 0x55a0448ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.636+0000 7f990d659700 1 -- 172.21.15.155:0/2402761754 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55a04463f340 con 0x55a0445c5400 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.636+0000 7f9913e66700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a04494cc00 0x55a0448ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.636+0000 7f9913e66700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a04494cc00 0x55a0448ad600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55a0448a7890 tx=0x55a0446b5800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f99166bda80 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55a0445c5800 0x55a0448adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0445c5c00 con 0x55a0445c5800 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f9914e68700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55a0445c5800 0x55a0448adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f9914e68700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55a0445c5800 0x55a0448adb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f99166bda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f99166bda80 20 realm 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a04494d000 con 0x55a0445c5800 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f99166bda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f99166bda80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.637+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a04494d400 con 0x55a0445c5800 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f99166bda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a04494d800 con 0x55a0445c5800 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f99166bda80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a04494dc00 con 0x55a0445c5800 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f99166bda80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f99166bda80 20 searching for the correct realm 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f99166bda80 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55a04494d000 0x55a0448ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a04494d400 con 0x55a04494d000 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.638+0000 7f9914667700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55a04494d000 0x55a0448ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.639+0000 7f9914667700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55a04494d000 0x55a0448ae100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.639+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.639+0000 7f9914667700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55a04494d400 0x55a0448aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.639+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c000 con 0x55a04494d400 2024-04-19T23:45:37.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.639+0000 7f9913e66700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55a04494d400 0x55a0448aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.640+0000 7f9913e66700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55a04494d400 0x55a0448aec00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.640+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.640+0000 7f9913e66700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55a044a0c000 0x55a0448af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.640+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a044a0c000 2024-04-19T23:45:37.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.640+0000 7f9914e68700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55a044a0c000 0x55a0448af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.641+0000 7f9914e68700 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55a044a0c000 0x55a0448af180 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.641+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.641+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a0445c5800 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.641+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.641+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a0445c5800 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.641+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.641+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a044a0c000 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.642+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.642+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a044a0c000 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.642+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.642+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d400 2024-04-19T23:45:37.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.642+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.642+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d000 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.642+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.642+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a0445c5800 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.642+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.642+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a044a0c000 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.643+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.643+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a0445c5800 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.643+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.643+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d400 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.643+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.643+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d000 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.643+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.643+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d000 2024-04-19T23:45:37.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.644+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.644+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a044a0c000 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.644+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.644+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d000 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.644+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.644+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d000 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.645+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.645+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a0445c5800 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.645+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.645+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a0445c5800 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.645+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.645+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a044a0c000 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.645+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.645+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d000 2024-04-19T23:45:37.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.645+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.646+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d400 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.646+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.646+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a0445c5800 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.646+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.646+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a044a0c000 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.646+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.646+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d000 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.646+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.646+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a044a0c000 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.647+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.647+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d400 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.647+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.647+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d000 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.647+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.647+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a044a0c000 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.647+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.647+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a0445c5800 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d400 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0445c5c00 con 0x55a0445c5800 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0cc00 con 0x55a0445c5800 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.648+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0d000 con 0x55a04494d400 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 20 zone default found 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 4 Realm: () 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 20 zonegroup default 2024-04-19T23:45:37.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0d400 con 0x55a044a0c000 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0d800 con 0x55a04494d000 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0dc00 con 0x55a04494d000 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 20 started sync module instance, tier type = 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.649+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0cc00 con 0x55a04494d400 2024-04-19T23:45:37.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.650+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.650+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94146833038080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0445c5c00 con 0x55a04494d400 2024-04-19T23:45:37.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.650+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a04494d800 con 0x55a0445c5800 2024-04-19T23:45:37.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.653+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.653+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94146833039232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a04494dc00 con 0x55a0445c5800 2024-04-19T23:45:37.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.653+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a04494d000 2024-04-19T23:45:37.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.653+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94146833038080] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.656+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.656+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94146833039232] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.656+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94146833040384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0d000 con 0x55a04494d000 2024-04-19T23:45:37.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.656+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0cc00 con 0x55a04494d400 2024-04-19T23:45:37.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.658+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94146833040384] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.658+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.658+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94146833041536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c400 con 0x55a04494d400 2024-04-19T23:45:37.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.658+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0d800 con 0x55a0445c5800 2024-04-19T23:45:37.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.661+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.661+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94146833042688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0dc00 con 0x55a0445c5800 2024-04-19T23:45:37.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.661+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0c800 con 0x55a044a0c000 2024-04-19T23:45:37.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.661+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94146833041536] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.662+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.662+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94146833043840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0d400 con 0x55a044a0c000 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.662+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0d800 con 0x55a044a0c000 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.663+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94146833042688] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.663+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.663+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94146833043840] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.663+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94146833044992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0dc00 con 0x55a044a0c000 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.663+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a04494d800 con 0x55a044a0c000 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.664+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94146833044992] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.665+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.665+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94146833046144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a04494dc00 con 0x55a044a0c000 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.665+0000 7f99166bda80 20 add_watcher() i=0 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.665+0000 7f99166bda80 20 add_watcher() i=1 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.665+0000 7f99166bda80 20 add_watcher() i=2 2024-04-19T23:45:37.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.665+0000 7f99166bda80 20 add_watcher() i=3 2024-04-19T23:45:37.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.665+0000 7f99166bda80 20 add_watcher() i=4 2024-04-19T23:45:37.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.665+0000 7f99166bda80 20 add_watcher() i=5 2024-04-19T23:45:37.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.665+0000 7f99166bda80 20 add_watcher() i=6 2024-04-19T23:45:37.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.667+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94146833046144] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.667+0000 7f99166bda80 20 add_watcher() i=7 2024-04-19T23:45:37.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.667+0000 7f99166bda80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:37.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.667+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a04494d800 con 0x55a0445c5800 2024-04-19T23:45:37.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.667+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.667+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94146834579456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a04494dc00 con 0x55a0445c5800 2024-04-19T23:45:37.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.669+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94146834579456] v30'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.669+0000 7f98fb635700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.669+0000 7f99166bda80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.669+0000 7f99166bda80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.669+0000 7f99166bda80 1 Processor -- start 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.670+0000 7f99166bda80 1 -- start start 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.670+0000 7f99166bda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.670+0000 7f99166bda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044600780 con 0x55a044a0d400 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.670+0000 7f9913e66700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.670+0000 7f9913e66700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34366/0 (socket says 172.21.15.155:34366) 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.670+0000 7f9913e66700 1 -- 172.21.15.155:0/476331847 learned_addr learned my addr 172.21.15.155:0/476331847 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.670+0000 7f9913e66700 1 -- 172.21.15.155:0/476331847 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0445ecb60 con 0x55a044a0d400 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.670+0000 7f9913e66700 1 --2- 172.21.15.155:0/476331847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55a0449a9830 tx=0x55a0449116e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a83725aad856538 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.671+0000 7f98fae34700 1 -- 172.21.15.155:0/476331847 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a04467d760 con 0x55a044a0d400 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.671+0000 7f98fae34700 1 -- 172.21.15.155:0/476331847 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a044a2e000 con 0x55a044a0d400 2024-04-19T23:45:37.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.671+0000 7f98fae34700 1 -- 172.21.15.155:0/476331847 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a044a30000 con 0x55a044a0d400 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.671+0000 7f99166bda80 1 -- 172.21.15.155:0/476331847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 msgr2=0x55a0448ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.671+0000 7f99166bda80 1 --2- 172.21.15.155:0/476331847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55a0449a9830 tx=0x55a0449116e0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.671+0000 7f99166bda80 1 -- 172.21.15.155:0/476331847 shutdown_connections 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.671+0000 7f99166bda80 1 --2- 172.21.15.155:0/476331847 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.671+0000 7f99166bda80 1 -- 172.21.15.155:0/476331847 >> 172.21.15.155:0/476331847 conn(0x55a044a0c800 msgr2=0x55a0446b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.671+0000 7f99166bda80 1 -- 172.21.15.155:0/476331847 shutdown_connections 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.671+0000 7f99166bda80 1 -- 172.21.15.155:0/476331847 wait complete. 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f99166bda80 1 Processor -- start 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f99166bda80 1 -- start start 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f99166bda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f99166bda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a044666000 con 0x55a044a0d400 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f9913e66700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f9913e66700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34370/0 (socket says 172.21.15.155:34370) 2024-04-19T23:45:37.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f9913e66700 1 -- 172.21.15.155:0/4227504002 learned_addr learned my addr 172.21.15.155:0/4227504002 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f9913e66700 1 -- 172.21.15.155:0/4227504002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0445ecd00 con 0x55a044a0d400 2024-04-19T23:45:37.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f9913e66700 1 --2- 172.21.15.155:0/4227504002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55a044a241e0 tx=0x55a044911800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f98f9631700 1 -- 172.21.15.155:0/4227504002 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a044a30160 con 0x55a044a0d400 2024-04-19T23:45:37.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f98f9631700 1 -- 172.21.15.155:0/4227504002 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a044a2e180 con 0x55a044a0d400 2024-04-19T23:45:37.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f99166bda80 1 -- 172.21.15.155:0/4227504002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0445ec340 con 0x55a044a0d400 2024-04-19T23:45:37.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.672+0000 7f98f9631700 1 -- 172.21.15.155:0/4227504002 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a044a302c0 con 0x55a044a0d400 2024-04-19T23:45:37.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.673+0000 7f99166bda80 1 -- 172.21.15.155:0/4227504002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0445edd40 con 0x55a044a0d400 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.673+0000 7f98f9631700 1 -- 172.21.15.155:0/4227504002 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55a045367b80 con 0x55a044a0d400 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.673+0000 7f98f9631700 1 --2- 172.21.15.155:0/4227504002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a044ab0000 0x55a0448af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.673+0000 7f98f9631700 1 -- 172.21.15.155:0/4227504002 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55a04463f500 con 0x55a044a0d400 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.673+0000 7f9914e68700 1 --2- 172.21.15.155:0/4227504002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a044ab0000 0x55a0448af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.673+0000 7f99166bda80 5 note: GC not initialized 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.674+0000 7f9914e68700 1 --2- 172.21.15.155:0/4227504002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a044ab0000 0x55a0448af700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55a0449a9f20 tx=0x55a044910000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.674+0000 7f98f6e2c700 20 reqs_thread_entry: start 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.674+0000 7f99166bda80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.675+0000 7f99166bda80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.675+0000 7f98f4e28700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:08 2024 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.675+0000 7f98f4606700 20 reqs_thread_entry: start 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.675+0000 7f99166bda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.675+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044a0dc00 con 0x55a0445c5800 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.675+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.675+0000 7f99166bda80 20 rados_obj.operate() r=0 bl.length=459 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.678 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:37.679 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:37.680 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:37.681 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:37.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.676+0000 7f98fb635700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.676+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94146834579456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044ab0400 con 0x55a0445c5800 2024-04-19T23:45:37.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.677+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94146834579456] v30'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.677+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94146833038080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044ab0800 con 0x55a04494d400 2024-04-19T23:45:37.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.680+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94146833038080] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.680+0000 7f99166bda80 20 remove_watcher() i=0 2024-04-19T23:45:37.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.680+0000 7f99166bda80 2 removed watcher, disabling cache 2024-04-19T23:45:37.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.680+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94146833039232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044ab0c00 con 0x55a0445c5800 2024-04-19T23:45:37.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.681+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94146833039232] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.681+0000 7f99166bda80 20 remove_watcher() i=1 2024-04-19T23:45:37.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.681+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94146833040384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044ab1000 con 0x55a04494d000 2024-04-19T23:45:37.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.682+0000 7f9914667700 1 -- 172.21.15.155:0/2402761754 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94146833040384] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a05440 con 0x55a04494d000 2024-04-19T23:45:37.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.682+0000 7f99166bda80 20 remove_watcher() i=2 2024-04-19T23:45:37.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.682+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94146833041536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044ab1400 con 0x55a04494d400 2024-04-19T23:45:37.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.683+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94146833041536] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a05680 con 0x55a04494d400 2024-04-19T23:45:37.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.683+0000 7f99166bda80 20 remove_watcher() i=3 2024-04-19T23:45:37.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.683+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94146833042688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044ab1800 con 0x55a0445c5800 2024-04-19T23:45:37.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.684+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94146833042688] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a0445c5800 2024-04-19T23:45:37.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.684+0000 7f99166bda80 20 remove_watcher() i=4 2024-04-19T23:45:37.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.684+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94146833043840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044ab1c00 con 0x55a044a0c000 2024-04-19T23:45:37.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.685+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94146833043840] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.685+0000 7f99166bda80 20 remove_watcher() i=5 2024-04-19T23:45:37.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.685+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94146833044992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044ab0400 con 0x55a044a0c000 2024-04-19T23:45:37.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.687+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94146833044992] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.687+0000 7f99166bda80 20 remove_watcher() i=6 2024-04-19T23:45:37.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.687+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94146833046144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a044ab0c00 con 0x55a044a0c000 2024-04-19T23:45:37.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f9914e68700 1 -- 172.21.15.155:0/2402761754 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94146833046144] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a044a04d80 con 0x55a044a0c000 2024-04-19T23:45:37.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 20 remove_watcher() i=7 2024-04-19T23:45:37.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55a044a0c000 msgr2=0x55a0448af180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55a044a0c000 0x55a0448af180 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55a0445c5800 msgr2=0x55a0448adb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55a0445c5800 0x55a0448adb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55a04494d400 msgr2=0x55a0448aec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55a04494d400 0x55a0448aec00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55a04494d000 msgr2=0x55a0448ae100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55a04494d000 0x55a0448ae100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a04494cc00 msgr2=0x55a0448ad600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a04494cc00 0x55a0448ad600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55a0448a7890 tx=0x55a0446b5800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 msgr2=0x55a0448acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f99166bda80 1 --2- 172.21.15.155:0/2402761754 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c5400 0x55a0448acb00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55a045442240 tx=0x55a044910120 comp rx=0 tx=0).stop 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 reap_dead start 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.688+0000 7f9913e66700 1 -- 172.21.15.155:0/2402761754 reap_dead start 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 shutdown_connections 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 >> 172.21.15.155:0/2402761754 conn(0x55a0445c4c00 msgr2=0x55a0446b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 shutdown_connections 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/2402761754 wait complete. 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/4227504002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a044ab0000 msgr2=0x55a0448af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 --2- 172.21.15.155:0/4227504002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a044ab0000 0x55a0448af700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55a0449a9f20 tx=0x55a044910000 comp rx=0 tx=0).stop 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/4227504002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 msgr2=0x55a0448ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 --2- 172.21.15.155:0/4227504002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55a044a241e0 tx=0x55a044911800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/4227504002 shutdown_connections 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 --2- 172.21.15.155:0/4227504002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a044ab0000 0x55a0448af700 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 --2- 172.21.15.155:0/4227504002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a044a0d400 0x55a0448ae680 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/4227504002 >> 172.21.15.155:0/4227504002 conn(0x55a044a0c800 msgr2=0x55a0446b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/4227504002 shutdown_connections 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/4227504002 wait complete. 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/2109588875 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a04494c000 msgr2=0x55a0448ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 --2- 172.21.15.155:0/2109588875 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a04494c000 0x55a0448ad080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55a045442fc0 tx=0x55a044910240 comp rx=0 tx=0).stop 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/2109588875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 msgr2=0x55a0448ac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 --2- 172.21.15.155:0/2109588875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55a04538ba40 tx=0x55a0446b5a40 comp rx=0 tx=0).stop 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/2109588875 shutdown_connections 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 --2- 172.21.15.155:0/2109588875 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a04494c000 0x55a0448ad080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 --2- 172.21.15.155:0/2109588875 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a0445c4800 0x55a0448ac580 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/2109588875 >> 172.21.15.155:0/2109588875 conn(0x55a0445c4400 msgr2=0x55a0446b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.689+0000 7f99166bda80 1 -- 172.21.15.155:0/2109588875 shutdown_connections 2024-04-19T23:45:37.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.690+0000 7f99166bda80 1 -- 172.21.15.155:0/2109588875 wait complete. 2024-04-19T23:45:37.694 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:37.695 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-19T23:45:37.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-19T23:45:37.695 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-04-19T23:45:37.741 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:37.742 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:37.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.742+0000 7fb079b93a80 1 Processor -- start 2024-04-19T23:45:37.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.742+0000 7fb079b93a80 1 -- start start 2024-04-19T23:45:37.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.743+0000 7fb079b93a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55c85ef7ac00 0x55c85f262580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.743+0000 7fb079b93a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c85f2a5500 con 0x55c85ef7a800 2024-04-19T23:45:37.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.743+0000 7fb079b93a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c85f01ca00 con 0x55c85ef7ac00 2024-04-19T23:45:37.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.743+0000 7fb07733c700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55c85ef7ac00 0x55c85f262580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.743+0000 7fb077b3d700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55c85ef7a800 0x55c85f066800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46574/0 (socket says 172.21.15.155:46574) 2024-04-19T23:45:37.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.743+0000 7fb077b3d700 1 -- 172.21.15.155:0/2794345253 learned_addr learned my addr 172.21.15.155:0/2794345253 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:37.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.743+0000 7fb07733c700 1 -- 172.21.15.155:0/2794345253 >> v1:172.21.15.76:6789/0 conn(0x55c85ef7a800 legacy=0x55c85f066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.743+0000 7fb07733c700 1 -- 172.21.15.155:0/2794345253 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85efa3d40 con 0x55c85ef7ac00 2024-04-19T23:45:37.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.743+0000 7fb076b3b700 1 -- 172.21.15.155:0/2794345253 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261200520 0 0) 0x55c85fd48000 con 0x55c85ef7a800 2024-04-19T23:45:37.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.743+0000 7fb07733c700 1 --2- 172.21.15.155:0/2794345253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7ac00 0x55c85f262580 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55c85f25d890 tx=0x55c85f06b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829fe9061679bf44 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.743+0000 7fb076b3b700 1 -- 172.21.15.155:0/2794345253 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f0334a0 con 0x55c85ef7ac00 2024-04-19T23:45:37.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.744+0000 7fb076b3b700 1 -- 172.21.15.155:0/2794345253 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c85f2a5800 con 0x55c85ef7ac00 2024-04-19T23:45:37.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.744+0000 7fb076b3b700 1 -- 172.21.15.155:0/2794345253 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f033600 con 0x55c85ef7ac00 2024-04-19T23:45:37.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.744+0000 7fb079b93a80 1 -- 172.21.15.155:0/2794345253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7ac00 msgr2=0x55c85f262580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.744+0000 7fb079b93a80 1 --2- 172.21.15.155:0/2794345253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7ac00 0x55c85f262580 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55c85f25d890 tx=0x55c85f06b920 comp rx=0 tx=0).stop 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.744+0000 7fb079b93a80 1 -- 172.21.15.155:0/2794345253 shutdown_connections 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.744+0000 7fb079b93a80 1 --2- 172.21.15.155:0/2794345253 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7ac00 0x55c85f262580 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.744+0000 7fb079b93a80 1 -- 172.21.15.155:0/2794345253 >> 172.21.15.155:0/2794345253 conn(0x55c85ef7a400 msgr2=0x55c85f066000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.744+0000 7fb079b93a80 1 -- 172.21.15.155:0/2794345253 shutdown_connections 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.744+0000 7fb079b93a80 1 -- 172.21.15.155:0/2794345253 wait complete. 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb079b93a80 1 Processor -- start 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb079b93a80 1 -- start start 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb079b93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb079b93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f01c500 con 0x55c85ef7a800 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb077b3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb077b3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34398/0 (socket says 172.21.15.155:34398) 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb077b3d700 1 -- 172.21.15.155:0/3663641460 learned_addr learned my addr 172.21.15.155:0/3663641460 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb077b3d700 1 -- 172.21.15.155:0/3663641460 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85efa3ba0 con 0x55c85ef7a800 2024-04-19T23:45:37.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb077b3d700 1 --2- 172.21.15.155:0/3663641460 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55c85fd4b770 tx=0x55c85f06bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387d24acddf1de40 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb07633a700 1 -- 172.21.15.155:0/3663641460 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f0331e0 con 0x55c85ef7a800 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb07633a700 1 -- 172.21.15.155:0/3663641460 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c85f2a5b00 con 0x55c85ef7a800 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.745+0000 7fb07633a700 1 -- 172.21.15.155:0/3663641460 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f0334a0 con 0x55c85ef7a800 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb079b93a80 1 -- 172.21.15.155:0/3663641460 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 msgr2=0x55c85f262580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb079b93a80 1 --2- 172.21.15.155:0/3663641460 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55c85fd4b770 tx=0x55c85f06bb60 comp rx=0 tx=0).stop 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb079b93a80 1 -- 172.21.15.155:0/3663641460 shutdown_connections 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb079b93a80 1 --2- 172.21.15.155:0/3663641460 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb079b93a80 1 -- 172.21.15.155:0/3663641460 >> 172.21.15.155:0/3663641460 conn(0x55c85ef7a400 msgr2=0x55c85f067000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb079b93a80 1 -- 172.21.15.155:0/3663641460 shutdown_connections 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb079b93a80 1 -- 172.21.15.155:0/3663641460 wait complete. 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb079b93a80 1 Processor -- start 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb079b93a80 1 -- start start 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb079b93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb079b93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f01c3c0 con 0x55c85ef7a800 2024-04-19T23:45:37.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb077b3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb077b3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34412/0 (socket says 172.21.15.155:34412) 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.746+0000 7fb077b3d700 1 -- 172.21.15.155:0/3175534307 learned_addr learned my addr 172.21.15.155:0/3175534307 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.747+0000 7fb077b3d700 1 -- 172.21.15.155:0/3175534307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85efa3a00 con 0x55c85ef7a800 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.747+0000 7fb077b3d700 1 --2- 172.21.15.155:0/3175534307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55c85fd4be30 tx=0x55c85f06ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.747+0000 7fb074b37700 1 -- 172.21.15.155:0/3175534307 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f033600 con 0x55c85ef7a800 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.747+0000 7fb074b37700 1 -- 172.21.15.155:0/3175534307 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c85f01bc80 con 0x55c85ef7a800 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.747+0000 7fb079b93a80 1 -- 172.21.15.155:0/3175534307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c85efa3860 con 0x55c85ef7a800 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.747+0000 7fb074b37700 1 -- 172.21.15.155:0/3175534307 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f0331e0 con 0x55c85ef7a800 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.747+0000 7fb079b93a80 1 -- 172.21.15.155:0/3175534307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c85efa36c0 con 0x55c85ef7a800 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb079b93a80 1 Processor -- start 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb079b93a80 1 -- start start 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb074b37700 1 -- 172.21.15.155:0/3175534307 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c85fd1cb00 con 0x55c85ef7a800 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb079b93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 0x55c85f262b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb079b93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85efb6640 con 0x55c85ef7b400 2024-04-19T23:45:37.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb074b37700 1 --2- 172.21.15.155:0/3175534307 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f306000 0x55c85f263080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb074b37700 1 -- 172.21.15.155:0/3175534307 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55c85eff5180 con 0x55c85ef7a800 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb07833e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 0x55c85f262b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb07833e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 0x55c85f262b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34418/0 (socket says 172.21.15.155:34418) 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb07833e700 1 -- 172.21.15.155:0/3588243131 learned_addr learned my addr 172.21.15.155:0/3588243131 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb077b3d700 1 --2- 172.21.15.155:0/3175534307 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f306000 0x55c85f263080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb07833e700 1 -- 172.21.15.155:0/3588243131 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85efa2000 con 0x55c85ef7b400 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb07833e700 1 --2- 172.21.15.155:0/3588243131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 0x55c85f262b00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55c85fe12e10 tx=0x55c85f2ce060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddbf65710a61734 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb077b3d700 1 --2- 172.21.15.155:0/3175534307 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f306000 0x55c85f263080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55c85fe12f00 tx=0x55c85f2ce240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.748+0000 7fb072332700 1 -- 172.21.15.155:0/3588243131 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f033600 con 0x55c85ef7b400 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb072332700 1 -- 172.21.15.155:0/3588243131 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c85f2a4300 con 0x55c85ef7b400 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb072332700 1 -- 172.21.15.155:0/3588243131 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f0331e0 con 0x55c85ef7b400 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb079b93a80 1 -- 172.21.15.155:0/3588243131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 msgr2=0x55c85f262b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb079b93a80 1 --2- 172.21.15.155:0/3588243131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 0x55c85f262b00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55c85fe12e10 tx=0x55c85f2ce060 comp rx=0 tx=0).stop 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb079b93a80 1 -- 172.21.15.155:0/3588243131 shutdown_connections 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb079b93a80 1 --2- 172.21.15.155:0/3588243131 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 0x55c85f262b00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb079b93a80 1 -- 172.21.15.155:0/3588243131 >> 172.21.15.155:0/3588243131 conn(0x55c85ef7ac00 msgr2=0x55c85f067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb079b93a80 1 -- 172.21.15.155:0/3588243131 shutdown_connections 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb079b93a80 1 -- 172.21.15.155:0/3588243131 wait complete. 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb079b93a80 1 Processor -- start 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb079b93a80 1 -- start start 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb079b93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 0x55c85f262b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.749+0000 7fb079b93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85efb68c0 con 0x55c85ef7b400 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.750+0000 7fb07833e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 0x55c85f262b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.750+0000 7fb07833e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 0x55c85f262b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34424/0 (socket says 172.21.15.155:34424) 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.750+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 learned_addr learned my addr 172.21.15.155:0/1244977645 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.750+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85efa2ea0 con 0x55c85ef7b400 2024-04-19T23:45:37.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.750+0000 7fb07833e700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 0x55c85f262b00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55c85fe12420 tx=0x55c85f2ce120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.750+0000 7fb070b2f700 1 -- 172.21.15.155:0/1244977645 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f033a20 con 0x55c85ef7b400 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.750+0000 7fb070b2f700 1 -- 172.21.15.155:0/1244977645 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c85f01bc80 con 0x55c85ef7b400 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.750+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c85efa2820 con 0x55c85ef7b400 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.750+0000 7fb070b2f700 1 -- 172.21.15.155:0/1244977645 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f033600 con 0x55c85ef7b400 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.750+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c85efa29c0 con 0x55c85ef7b400 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.751+0000 7fb070b2f700 1 -- 172.21.15.155:0/1244977645 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c85fd1cdc0 con 0x55c85ef7b400 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.751+0000 7fb070b2f700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f306c00 0x55c85f263600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.751+0000 7fb070b2f700 1 -- 172.21.15.155:0/1244977645 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55c85eff5340 con 0x55c85ef7b400 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.751+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.751+0000 7fb07733c700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f306c00 0x55c85f263600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.751+0000 7fb079b93a80 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c85ef7b800 0x55c85f263b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.751+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85ef7bc00 con 0x55c85ef7b800 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.751+0000 7fb07833e700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c85ef7b800 0x55c85f263b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb07733c700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f306c00 0x55c85f263600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55c85f25d890 tx=0x55c85f06b800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb07833e700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c85ef7b800 0x55c85f263b80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb079b93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb079b93a80 20 realm 2024-04-19T23:45:37.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f307000 con 0x55c85ef7b800 2024-04-19T23:45:37.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb079b93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb079b93a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:37.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f307400 con 0x55c85ef7b800 2024-04-19T23:45:37.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb079b93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.752+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f307800 con 0x55c85ef7b800 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.753+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.753+0000 7fb079b93a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.753+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.753+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f307c00 con 0x55c85ef7b800 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.753+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.753+0000 7fb079b93a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.753+0000 7fb079b93a80 20 searching for the correct realm 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.753+0000 7fb079b93a80 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c85f307000 0x55c85f264100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.753+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f307400 con 0x55c85f307000 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.753+0000 7fb077b3d700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c85f307000 0x55c85f264100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.753+0000 7fb077b3d700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c85f307000 0x55c85f264100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.754+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.754+0000 7fb077b3d700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c85f307400 0x55c85f264c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.754+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2000 con 0x55c85f307400 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.754+0000 7fb07733c700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c85f307400 0x55c85f264c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.754+0000 7fb07733c700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c85f307400 0x55c85f264c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.754+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.754+0000 7fb07733c700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c85f3c2000 0x55c85f265180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.754+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f3c2000 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.755+0000 7fb07833e700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c85f3c2000 0x55c85f265180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.755+0000 7fb07833e700 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c85f3c2000 0x55c85f265180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.755+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.755+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85ef7b800 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.755+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.755+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85ef7b800 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.756+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.756+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f3c2000 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.756+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.756+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f3c2000 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.756+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.756+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307400 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.756+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.756+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307000 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.757+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.757+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85ef7b800 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.757+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.757+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f3c2000 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.757+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.757+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85ef7b800 2024-04-19T23:45:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.757+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.757+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307400 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.757+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.758+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307000 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.758+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.758+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307000 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.758+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.758+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f3c2000 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.758+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.758+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307000 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.758+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.758+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307000 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.758+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.759+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85ef7b800 2024-04-19T23:45:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.759+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.759+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85ef7b800 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.759+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.759+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f3c2000 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.759+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.759+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307000 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.759+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.759+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307400 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.760+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.760+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85ef7b800 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.760+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.760+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f3c2000 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.760+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.760+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307000 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.760+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.760+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f3c2000 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.761+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.761+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307400 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.761+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.761+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307000 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.761+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.761+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f3c2000 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.761+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.761+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85ef7b800 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307400 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:37.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85ef7bc00 con 0x55c85ef7b800 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2c00 con 0x55c85ef7b800 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c3000 con 0x55c85f307400 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.762+0000 7fb079b93a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:37.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 20 zone default found 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 4 Realm: () 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 20 zonegroup default 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c3400 con 0x55c85f3c2000 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c3800 con 0x55c85f307000 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c3c00 con 0x55c85f307000 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 20 started sync module instance, tier type = 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.763+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2c00 con 0x55c85f307400 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.765+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.765+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94319078120192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85ef7bc00 con 0x55c85f307400 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.765+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f307800 con 0x55c85ef7b800 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.767+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.767+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94319078121344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f307c00 con 0x55c85ef7b800 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.767+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f307000 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.767+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94319078120192] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.768+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.768+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94319078122496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c3000 con 0x55c85f307000 2024-04-19T23:45:37.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.768+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2c00 con 0x55c85f307400 2024-04-19T23:45:37.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.769+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94319078121344] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.769+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94319078122496] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.770+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.770+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94319078123648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2400 con 0x55c85f307400 2024-04-19T23:45:37.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.770+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c3800 con 0x55c85ef7b800 2024-04-19T23:45:37.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.772+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.772+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94319078124800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c3c00 con 0x55c85ef7b800 2024-04-19T23:45:37.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.772+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c2800 con 0x55c85f3c2000 2024-04-19T23:45:37.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.773+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94319078123648] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.775+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94319078124800] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.775+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.775+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94319078125952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c3400 con 0x55c85f3c2000 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.775+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c3800 con 0x55c85f3c2000 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.778+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94319078125952] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.781+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.781+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94319078127104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c3c00 con 0x55c85f3c2000 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.781+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f307800 con 0x55c85f3c2000 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.782+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.782+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94319078128256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f307c00 con 0x55c85f3c2000 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.782+0000 7fb079b93a80 20 add_watcher() i=0 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.782+0000 7fb079b93a80 20 add_watcher() i=1 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.782+0000 7fb079b93a80 20 add_watcher() i=2 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.782+0000 7fb079b93a80 20 add_watcher() i=3 2024-04-19T23:45:37.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.782+0000 7fb079b93a80 20 add_watcher() i=4 2024-04-19T23:45:37.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.782+0000 7fb079b93a80 20 add_watcher() i=5 2024-04-19T23:45:37.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.783+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94319078127104] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.783+0000 7fb079b93a80 20 add_watcher() i=6 2024-04-19T23:45:37.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.784+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94319078128256] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.784+0000 7fb079b93a80 20 add_watcher() i=7 2024-04-19T23:45:37.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.784+0000 7fb079b93a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:37.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.784+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f307800 con 0x55c85ef7b800 2024-04-19T23:45:37.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.784+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.784+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94319079661568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f307c00 con 0x55c85ef7b800 2024-04-19T23:45:37.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.785+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94319079661568] v30'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.785+0000 7fb05eb0b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.785+0000 7fb079b93a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:37.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.785+0000 7fb079b93a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.786+0000 7fb079b93a80 1 Processor -- start 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.786+0000 7fb079b93a80 1 -- start start 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.786+0000 7fb079b93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.786+0000 7fb079b93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f01c3c0 con 0x55c85f3c3400 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.786+0000 7fb07733c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.786+0000 7fb07733c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34440/0 (socket says 172.21.15.155:34440) 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.786+0000 7fb07733c700 1 -- 172.21.15.155:0/4289306932 learned_addr learned my addr 172.21.15.155:0/4289306932 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.786+0000 7fb07733c700 1 -- 172.21.15.155:0/4289306932 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85efa2b60 con 0x55c85f3c3400 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.787+0000 7fb07733c700 1 --2- 172.21.15.155:0/4289306932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55c85f315440 tx=0x55c85f2cf6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16332029143c9f46 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.787+0000 7fb05e30a700 1 -- 172.21.15.155:0/4289306932 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f033760 con 0x55c85f3c3400 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.787+0000 7fb05e30a700 1 -- 172.21.15.155:0/4289306932 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c85f3e4000 con 0x55c85f3c3400 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.787+0000 7fb05e30a700 1 -- 172.21.15.155:0/4289306932 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f3e6000 con 0x55c85f3c3400 2024-04-19T23:45:37.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.787+0000 7fb079b93a80 1 -- 172.21.15.155:0/4289306932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 msgr2=0x55c85f264680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.787+0000 7fb079b93a80 1 --2- 172.21.15.155:0/4289306932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55c85f315440 tx=0x55c85f2cf6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.787+0000 7fb079b93a80 1 -- 172.21.15.155:0/4289306932 shutdown_connections 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.787+0000 7fb079b93a80 1 --2- 172.21.15.155:0/4289306932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.787+0000 7fb079b93a80 1 -- 172.21.15.155:0/4289306932 >> 172.21.15.155:0/4289306932 conn(0x55c85f3c2800 msgr2=0x55c85f068000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.787+0000 7fb079b93a80 1 -- 172.21.15.155:0/4289306932 shutdown_connections 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.787+0000 7fb079b93a80 1 -- 172.21.15.155:0/4289306932 wait complete. 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.788+0000 7fb079b93a80 1 Processor -- start 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.788+0000 7fb079b93a80 1 -- start start 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.788+0000 7fb079b93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.788+0000 7fb079b93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f01c500 con 0x55c85f3c3400 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.788+0000 7fb07733c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.788+0000 7fb07733c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34448/0 (socket says 172.21.15.155:34448) 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.788+0000 7fb07733c700 1 -- 172.21.15.155:0/172729663 learned_addr learned my addr 172.21.15.155:0/172729663 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.788+0000 7fb07733c700 1 -- 172.21.15.155:0/172729663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85efa2d00 con 0x55c85f3c3400 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.789+0000 7fb07733c700 1 --2- 172.21.15.155:0/172729663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55c85f3d7200 tx=0x55c85f2cf800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.789+0000 7fb05cb07700 1 -- 172.21.15.155:0/172729663 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f3e6160 con 0x55c85f3c3400 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.789+0000 7fb05cb07700 1 -- 172.21.15.155:0/172729663 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c85f3e4180 con 0x55c85f3c3400 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.789+0000 7fb079b93a80 1 -- 172.21.15.155:0/172729663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c85efa2340 con 0x55c85f3c3400 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.789+0000 7fb05cb07700 1 -- 172.21.15.155:0/172729663 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c85f3e62c0 con 0x55c85f3c3400 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.789+0000 7fb079b93a80 1 -- 172.21.15.155:0/172729663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c85efa3d40 con 0x55c85f3c3400 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.789+0000 7fb05cb07700 1 -- 172.21.15.155:0/172729663 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c85fd1db80 con 0x55c85f3c3400 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.790+0000 7fb05cb07700 1 --2- 172.21.15.155:0/172729663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f466000 0x55c85f265700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.790+0000 7fb05cb07700 1 -- 172.21.15.155:0/172729663 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55c85eff5500 con 0x55c85f3c3400 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.790+0000 7fb07833e700 1 --2- 172.21.15.155:0/172729663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f466000 0x55c85f265700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.790+0000 7fb079b93a80 5 note: GC not initialized 2024-04-19T23:45:37.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.790+0000 7fb07833e700 1 --2- 172.21.15.155:0/172729663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f466000 0x55c85f265700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55c85f35df50 tx=0x55c85f2ce000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.791+0000 7fb05a302700 20 reqs_thread_entry: start 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.791+0000 7fb079b93a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.791+0000 7fb079b93a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.791+0000 7fb0582fe700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:08 2024 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.791+0000 7fb057adc700 20 reqs_thread_entry: start 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.791+0000 7fb079b93a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.791+0000 7fb079b93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.791+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f3c3c00 con 0x55c85ef7b800 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.792+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.792+0000 7fb079b93a80 20 rados_obj.operate() r=0 bl.length=459 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.792+0000 7fb079b93a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:37.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.792+0000 7fb079b93a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.792+0000 7fb079b93a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.792+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f466800 con 0x55c85ef7b800 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.793+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v30'5 uv5 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.793+0000 7fb079b93a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.793+0000 7fb079b93a80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.793+0000 7fb079b93a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.793+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94319079663872 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f466c00 con 0x55c85ef7b800 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.793+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94319078124800 notify 128849018884 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55c85f361d40 con 0x55c85ef7b800 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.793+0000 7fb072332700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94319078124800 notifier 4365 bl.length()=533 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.793+0000 7fb072332700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.793+0000 7fb072332700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.793+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(64 notify.4 [notify cookie 94319079663872 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.793+0000 7fb072332700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f4dc000 con 0x55c85ef7b800 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.794+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== watch-notify(notify_complete (2) cookie 94319079663872 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c85f42bba0 con 0x55c85ef7b800 2024-04-19T23:45:37.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.794+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.794+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f467000 con 0x55c85f3c2000 2024-04-19T23:45:37.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.795+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.795+0000 7fb079b93a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-19T23:45:37.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.795+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94319079663872 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f467400 con 0x55c85f307000 2024-04-19T23:45:37.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.795+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 94319078122496 notify 128849018881 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55c85f2cdd40 con 0x55c85f307000 2024-04-19T23:45:37.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.795+0000 7fb072332700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94319078122496 notifier 4365 bl.length()=170 2024-04-19T23:45:37.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.795+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(67 notify.2 [notify cookie 94319079663872 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.795+0000 7fb072332700 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f4dc400 con 0x55c85f307000 2024-04-19T23:45:37.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.795+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.795+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== watch-notify(notify_complete (2) cookie 94319079663872 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c85f429a00 con 0x55c85f307000 2024-04-19T23:45:37.799 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:37.800 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:37.801 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.802 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.802 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.802 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.802 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.802 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:37.802 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:37.802 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:37.802 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:37.802 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.796+0000 7fb05eb0b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.796+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94319079661568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f467800 con 0x55c85ef7b800 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.797+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94319079661568] v30'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.797+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94319078120192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f467c00 con 0x55c85f307400 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.798+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94319078120192] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.798+0000 7fb079b93a80 20 remove_watcher() i=0 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.798+0000 7fb079b93a80 2 removed watcher, disabling cache 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.798+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94319078121344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f4dc000 con 0x55c85ef7b800 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.800+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94319078121344] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.800+0000 7fb079b93a80 20 remove_watcher() i=1 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.800+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94319078122496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f4dc800 con 0x55c85f307000 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.801+0000 7fb077b3d700 1 -- 172.21.15.155:0/1244977645 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94319078122496] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3af200 con 0x55c85f307000 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.801+0000 7fb079b93a80 20 remove_watcher() i=2 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.801+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94319078123648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f4dcc00 con 0x55c85f307400 2024-04-19T23:45:37.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.802+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94319078123648] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3af440 con 0x55c85f307400 2024-04-19T23:45:37.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.802+0000 7fb079b93a80 20 remove_watcher() i=3 2024-04-19T23:45:37.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.802+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94319078124800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f4dd000 con 0x55c85ef7b800 2024-04-19T23:45:37.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.803+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94319078124800] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85ef7b800 2024-04-19T23:45:37.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.803+0000 7fb079b93a80 20 remove_watcher() i=4 2024-04-19T23:45:37.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.803+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94319078125952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f4dd400 con 0x55c85f3c2000 2024-04-19T23:45:37.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.804+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94319078125952] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.804+0000 7fb079b93a80 20 remove_watcher() i=5 2024-04-19T23:45:37.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.804+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94319078127104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f4dd800 con 0x55c85f3c2000 2024-04-19T23:45:37.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.807+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94319078127104] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.807+0000 7fb079b93a80 20 remove_watcher() i=6 2024-04-19T23:45:37.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.807+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94319078128256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c85f4ddc00 con 0x55c85f3c2000 2024-04-19T23:45:37.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb07833e700 1 -- 172.21.15.155:0/1244977645 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94319078128256] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c85f3aeb40 con 0x55c85f3c2000 2024-04-19T23:45:37.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 20 remove_watcher() i=7 2024-04-19T23:45:37.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c85f3c2000 msgr2=0x55c85f265180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c85f3c2000 0x55c85f265180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c85ef7b800 msgr2=0x55c85f263b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c85ef7b800 0x55c85f263b80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c85f307400 msgr2=0x55c85f264c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c85f307400 0x55c85f264c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c85f307000 msgr2=0x55c85f264100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c85f307000 0x55c85f264100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f306c00 msgr2=0x55c85f263600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f306c00 0x55c85f263600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55c85f25d890 tx=0x55c85f06b800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 msgr2=0x55c85f262b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 --2- 172.21.15.155:0/1244977645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7b400 0x55c85f262b00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55c85fe12420 tx=0x55c85f2ce120 comp rx=0 tx=0).stop 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 reap_dead start 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb07733c700 1 -- 172.21.15.155:0/1244977645 reap_dead start 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 shutdown_connections 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 >> 172.21.15.155:0/1244977645 conn(0x55c85ef7ac00 msgr2=0x55c85f067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 shutdown_connections 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 -- 172.21.15.155:0/1244977645 wait complete. 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 -- 172.21.15.155:0/172729663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f466000 msgr2=0x55c85f265700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.808+0000 7fb079b93a80 1 --2- 172.21.15.155:0/172729663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f466000 0x55c85f265700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55c85f35df50 tx=0x55c85f2ce000 comp rx=0 tx=0).stop 2024-04-19T23:45:37.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 -- 172.21.15.155:0/172729663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 msgr2=0x55c85f264680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 --2- 172.21.15.155:0/172729663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55c85f3d7200 tx=0x55c85f2cf800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 -- 172.21.15.155:0/172729663 shutdown_connections 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 --2- 172.21.15.155:0/172729663 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f466000 0x55c85f265700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 --2- 172.21.15.155:0/172729663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85f3c3400 0x55c85f264680 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 -- 172.21.15.155:0/172729663 >> 172.21.15.155:0/172729663 conn(0x55c85f3c2800 msgr2=0x55c85f068000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 -- 172.21.15.155:0/172729663 shutdown_connections 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 -- 172.21.15.155:0/172729663 wait complete. 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 -- 172.21.15.155:0/3175534307 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f306000 msgr2=0x55c85f263080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 --2- 172.21.15.155:0/3175534307 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f306000 0x55c85f263080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55c85fe12f00 tx=0x55c85f2ce240 comp rx=0 tx=0).stop 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 -- 172.21.15.155:0/3175534307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 msgr2=0x55c85f262580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 --2- 172.21.15.155:0/3175534307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55c85fd4be30 tx=0x55c85f06ba40 comp rx=0 tx=0).stop 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 -- 172.21.15.155:0/3175534307 shutdown_connections 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 --2- 172.21.15.155:0/3175534307 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c85f306000 0x55c85f263080 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 --2- 172.21.15.155:0/3175534307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c85ef7a800 0x55c85f262580 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 -- 172.21.15.155:0/3175534307 >> 172.21.15.155:0/3175534307 conn(0x55c85ef7a400 msgr2=0x55c85f067000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 -- 172.21.15.155:0/3175534307 shutdown_connections 2024-04-19T23:45:37.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.809+0000 7fb079b93a80 1 -- 172.21.15.155:0/3175534307 wait complete. 2024-04-19T23:45:37.814 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:37.814 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-19T23:45:37.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-19T23:45:37.814 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-04-19T23:45:37.862 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:37.862 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.862+0000 7fc55ec2fa80 1 Processor -- start 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.862+0000 7fc55ec2fa80 1 -- start start 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.862+0000 7fc55ec2fa80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55c6f9000c00 0x55c6f92e8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.862+0000 7fc55ec2fa80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c6f932b500 con 0x55c6f9000800 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.862+0000 7fc55ec2fa80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c6f90a2a00 con 0x55c6f9000c00 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.862+0000 7fc55c3d8700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55c6f9000c00 0x55c6f92e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.862+0000 7fc55cbd9700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55c6f9000800 0x55c6f90ec800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46576/0 (socket says 172.21.15.155:46576) 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.863+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1203779182 learned_addr learned my addr 172.21.15.155:0/1203779182 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.863+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1203779182 >> v1:172.21.15.76:6789/0 conn(0x55c6f9000800 legacy=0x55c6f90ec800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.863+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1203779182 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f9029d40 con 0x55c6f9000c00 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.863+0000 7fc55c3d8700 1 --2- 172.21.15.155:0/1203779182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000c00 0x55c6f92e8580 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55c6f92e3890 tx=0x55c6f90f1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e44660e2025300 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.863+0000 7fc55bbd7700 1 -- 172.21.15.155:0/1203779182 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f90b94a0 con 0x55c6f9000c00 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.863+0000 7fc55bbd7700 1 -- 172.21.15.155:0/1203779182 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6f932b800 con 0x55c6f9000c00 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.863+0000 7fc55bbd7700 1 -- 172.21.15.155:0/1203779182 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f90b9600 con 0x55c6f9000c00 2024-04-19T23:45:37.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.863+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1203779182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000c00 msgr2=0x55c6f92e8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.863+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1203779182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000c00 0x55c6f92e8580 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55c6f92e3890 tx=0x55c6f90f1920 comp rx=0 tx=0).stop 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.864+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1203779182 shutdown_connections 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.864+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1203779182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000c00 0x55c6f92e8580 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.864+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1203779182 >> 172.21.15.155:0/1203779182 conn(0x55c6f9000400 msgr2=0x55c6f90ec000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.864+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1203779182 shutdown_connections 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.864+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1203779182 wait complete. 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.864+0000 7fc55ec2fa80 1 Processor -- start 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.864+0000 7fc55ec2fa80 1 -- start start 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.864+0000 7fc55ec2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.864+0000 7fc55ec2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f90a2500 con 0x55c6f9000800 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.864+0000 7fc55cbd9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.864+0000 7fc55cbd9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34470/0 (socket says 172.21.15.155:34470) 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.865+0000 7fc55cbd9700 1 -- 172.21.15.155:0/334090260 learned_addr learned my addr 172.21.15.155:0/334090260 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.865+0000 7fc55cbd9700 1 -- 172.21.15.155:0/334090260 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f9029ba0 con 0x55c6f9000800 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.865+0000 7fc55cbd9700 1 --2- 172.21.15.155:0/334090260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55c6f9171800 tx=0x55c6f90f1b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605d233683f2bc58 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.865+0000 7fc55b3d6700 1 -- 172.21.15.155:0/334090260 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f90b91e0 con 0x55c6f9000800 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.865+0000 7fc55b3d6700 1 -- 172.21.15.155:0/334090260 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6f932bb00 con 0x55c6f9000800 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.865+0000 7fc55b3d6700 1 -- 172.21.15.155:0/334090260 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f90b94a0 con 0x55c6f9000800 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.865+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/334090260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 msgr2=0x55c6f92e8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.865+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/334090260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55c6f9171800 tx=0x55c6f90f1b60 comp rx=0 tx=0).stop 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.865+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/334090260 shutdown_connections 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.865+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/334090260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.865+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/334090260 >> 172.21.15.155:0/334090260 conn(0x55c6f9000400 msgr2=0x55c6f90ed000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.866+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/334090260 shutdown_connections 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.866+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/334090260 wait complete. 2024-04-19T23:45:37.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.866+0000 7fc55ec2fa80 1 Processor -- start 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.866+0000 7fc55ec2fa80 1 -- start start 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.866+0000 7fc55ec2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.866+0000 7fc55ec2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f90a23c0 con 0x55c6f9000800 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.866+0000 7fc55cbd9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.866+0000 7fc55cbd9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34478/0 (socket says 172.21.15.155:34478) 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.866+0000 7fc55cbd9700 1 -- 172.21.15.155:0/3804258299 learned_addr learned my addr 172.21.15.155:0/3804258299 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.866+0000 7fc55cbd9700 1 -- 172.21.15.155:0/3804258299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f9029a00 con 0x55c6f9000800 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.867+0000 7fc55cbd9700 1 --2- 172.21.15.155:0/3804258299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55c6f9171a10 tx=0x55c6f90f1a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.867+0000 7fc559bd3700 1 -- 172.21.15.155:0/3804258299 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f90b9600 con 0x55c6f9000800 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.867+0000 7fc559bd3700 1 -- 172.21.15.155:0/3804258299 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6f90a1c80 con 0x55c6f9000800 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.867+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3804258299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c6f9029860 con 0x55c6f9000800 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.867+0000 7fc559bd3700 1 -- 172.21.15.155:0/3804258299 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f90b91e0 con 0x55c6f9000800 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.867+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3804258299 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6f90296c0 con 0x55c6f9000800 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.867+0000 7fc55ec2fa80 1 Processor -- start 2024-04-19T23:45:37.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.867+0000 7fc55ec2fa80 1 -- start start 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc559bd3700 1 -- 172.21.15.155:0/3804258299 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c6f9da2b00 con 0x55c6f9000800 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc55ec2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 0x55c6f92e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc55ec2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f903c640 con 0x55c6f9001400 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc55d3da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 0x55c6f92e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc55d3da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 0x55c6f92e8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34494/0 (socket says 172.21.15.155:34494) 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc559bd3700 1 --2- 172.21.15.155:0/3804258299 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f938a000 0x55c6f92e9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc55d3da700 1 -- 172.21.15.155:0/848136252 learned_addr learned my addr 172.21.15.155:0/848136252 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc559bd3700 1 -- 172.21.15.155:0/3804258299 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55c6f907b180 con 0x55c6f9000800 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc55cbd9700 1 --2- 172.21.15.155:0/3804258299 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f938a000 0x55c6f92e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc55d3da700 1 -- 172.21.15.155:0/848136252 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f9028000 con 0x55c6f9001400 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc55d3da700 1 --2- 172.21.15.155:0/848136252 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 0x55c6f92e8b00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55c6f9390060 tx=0x55c6f9346120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c317c8059051366 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc55cbd9700 1 --2- 172.21.15.155:0/3804258299 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f938a000 0x55c6f92e9080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55c6f9e6cf90 tx=0x55c6f9346240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc5573ce700 1 -- 172.21.15.155:0/848136252 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f90b9600 con 0x55c6f9001400 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc5573ce700 1 -- 172.21.15.155:0/848136252 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6f932a300 con 0x55c6f9001400 2024-04-19T23:45:37.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.868+0000 7fc5573ce700 1 -- 172.21.15.155:0/848136252 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f90b91e0 con 0x55c6f9001400 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/848136252 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 msgr2=0x55c6f92e8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/848136252 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 0x55c6f92e8b00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55c6f9390060 tx=0x55c6f9346120 comp rx=0 tx=0).stop 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/848136252 shutdown_connections 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/848136252 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 0x55c6f92e8b00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/848136252 >> 172.21.15.155:0/848136252 conn(0x55c6f9000c00 msgr2=0x55c6f90ed800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/848136252 shutdown_connections 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/848136252 wait complete. 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55ec2fa80 1 Processor -- start 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55ec2fa80 1 -- start start 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55ec2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 0x55c6f92e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55ec2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f903c8c0 con 0x55c6f9001400 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55d3da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 0x55c6f92e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55d3da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 0x55c6f92e8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34510/0 (socket says 172.21.15.155:34510) 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.869+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 learned_addr learned my addr 172.21.15.155:0/1850308219 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.870+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f9028ea0 con 0x55c6f9001400 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.870+0000 7fc55d3da700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 0x55c6f92e8b00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55c6f9e6c240 tx=0x55c6f93468a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.870+0000 7fc555bcb700 1 -- 172.21.15.155:0/1850308219 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f90b9a20 con 0x55c6f9001400 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.870+0000 7fc555bcb700 1 -- 172.21.15.155:0/1850308219 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6f90a1c80 con 0x55c6f9001400 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.870+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c6f9028820 con 0x55c6f9001400 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.870+0000 7fc555bcb700 1 -- 172.21.15.155:0/1850308219 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f90b9600 con 0x55c6f9001400 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.870+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6f90289c0 con 0x55c6f9001400 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.871+0000 7fc555bcb700 1 -- 172.21.15.155:0/1850308219 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c6f9da2dc0 con 0x55c6f9001400 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.871+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.871+0000 7fc555bcb700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f938ac00 0x55c6f92e9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.871+0000 7fc555bcb700 1 -- 172.21.15.155:0/1850308219 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55c6f907b340 con 0x55c6f9001400 2024-04-19T23:45:37.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.871+0000 7fc55c3d8700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f938ac00 0x55c6f92e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.871+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c6f9001800 0x55c6f92e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.871+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f9001c00 con 0x55c6f9001800 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.871+0000 7fc55d3da700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c6f9001800 0x55c6f92e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.871+0000 7fc55c3d8700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f938ac00 0x55c6f92e9600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55c6f92e3890 tx=0x55c6f90f1800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.871+0000 7fc55d3da700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c6f9001800 0x55c6f92e9b80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 20 realm 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938b000 con 0x55c6f9001800 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938b400 con 0x55c6f9001800 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938b800 con 0x55c6f9001800 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.872+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938bc00 con 0x55c6f9001800 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.873+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.873+0000 7fc55ec2fa80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.873+0000 7fc55ec2fa80 20 searching for the correct realm 2024-04-19T23:45:37.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.873+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c6f938b000 0x55c6f92ea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.873+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938b400 con 0x55c6f938b000 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.873+0000 7fc55cbd9700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c6f938b000 0x55c6f92ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.873+0000 7fc55cbd9700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c6f938b000 0x55c6f92ea100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.874+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.874+0000 7fc55cbd9700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c6f938b400 0x55c6f92eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.874+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e000 con 0x55c6f938b400 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.874+0000 7fc55c3d8700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c6f938b400 0x55c6f92eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.874+0000 7fc55c3d8700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c6f938b400 0x55c6f92eac00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.874+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.874+0000 7fc55c3d8700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c6f944e000 0x55c6f92eb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.874+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f944e000 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.874+0000 7fc55d3da700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c6f944e000 0x55c6f92eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.875+0000 7fc55d3da700 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c6f944e000 0x55c6f92eb180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.875+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.875+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f9001800 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.875+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.875+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f9001800 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.875+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.875+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f944e000 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.876+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.876+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f944e000 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.876+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.876+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b400 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.876+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.876+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b000 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.876+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.876+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f9001800 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.877+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.877+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f944e000 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.877+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.877+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f9001800 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.877+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.877+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b400 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.877+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.877+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b000 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.878+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.878+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b000 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.878+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.878+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f944e000 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.878+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.878+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b000 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.878+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.878+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b000 2024-04-19T23:45:37.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.878+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.878+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f9001800 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.879+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.879+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f9001800 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.879+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.879+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f944e000 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.879+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.879+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b000 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.879+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.879+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b400 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.880+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.880+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f9001800 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.880+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.880+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f944e000 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.880+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.880+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b000 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.880+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.880+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f944e000 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.881+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.881+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b400 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.881+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.881+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b000 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.881+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.881+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f944e000 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.881+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.881+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f9001800 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.881+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.881+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b400 2024-04-19T23:45:37.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f9001c00 con 0x55c6f9001800 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944ec00 con 0x55c6f9001800 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944f000 con 0x55c6f938b400 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.882+0000 7fc55ec2fa80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:37.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 20 zone default found 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 4 Realm: () 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 20 zonegroup default 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944f400 con 0x55c6f944e000 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944f800 con 0x55c6f938b000 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944fc00 con 0x55c6f938b000 2024-04-19T23:45:37.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 20 started sync module instance, tier type = 2024-04-19T23:45:37.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:37.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.883+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944ec00 con 0x55c6f938b400 2024-04-19T23:45:37.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.884+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.884+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94313072425728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f9001c00 con 0x55c6f938b400 2024-04-19T23:45:37.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.884+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938b800 con 0x55c6f9001800 2024-04-19T23:45:37.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.887+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.887+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94313072426880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938bc00 con 0x55c6f9001800 2024-04-19T23:45:37.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.887+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f938b000 2024-04-19T23:45:37.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.887+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94313072425728] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.888+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94313072426880] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.888+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.888+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94313072428032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944f000 con 0x55c6f938b000 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.888+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944ec00 con 0x55c6f938b400 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.889+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.889+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94313072429184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e400 con 0x55c6f938b400 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.890+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944f800 con 0x55c6f9001800 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.890+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94313072429184] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.891+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94313072428032] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.894+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.894+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94313072430336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944fc00 con 0x55c6f9001800 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.894+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944e800 con 0x55c6f944e000 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.899+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.899+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94313072431488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944f400 con 0x55c6f944e000 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.899+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944f800 con 0x55c6f944e000 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.899+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94313072430336] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.902+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94313072431488] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.905+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.905+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94313072432640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944fc00 con 0x55c6f944e000 2024-04-19T23:45:37.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.905+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938b800 con 0x55c6f944e000 2024-04-19T23:45:37.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.907+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94313072432640] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.909+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.909+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94313072433792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938bc00 con 0x55c6f944e000 2024-04-19T23:45:37.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.909+0000 7fc55ec2fa80 20 add_watcher() i=0 2024-04-19T23:45:37.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.909+0000 7fc55ec2fa80 20 add_watcher() i=1 2024-04-19T23:45:37.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.909+0000 7fc55ec2fa80 20 add_watcher() i=2 2024-04-19T23:45:37.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.909+0000 7fc55ec2fa80 20 add_watcher() i=3 2024-04-19T23:45:37.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.909+0000 7fc55ec2fa80 20 add_watcher() i=4 2024-04-19T23:45:37.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.909+0000 7fc55ec2fa80 20 add_watcher() i=5 2024-04-19T23:45:37.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.909+0000 7fc55ec2fa80 20 add_watcher() i=6 2024-04-19T23:45:37.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.912+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94313072433792] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.912+0000 7fc55ec2fa80 20 add_watcher() i=7 2024-04-19T23:45:37.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.912+0000 7fc55ec2fa80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:37.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.912+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938b800 con 0x55c6f9001800 2024-04-19T23:45:37.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.913+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.913+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94313073983488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938bc00 con 0x55c6f9001800 2024-04-19T23:45:37.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.914+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94313073983488] v30'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.914+0000 7fc543ba7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.914+0000 7fc55ec2fa80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.914+0000 7fc55ec2fa80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.914+0000 7fc55ec2fa80 1 Processor -- start 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.914+0000 7fc55ec2fa80 1 -- start start 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.914+0000 7fc55ec2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.914+0000 7fc55ec2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f90a23c0 con 0x55c6f944f400 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.914+0000 7fc55c3d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.914+0000 7fc55c3d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34514/0 (socket says 172.21.15.155:34514) 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.914+0000 7fc55c3d8700 1 -- 172.21.15.155:0/3575332143 learned_addr learned my addr 172.21.15.155:0/3575332143 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.915+0000 7fc55c3d8700 1 -- 172.21.15.155:0/3575332143 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f9028b60 con 0x55c6f944f400 2024-04-19T23:45:37.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.915+0000 7fc55c3d8700 1 --2- 172.21.15.155:0/3575332143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55c6f93e5f20 tx=0x55c6f93476e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89cd7915fa9333d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.915+0000 7fc5433a6700 1 -- 172.21.15.155:0/3575332143 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f90b9760 con 0x55c6f944f400 2024-04-19T23:45:37.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.915+0000 7fc5433a6700 1 -- 172.21.15.155:0/3575332143 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6f9472000 con 0x55c6f944f400 2024-04-19T23:45:37.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.915+0000 7fc5433a6700 1 -- 172.21.15.155:0/3575332143 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f9474000 con 0x55c6f944f400 2024-04-19T23:45:37.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3575332143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 msgr2=0x55c6f92ea680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/3575332143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55c6f93e5f20 tx=0x55c6f93476e0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3575332143 shutdown_connections 2024-04-19T23:45:37.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/3575332143 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3575332143 >> 172.21.15.155:0/3575332143 conn(0x55c6f944e800 msgr2=0x55c6f90ee000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3575332143 shutdown_connections 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3575332143 wait complete. 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55ec2fa80 1 Processor -- start 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55ec2fa80 1 -- start start 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55ec2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55ec2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f90a2500 con 0x55c6f944f400 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55c3d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55c3d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34524/0 (socket says 172.21.15.155:34524) 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.916+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1141803705 learned_addr learned my addr 172.21.15.155:0/1141803705 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.917+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1141803705 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f9028d00 con 0x55c6f944f400 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.917+0000 7fc55c3d8700 1 --2- 172.21.15.155:0/1141803705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55c6f94701e0 tx=0x55c6f9347800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.917+0000 7fc541ba3700 1 -- 172.21.15.155:0/1141803705 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f9474160 con 0x55c6f944f400 2024-04-19T23:45:37.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.917+0000 7fc541ba3700 1 -- 172.21.15.155:0/1141803705 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6f9472180 con 0x55c6f944f400 2024-04-19T23:45:37.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.917+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1141803705 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c6f9028340 con 0x55c6f944f400 2024-04-19T23:45:37.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.917+0000 7fc541ba3700 1 -- 172.21.15.155:0/1141803705 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c6f94742c0 con 0x55c6f944f400 2024-04-19T23:45:37.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.917+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1141803705 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6f9029d40 con 0x55c6f944f400 2024-04-19T23:45:37.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.918+0000 7fc541ba3700 1 -- 172.21.15.155:0/1141803705 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c6f9da3b80 con 0x55c6f944f400 2024-04-19T23:45:37.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.918+0000 7fc541ba3700 1 --2- 172.21.15.155:0/1141803705 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f94ea000 0x55c6f92eb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.918+0000 7fc541ba3700 1 -- 172.21.15.155:0/1141803705 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55c6f907b500 con 0x55c6f944f400 2024-04-19T23:45:37.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.918+0000 7fc55ec2fa80 5 note: GC not initialized 2024-04-19T23:45:37.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.918+0000 7fc55d3da700 1 --2- 172.21.15.155:0/1141803705 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f94ea000 0x55c6f92eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.918+0000 7fc55d3da700 1 --2- 172.21.15.155:0/1141803705 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f94ea000 0x55c6f92eb700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55c6f93e5bf0 tx=0x55c6f93460c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.919+0000 7fc53f39e700 20 reqs_thread_entry: start 2024-04-19T23:45:37.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.919+0000 7fc55ec2fa80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:37.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.919+0000 7fc55ec2fa80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:37.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.919+0000 7fc53d39a700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:08 2024 2024-04-19T23:45:37.924 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.919+0000 7fc53cb78700 20 reqs_thread_entry: start 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.919+0000 7fc55ec2fa80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.919+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.919+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944fc00 con 0x55c6f9001800 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f94ea400 con 0x55c6f9001800 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.920+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f94eac00 con 0x55c6f9001800 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.921+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~513] v30'6 uv6 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.921+0000 7fc55ec2fa80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.921+0000 7fc55ec2fa80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.921+0000 7fc55ec2fa80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.921+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94313073985792 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f94eb000 con 0x55c6f9001800 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.921+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== watch-notify(notify (1) cookie 94313072430336 notify 128849018885 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x55c6f93e3d40 con 0x55c6f9001800 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.921+0000 7fc5573ce700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94313072430336 notifier 4373 bl.length()=689 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.921+0000 7fc5573ce700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.921+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(65 notify.4 [notify cookie 94313073985792 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.921+0000 7fc5573ce700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.921+0000 7fc5573ce700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938b800 con 0x55c6f9001800 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.922+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.922+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== watch-notify(notify_complete (2) cookie 94313073985792 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c6f94b1ba0 con 0x55c6f9001800 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.922+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f94eb400 con 0x55c6f9001800 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc55ec2fa80 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc55ec2fa80 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc55ec2fa80 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94313073985792 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f94eb800 con 0x55c6f938b400 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== watch-notify(notify (1) cookie 94313072425728 notify 128849018882 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x55c6f94afa00 con 0x55c6f938b400 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc5573ce700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94313072425728 notifier 4373 bl.length()=166 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc5573ce700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc5573ce700 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-19T23:45:37.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(68 notify.0 [notify cookie 94313073985792 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc5573ce700 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938bc00 con 0x55c6f938b400 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== watch-notify(notify_complete (2) cookie 94313073985792 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c6f94ad040 con 0x55c6f938b400 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.924+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [ 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.928 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "foo:foo1", 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: "permissions": "full-control" 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [ 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo:foo1", 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "JQ5vG0eMWnJ2BOtFHYnyPj61MuwKIkL5ySQ9y3bo" 2024-04-19T23:45:37.929 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:37.930 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:37.931 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:37.931 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:37.931 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:37.931 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:37.931 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:37.931 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:37.931 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:37.931 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:37.931 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:37.931 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:37.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.925+0000 7fc543ba7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:37.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.925+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94313073983488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f94ebc00 con 0x55c6f9001800 2024-04-19T23:45:37.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.926+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94313073983488] v30'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.926+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94313072425728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f94eb800 con 0x55c6f938b400 2024-04-19T23:45:37.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.927+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94313072425728] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.927+0000 7fc55ec2fa80 20 remove_watcher() i=0 2024-04-19T23:45:37.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.927+0000 7fc55ec2fa80 2 removed watcher, disabling cache 2024-04-19T23:45:37.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.927+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94313072426880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f94ea400 con 0x55c6f9001800 2024-04-19T23:45:37.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.929+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94313072426880] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.929+0000 7fc55ec2fa80 20 remove_watcher() i=1 2024-04-19T23:45:37.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.929+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94313072428032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f94eac00 con 0x55c6f938b000 2024-04-19T23:45:37.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.931+0000 7fc55cbd9700 1 -- 172.21.15.155:0/1850308219 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94313072428032] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9429200 con 0x55c6f938b000 2024-04-19T23:45:37.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.931+0000 7fc55ec2fa80 20 remove_watcher() i=2 2024-04-19T23:45:37.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.931+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94313072429184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f94ea800 con 0x55c6f938b400 2024-04-19T23:45:37.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.932+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94313072429184] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9429440 con 0x55c6f938b400 2024-04-19T23:45:37.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.932+0000 7fc55ec2fa80 20 remove_watcher() i=3 2024-04-19T23:45:37.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.932+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94313072430336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f94eb000 con 0x55c6f9001800 2024-04-19T23:45:37.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.935+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94313072430336] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f9001800 2024-04-19T23:45:37.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.935+0000 7fc55ec2fa80 20 remove_watcher() i=4 2024-04-19T23:45:37.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.935+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94313072431488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944ec00 con 0x55c6f944e000 2024-04-19T23:45:37.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.936+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94313072431488] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.936+0000 7fc55ec2fa80 20 remove_watcher() i=5 2024-04-19T23:45:37.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.936+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94313072432640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f944fc00 con 0x55c6f944e000 2024-04-19T23:45:37.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.939+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94313072432640] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.939+0000 7fc55ec2fa80 20 remove_watcher() i=6 2024-04-19T23:45:37.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.939+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94313072433792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f938bc00 con 0x55c6f944e000 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55d3da700 1 -- 172.21.15.155:0/1850308219 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94313072433792] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c6f9428b40 con 0x55c6f944e000 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 20 remove_watcher() i=7 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c6f944e000 msgr2=0x55c6f92eb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c6f944e000 0x55c6f92eb180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c6f9001800 msgr2=0x55c6f92e9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c6f9001800 0x55c6f92e9b80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c6f938b400 msgr2=0x55c6f92eac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c6f938b400 0x55c6f92eac00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c6f938b000 msgr2=0x55c6f92ea100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c6f938b000 0x55c6f92ea100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f938ac00 msgr2=0x55c6f92e9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f938ac00 0x55c6f92e9600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55c6f92e3890 tx=0x55c6f90f1800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 msgr2=0x55c6f92e8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1850308219 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9001400 0x55c6f92e8b00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55c6f9e6c240 tx=0x55c6f93468a0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 reap_dead start 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55c3d8700 1 -- 172.21.15.155:0/1850308219 reap_dead start 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 shutdown_connections 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 >> 172.21.15.155:0/1850308219 conn(0x55c6f9000c00 msgr2=0x55c6f90ed800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 shutdown_connections 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1850308219 wait complete. 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1141803705 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f94ea000 msgr2=0x55c6f92eb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1141803705 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f94ea000 0x55c6f92eb700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55c6f93e5bf0 tx=0x55c6f93460c0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1141803705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 msgr2=0x55c6f92ea680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1141803705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55c6f94701e0 tx=0x55c6f9347800 comp rx=0 tx=0).stop 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1141803705 shutdown_connections 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1141803705 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f94ea000 0x55c6f92eb700 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/1141803705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f944f400 0x55c6f92ea680 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.942+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1141803705 >> 172.21.15.155:0/1141803705 conn(0x55c6f944e800 msgr2=0x55c6f90ee000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1141803705 shutdown_connections 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/1141803705 wait complete. 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3804258299 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f938a000 msgr2=0x55c6f92e9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/3804258299 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f938a000 0x55c6f92e9080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55c6f9e6cf90 tx=0x55c6f9346240 comp rx=0 tx=0).stop 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3804258299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 msgr2=0x55c6f92e8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/3804258299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55c6f9171a10 tx=0x55c6f90f1a40 comp rx=0 tx=0).stop 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3804258299 shutdown_connections 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/3804258299 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c6f938a000 0x55c6f92e9080 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 --2- 172.21.15.155:0/3804258299 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c6f9000800 0x55c6f92e8580 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3804258299 >> 172.21.15.155:0/3804258299 conn(0x55c6f9000400 msgr2=0x55c6f90ed000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3804258299 shutdown_connections 2024-04-19T23:45:37.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.943+0000 7fc55ec2fa80 1 -- 172.21.15.155:0/3804258299 wait complete. 2024-04-19T23:45:37.947 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'JQ5vG0eMWnJ2BOtFHYnyPj61MuwKIkL5ySQ9y3bo'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:37.947 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-19T23:45:37.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-19T23:45:37.948 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-04-19T23:45:37.996 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:37.996 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.997+0000 7f0d82a2fa80 1 Processor -- start 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.997+0000 7f0d82a2fa80 1 -- start start 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.997+0000 7f0d82a2fa80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x560294e78800 0x560295160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.997+0000 7f0d82a2fa80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5602951a3500 con 0x560294e78c00 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.997+0000 7f0d82a2fa80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x560294f1aa00 con 0x560294e78800 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.997+0000 7f0d809d9700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x560294e78800 0x560295160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.997+0000 7f0d809d9700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x560294e78800 0x560295160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34532/0 (socket says 172.21.15.155:34532) 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.997+0000 7f0d809d9700 1 -- 172.21.15.155:0/863034108 learned_addr learned my addr 172.21.15.155:0/863034108 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.997+0000 7f0d801d8700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x560294e78c00 0x560294f64800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46586/0 (socket says 172.21.15.155:46586) 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.997+0000 7f0d809d9700 1 -- 172.21.15.155:0/863034108 >> v1:172.21.15.76:6789/0 conn(0x560294e78c00 legacy=0x560294f64800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d809d9700 1 -- 172.21.15.155:0/863034108 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560294ea1d40 con 0x560294e78800 2024-04-19T23:45:37.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d809d9700 1 --2- 172.21.15.155:0/863034108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x56029515b9e0 tx=0x560294f69920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382e729d0214354f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:37.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d7f9d7700 1 -- 172.21.15.155:0/863034108 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560294f314a0 con 0x560294e78800 2024-04-19T23:45:37.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d7f9d7700 1 -- 172.21.15.155:0/863034108 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5602951a3800 con 0x560294e78800 2024-04-19T23:45:37.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d7f9d7700 1 -- 172.21.15.155:0/863034108 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560294f31600 con 0x560294e78800 2024-04-19T23:45:38.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/863034108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 msgr2=0x560295160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/863034108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x56029515b9e0 tx=0x560294f69920 comp rx=0 tx=0).stop 2024-04-19T23:45:38.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/863034108 shutdown_connections 2024-04-19T23:45:38.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/863034108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/863034108 >> 172.21.15.155:0/863034108 conn(0x560294e78400 msgr2=0x560294f64000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/863034108 shutdown_connections 2024-04-19T23:45:38.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.998+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/863034108 wait complete. 2024-04-19T23:45:38.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.999+0000 7f0d82a2fa80 1 Processor -- start 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.999+0000 7f0d82a2fa80 1 -- start start 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.999+0000 7f0d82a2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.999+0000 7f0d82a2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560294f1a500 con 0x560294e78800 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.999+0000 7f0d809d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.999+0000 7f0d809d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34546/0 (socket says 172.21.15.155:34546) 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:37.999+0000 7f0d809d9700 1 -- 172.21.15.155:0/3044646304 learned_addr learned my addr 172.21.15.155:0/3044646304 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d809d9700 1 -- 172.21.15.155:0/3044646304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560294ea1ba0 con 0x560294e78800 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d809d9700 1 --2- 172.21.15.155:0/3044646304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x560295c3e1b0 tx=0x560294f69800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e542b56568e38c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d7f1d6700 1 -- 172.21.15.155:0/3044646304 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560294f31760 con 0x560294e78800 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d7f1d6700 1 -- 172.21.15.155:0/3044646304 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5602951a3b00 con 0x560294e78800 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d7f1d6700 1 -- 172.21.15.155:0/3044646304 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560294f314a0 con 0x560294e78800 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/3044646304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 msgr2=0x560295160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/3044646304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x560295c3e1b0 tx=0x560294f69800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/3044646304 shutdown_connections 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/3044646304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/3044646304 >> 172.21.15.155:0/3044646304 conn(0x560294e78400 msgr2=0x560294f65000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/3044646304 shutdown_connections 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.000+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/3044646304 wait complete. 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.001+0000 7f0d82a2fa80 1 Processor -- start 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.001+0000 7f0d82a2fa80 1 -- start start 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.001+0000 7f0d82a2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.001+0000 7f0d82a2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560294f1a3c0 con 0x560294e78800 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.001+0000 7f0d809d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.001+0000 7f0d809d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34550/0 (socket says 172.21.15.155:34550) 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.001+0000 7f0d809d9700 1 -- 172.21.15.155:0/460849624 learned_addr learned my addr 172.21.15.155:0/460849624 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.001+0000 7f0d809d9700 1 -- 172.21.15.155:0/460849624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560294ea1a00 con 0x560294e78800 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.002+0000 7f0d809d9700 1 --2- 172.21.15.155:0/460849624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x560295c3ff80 tx=0x560294f69920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.002+0000 7f0d7d9d3700 1 -- 172.21.15.155:0/460849624 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560294f31600 con 0x560294e78800 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.002+0000 7f0d7d9d3700 1 -- 172.21.15.155:0/460849624 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5602951a3c80 con 0x560294e78800 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.002+0000 7f0d7d9d3700 1 -- 172.21.15.155:0/460849624 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560294f318c0 con 0x560294e78800 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.002+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/460849624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560294ea1860 con 0x560294e78800 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.002+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/460849624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560294ea16c0 con 0x560294e78800 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.002+0000 7f0d82a2fa80 1 Processor -- start 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.002+0000 7f0d7d9d3700 1 -- 172.21.15.155:0/460849624 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x560295c1ab00 con 0x560294e78800 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.002+0000 7f0d82a2fa80 1 -- start start 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d7d9d3700 1 --2- 172.21.15.155:0/460849624 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560294e79400 0x560295161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d82a2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 0x560295160b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d82a2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560294eb4640 con 0x560294e79800 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d7d9d3700 1 -- 172.21.15.155:0/460849624 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x560294ef3180 con 0x560294e78800 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d811da700 1 --2- 172.21.15.155:0/460849624 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560294e79400 0x560295161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d809d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 0x560295160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d809d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 0x560295160b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34566/0 (socket says 172.21.15.155:34566) 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d809d9700 1 -- 172.21.15.155:0/1820965874 learned_addr learned my addr 172.21.15.155:0/1820965874 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d809d9700 1 -- 172.21.15.155:0/1820965874 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560294ea0000 con 0x560294e79800 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d811da700 1 --2- 172.21.15.155:0/460849624 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560294e79400 0x560295161080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x560295c3f710 tx=0x5602951bc720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d809d9700 1 --2- 172.21.15.155:0/1820965874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 0x560295160b00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x560295d04fc0 tx=0x5602951bc540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f917e531bb34a819 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d7b1ce700 1 -- 172.21.15.155:0/1820965874 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560294f31600 con 0x560294e79800 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d7b1ce700 1 -- 172.21.15.155:0/1820965874 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5602951a3c80 con 0x560294e79800 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.003+0000 7f0d7b1ce700 1 -- 172.21.15.155:0/1820965874 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560294f318c0 con 0x560294e79800 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1820965874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 msgr2=0x560295160b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/1820965874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 0x560295160b00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x560295d04fc0 tx=0x5602951bc540 comp rx=0 tx=0).stop 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1820965874 shutdown_connections 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/1820965874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 0x560295160b00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1820965874 >> 172.21.15.155:0/1820965874 conn(0x560294e78c00 msgr2=0x560294f65800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1820965874 shutdown_connections 2024-04-19T23:45:38.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1820965874 wait complete. 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d82a2fa80 1 Processor -- start 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d82a2fa80 1 -- start start 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d82a2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 0x560295160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d82a2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560294eb48c0 con 0x560294e79800 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d809d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 0x560295160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d809d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 0x560295160b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34574/0 (socket says 172.21.15.155:34574) 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 learned_addr learned my addr 172.21.15.155:0/1279579091 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.004+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560294ea0ea0 con 0x560294e79800 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.005+0000 7f0d809d9700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 0x560295160b00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x560295d04810 tx=0x5602951bc600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.005+0000 7f0d799cb700 1 -- 172.21.15.155:0/1279579091 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560294f31760 con 0x560294e79800 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.005+0000 7f0d799cb700 1 -- 172.21.15.155:0/1279579091 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560294f19e00 con 0x560294e79800 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.005+0000 7f0d799cb700 1 -- 172.21.15.155:0/1279579091 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560294f314a0 con 0x560294e79800 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.005+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560294ea0820 con 0x560294e79800 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.005+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560294ea09c0 con 0x560294e79800 2024-04-19T23:45:38.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.006+0000 7f0d799cb700 1 -- 172.21.15.155:0/1279579091 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x560295c1adc0 con 0x560294e79800 2024-04-19T23:45:38.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.006+0000 7f0d799cb700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560295216c00 0x560295161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.006+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.006+0000 7f0d799cb700 1 -- 172.21.15.155:0/1279579091 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x560294ef3340 con 0x560294e79800 2024-04-19T23:45:38.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.006+0000 7f0d801d8700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560295216c00 0x560295161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.006+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x560294e79c00 0x560295161b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.006+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295217000 con 0x560294e79c00 2024-04-19T23:45:38.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.006+0000 7f0d811da700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x560294e79c00 0x560295161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.006+0000 7f0d801d8700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560295216c00 0x560295161600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x56029515bf80 tx=0x5602951bc6c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.006+0000 7f0d811da700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x560294e79c00 0x560295161b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 20 realm 2024-04-19T23:45:38.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295217400 con 0x560294e79c00 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295217800 con 0x560294e79c00 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295217c00 con 0x560294e79c00 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.007+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295217000 con 0x560294e79c00 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.008+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.008+0000 7f0d82a2fa80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.008+0000 7f0d82a2fa80 20 searching for the correct realm 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.008+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x560295217400 0x560295162100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.008+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295217800 con 0x560295217400 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.008+0000 7f0d809d9700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x560295217400 0x560295162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.008+0000 7f0d809d9700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x560295217400 0x560295162100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.009+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.009+0000 7f0d809d9700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x560295217800 0x560295162c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.009+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295216400 con 0x560295217800 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.009+0000 7f0d801d8700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x560295217800 0x560295162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.009+0000 7f0d801d8700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x560295217800 0x560295162c00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.009+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.009+0000 7f0d801d8700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x560295216400 0x560295163180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.009+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295216400 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.009+0000 7f0d811da700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x560295216400 0x560295163180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.010+0000 7f0d811da700 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x560295216400 0x560295163180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.010+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.010+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560294e79c00 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.010+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.010+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560294e79c00 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.010+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.010+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295216400 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.011+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.011+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295216400 2024-04-19T23:45:38.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.011+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.011+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217800 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.011+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.011+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217400 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.011+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.011+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560294e79c00 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.011+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.011+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295216400 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.012+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.012+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560294e79c00 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.012+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.012+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217800 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.012+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.012+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217400 2024-04-19T23:45:38.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.013+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.013+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217400 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.013+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.013+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295216400 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.013+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.013+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217400 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.013+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.013+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217400 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.013+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.013+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560294e79c00 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.014+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.014+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560294e79c00 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.014+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.014+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295216400 2024-04-19T23:45:38.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.014+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.014+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217400 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.014+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.014+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217800 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.015+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.015+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560294e79c00 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.015+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.015+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295216400 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.015+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.015+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217400 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.015+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.015+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295216400 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.016+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.016+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217800 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.016+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.016+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217400 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.016+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.016+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295216400 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560294e79c00 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217800 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d82a2fa80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d82a2fa80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d82a2fa80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:38.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d82a2fa80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295217c00 con 0x560294e79c00 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d82a2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295217000 con 0x560294e79c00 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d82a2fa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.017+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a400 con 0x560295217800 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:38.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 20 zone default found 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 4 Realm: () 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 20 zonegroup default 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a800 con 0x560295216400 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1ac00 con 0x560295217400 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.018+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1b000 con 0x560295217400 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.019+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.019+0000 7f0d82a2fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.019+0000 7f0d82a2fa80 20 started sync module instance, tier type = 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.019+0000 7f0d82a2fa80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.019+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1b400 con 0x560295217800 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.020+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.020+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94569091136256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1b800 con 0x560295217800 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.020+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1bc00 con 0x560294e79c00 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.021+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94569091136256] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.021+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.021+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94569091137408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a800 con 0x560294e79c00 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.021+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1bc00 con 0x560295217400 2024-04-19T23:45:38.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.023+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.023+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94569091137408] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.023+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94569091138560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295217400 2024-04-19T23:45:38.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.023+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a400 con 0x560295217800 2024-04-19T23:45:38.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.024+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.024+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94569091139712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1b400 con 0x560295217800 2024-04-19T23:45:38.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.024+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295217c00 con 0x560294e79c00 2024-04-19T23:45:38.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.025+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94569091139712] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.026+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94569091138560] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.027+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.027+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94569091140864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295217000 con 0x560294e79c00 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.027+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1ac00 con 0x560295216400 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.028+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.028+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94569091142016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1b000 con 0x560295216400 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.028+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1bc00 con 0x560295216400 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.029+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94569091140864] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.031+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94569091142016] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.034+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.034+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94569091143168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560295216400 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.034+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a800 con 0x560295216400 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.037+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.037+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94569091143168] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.037+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94569091144320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1ac00 con 0x560295216400 2024-04-19T23:45:38.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.037+0000 7f0d82a2fa80 20 add_watcher() i=0 2024-04-19T23:45:38.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.037+0000 7f0d82a2fa80 20 add_watcher() i=1 2024-04-19T23:45:38.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.037+0000 7f0d82a2fa80 20 add_watcher() i=2 2024-04-19T23:45:38.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.037+0000 7f0d82a2fa80 20 add_watcher() i=3 2024-04-19T23:45:38.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.037+0000 7f0d82a2fa80 20 add_watcher() i=4 2024-04-19T23:45:38.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.037+0000 7f0d82a2fa80 20 add_watcher() i=5 2024-04-19T23:45:38.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.037+0000 7f0d82a2fa80 20 add_watcher() i=6 2024-04-19T23:45:38.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.040+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94569091144320] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.040+0000 7f0d82a2fa80 20 add_watcher() i=7 2024-04-19T23:45:38.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.040+0000 7f0d82a2fa80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:38.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.040+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1b000 con 0x560294e79c00 2024-04-19T23:45:38.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.040+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.040+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94569092497408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295217c00 con 0x560294e79c00 2024-04-19T23:45:38.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.041+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94569092497408] v30'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.041+0000 7f0d679a7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.041+0000 7f0d82a2fa80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:38.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.041+0000 7f0d82a2fa80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:38.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.041+0000 7f0d82a2fa80 1 Processor -- start 2024-04-19T23:45:38.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.041+0000 7f0d82a2fa80 1 -- start start 2024-04-19T23:45:38.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.041+0000 7f0d82a2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.041+0000 7f0d82a2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560294f1a3c0 con 0x560295217c00 2024-04-19T23:45:38.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.042+0000 7f0d801d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.042+0000 7f0d801d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34586/0 (socket says 172.21.15.155:34586) 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.042+0000 7f0d801d8700 1 -- 172.21.15.155:0/637609831 learned_addr learned my addr 172.21.15.155:0/637609831 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.042+0000 7f0d801d8700 1 -- 172.21.15.155:0/637609831 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560294ea0b60 con 0x560295217c00 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.042+0000 7f0d801d8700 1 --2- 172.21.15.155:0/637609831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56029523be00 tx=0x5602951bd500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b0caa29acd1c0b server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.042+0000 7f0d671a6700 1 -- 172.21.15.155:0/637609831 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5602952a2160 con 0x560295217c00 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.042+0000 7f0d671a6700 1 -- 172.21.15.155:0/637609831 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5602952c0000 con 0x560295217c00 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.042+0000 7f0d671a6700 1 -- 172.21.15.155:0/637609831 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5602952a22c0 con 0x560295217c00 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.043+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/637609831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 msgr2=0x560295162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.043+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/637609831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56029523be00 tx=0x5602951bd500 comp rx=0 tx=0).stop 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.043+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/637609831 shutdown_connections 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.043+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/637609831 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.043+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/637609831 >> 172.21.15.155:0/637609831 conn(0x560295217000 msgr2=0x560294f66000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.043+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/637609831 shutdown_connections 2024-04-19T23:45:38.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.043+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/637609831 wait complete. 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.043+0000 7f0d82a2fa80 1 Processor -- start 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d82a2fa80 1 -- start start 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d82a2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d82a2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560294f1a500 con 0x560295217c00 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d801d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d801d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34600/0 (socket says 172.21.15.155:34600) 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d801d8700 1 -- 172.21.15.155:0/2071476687 learned_addr learned my addr 172.21.15.155:0/2071476687 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d801d8700 1 -- 172.21.15.155:0/2071476687 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560294ea0d00 con 0x560295217c00 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d801d8700 1 --2- 172.21.15.155:0/2071476687 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5602952bec30 tx=0x5602951bd620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d659a3700 1 -- 172.21.15.155:0/2071476687 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5602952a2420 con 0x560295217c00 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d659a3700 1 -- 172.21.15.155:0/2071476687 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5602952c0180 con 0x560295217c00 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d659a3700 1 -- 172.21.15.155:0/2071476687 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5602952a2160 con 0x560295217c00 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.044+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/2071476687 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560294ea0340 con 0x560295217c00 2024-04-19T23:45:38.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.045+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/2071476687 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560294ea0b60 con 0x560295217c00 2024-04-19T23:45:38.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.045+0000 7f0d659a3700 1 -- 172.21.15.155:0/2071476687 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x560295c1bb80 con 0x560295217c00 2024-04-19T23:45:38.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.045+0000 7f0d659a3700 1 --2- 172.21.15.155:0/2071476687 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560295344000 0x560295163700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.045+0000 7f0d659a3700 1 -- 172.21.15.155:0/2071476687 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x560294ef36c0 con 0x560295217c00 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.045+0000 7f0d811da700 1 --2- 172.21.15.155:0/2071476687 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560295344000 0x560295163700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.045+0000 7f0d82a2fa80 5 note: GC not initialized 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.046+0000 7f0d811da700 1 --2- 172.21.15.155:0/2071476687 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560295344000 0x560295163700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x5602952bf7d0 tx=0x5602951bd380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.046+0000 7f0d6319e700 20 reqs_thread_entry: start 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.046+0000 7f0d82a2fa80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.046+0000 7f0d82a2fa80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.047+0000 7f0d6119a700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:08 2024 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.047+0000 7f0d60978700 20 reqs_thread_entry: start 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.047+0000 7f0d82a2fa80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.047+0000 7f0d82a2fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.047+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1a000 con 0x560294e79c00 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.047+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.047+0000 7f0d82a2fa80 20 rados_obj.operate() r=0 bl.length=513 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.047+0000 7f0d82a2fa80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.047+0000 7f0d82a2fa80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.047+0000 7f0d82a2fa80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.047+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1ac00 con 0x560294e79c00 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v30'7 uv7 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d82a2fa80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d82a2fa80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d82a2fa80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94569092499712 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295d1b000 con 0x560294e79c00 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94569091140864 notify 128849018886 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x5602953b0000 con 0x560294e79c00 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d7b1ce700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94569091140864 notifier 4381 bl.length()=689 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d7b1ce700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d7b1ce700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d7b1ce700 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295344400 con 0x560294e79c00 2024-04-19T23:45:38.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(64 notify.4 [notify cookie 94569092499712 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.049+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.050+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 94569092499712 notify 128849018886 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5602953b01a0 con 0x560294e79c00 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [ 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "foo:foo1", 2024-04-19T23:45:38.052 INFO:teuthology.orchestra.run.smithi155.stdout: "permissions": "full-control" 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [ 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo:foo1", 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.053 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.054 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.055 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:38.057 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:38.057 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:38.058 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:38.058 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:38.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.050+0000 7f0d679a7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.050+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94569092497408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295344c00 con 0x560294e79c00 2024-04-19T23:45:38.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.051+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94569092497408] v30'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.051+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94569091136256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295345000 con 0x560295217800 2024-04-19T23:45:38.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.052+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94569091136256] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.052+0000 7f0d82a2fa80 20 remove_watcher() i=0 2024-04-19T23:45:38.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.052+0000 7f0d82a2fa80 2 removed watcher, disabling cache 2024-04-19T23:45:38.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.052+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94569091137408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295345400 con 0x560294e79c00 2024-04-19T23:45:38.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.053+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94569091137408] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.053+0000 7f0d82a2fa80 20 remove_watcher() i=1 2024-04-19T23:45:38.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.053+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94569091138560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295345800 con 0x560295217400 2024-04-19T23:45:38.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.056+0000 7f0d809d9700 1 -- 172.21.15.155:0/1279579091 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94569091138560] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295293200 con 0x560295217400 2024-04-19T23:45:38.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.056+0000 7f0d82a2fa80 20 remove_watcher() i=2 2024-04-19T23:45:38.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.056+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94569091139712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295345c00 con 0x560295217800 2024-04-19T23:45:38.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.057+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94569091139712] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295293440 con 0x560295217800 2024-04-19T23:45:38.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.057+0000 7f0d82a2fa80 20 remove_watcher() i=3 2024-04-19T23:45:38.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.057+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94569091140864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295345000 con 0x560294e79c00 2024-04-19T23:45:38.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.059+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94569091140864] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560294e79c00 2024-04-19T23:45:38.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.059+0000 7f0d82a2fa80 20 remove_watcher() i=4 2024-04-19T23:45:38.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.059+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94569091142016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295345c00 con 0x560295216400 2024-04-19T23:45:38.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.061+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94569091142016] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.061+0000 7f0d82a2fa80 20 remove_watcher() i=5 2024-04-19T23:45:38.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.061+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94569091143168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295344400 con 0x560295216400 2024-04-19T23:45:38.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.064+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94569091143168] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.064+0000 7f0d82a2fa80 20 remove_watcher() i=6 2024-04-19T23:45:38.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.064+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94569091144320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560295344c00 con 0x560295216400 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d811da700 1 -- 172.21.15.155:0/1279579091 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94569091144320] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560295292b40 con 0x560295216400 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 20 remove_watcher() i=7 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x560295216400 msgr2=0x560295163180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x560295216400 0x560295163180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x560294e79c00 msgr2=0x560295161b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x560294e79c00 0x560295161b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x560295217800 msgr2=0x560295162c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x560295217800 0x560295162c00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x560295217400 msgr2=0x560295162100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x560295217400 0x560295162100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560295216c00 msgr2=0x560295161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560295216c00 0x560295161600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x56029515bf80 tx=0x5602951bc6c0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 msgr2=0x560295160b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/1279579091 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e79800 0x560295160b00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x560295d04810 tx=0x5602951bc600 comp rx=0 tx=0).stop 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 reap_dead start 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d801d8700 1 -- 172.21.15.155:0/1279579091 reap_dead start 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 shutdown_connections 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 >> 172.21.15.155:0/1279579091 conn(0x560294e78c00 msgr2=0x560294f65800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 shutdown_connections 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.067+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/1279579091 wait complete. 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/2071476687 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560295344000 msgr2=0x560295163700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/2071476687 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560295344000 0x560295163700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x5602952bf7d0 tx=0x5602951bd380 comp rx=0 tx=0).stop 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/2071476687 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 msgr2=0x560295162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/2071476687 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5602952bec30 tx=0x5602951bd620 comp rx=0 tx=0).stop 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/2071476687 shutdown_connections 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/2071476687 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560295344000 0x560295163700 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/2071476687 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560295217c00 0x560295162680 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/2071476687 >> 172.21.15.155:0/2071476687 conn(0x560295217000 msgr2=0x560294f66000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/2071476687 shutdown_connections 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/2071476687 wait complete. 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/460849624 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560294e79400 msgr2=0x560295161080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/460849624 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560294e79400 0x560295161080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x560295c3f710 tx=0x5602951bc720 comp rx=0 tx=0).stop 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/460849624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 msgr2=0x560295160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/460849624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x560295c3ff80 tx=0x560294f69920 comp rx=0 tx=0).stop 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/460849624 shutdown_connections 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/460849624 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560294e79400 0x560295161080 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 --2- 172.21.15.155:0/460849624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560294e78800 0x560295160580 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/460849624 >> 172.21.15.155:0/460849624 conn(0x560294e78400 msgr2=0x560294f65000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/460849624 shutdown_connections 2024-04-19T23:45:38.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.068+0000 7f0d82a2fa80 1 -- 172.21.15.155:0/460849624 wait complete. 2024-04-19T23:45:38.072 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:38.072 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-19T23:45:38.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-19T23:45:38.073 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-19T23:45:38.117 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:38.117 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:38.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.118+0000 7fb2e6e9ba80 1 Processor -- start 2024-04-19T23:45:38.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.118+0000 7fb2e6e9ba80 1 -- start start 2024-04-19T23:45:38.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.119+0000 7fb2e6e9ba80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x558258486c00 0x55825876e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.119+0000 7fb2e6e9ba80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5582587b1500 con 0x558258486800 2024-04-19T23:45:38.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.119+0000 7fb2e6e9ba80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x558258528a00 con 0x558258486c00 2024-04-19T23:45:38.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.119+0000 7fb2e4644700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x558258486c00 0x55825876e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.119+0000 7fb2e4e45700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x558258486800 0x558258572800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46592/0 (socket says 172.21.15.155:46592) 2024-04-19T23:45:38.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.119+0000 7fb2e4e45700 1 -- 172.21.15.155:0/4233296547 learned_addr learned my addr 172.21.15.155:0/4233296547 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:38.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.119+0000 7fb2e3e43700 1 -- 172.21.15.155:0/4233296547 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413528995 0 0) 0x558259254000 con 0x558258486800 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.119+0000 7fb2e3e43700 1 -- 172.21.15.155:0/4233296547 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5582587b1680 con 0x558258486800 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.119+0000 7fb2e4644700 1 -- 172.21.15.155:0/4233296547 >> v1:172.21.15.76:6789/0 conn(0x558258486800 legacy=0x558258572800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.119+0000 7fb2e4644700 1 -- 172.21.15.155:0/4233296547 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582584afd40 con 0x558258486c00 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.120+0000 7fb2e4644700 1 --2- 172.21.15.155:0/4233296547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486c00 0x55825876e580 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x558258769890 tx=0x558258577980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1df288f7c46e1ce server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.120+0000 7fb2e3e43700 1 -- 172.21.15.155:0/4233296547 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55825853f4a0 con 0x558258486c00 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.120+0000 7fb2e3e43700 1 -- 172.21.15.155:0/4233296547 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582587b1680 con 0x558258486c00 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.120+0000 7fb2e3e43700 1 -- 172.21.15.155:0/4233296547 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55825853f600 con 0x558258486c00 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.120+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/4233296547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486c00 msgr2=0x55825876e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.120+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/4233296547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486c00 0x55825876e580 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x558258769890 tx=0x558258577980 comp rx=0 tx=0).stop 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.120+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/4233296547 shutdown_connections 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.120+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/4233296547 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486c00 0x55825876e580 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.120+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/4233296547 >> 172.21.15.155:0/4233296547 conn(0x558258486400 msgr2=0x558258572000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.120+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/4233296547 shutdown_connections 2024-04-19T23:45:38.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.120+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/4233296547 wait complete. 2024-04-19T23:45:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.121+0000 7fb2e6e9ba80 1 Processor -- start 2024-04-19T23:45:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.121+0000 7fb2e6e9ba80 1 -- start start 2024-04-19T23:45:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.121+0000 7fb2e6e9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.121+0000 7fb2e6e9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558258528500 con 0x558258486800 2024-04-19T23:45:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.121+0000 7fb2e4e45700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.121+0000 7fb2e4e45700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34626/0 (socket says 172.21.15.155:34626) 2024-04-19T23:45:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.121+0000 7fb2e4e45700 1 -- 172.21.15.155:0/2640389738 learned_addr learned my addr 172.21.15.155:0/2640389738 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e4e45700 1 -- 172.21.15.155:0/2640389738 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582584afba0 con 0x558258486800 2024-04-19T23:45:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e4e45700 1 --2- 172.21.15.155:0/2640389738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x558259257770 tx=0x558258577b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b187e359dabe41f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e3642700 1 -- 172.21.15.155:0/2640389738 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55825853f1e0 con 0x558258486800 2024-04-19T23:45:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e3642700 1 -- 172.21.15.155:0/2640389738 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582587b1b00 con 0x558258486800 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e3642700 1 -- 172.21.15.155:0/2640389738 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55825853f4a0 con 0x558258486800 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2640389738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 msgr2=0x55825876e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/2640389738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x558259257770 tx=0x558258577b60 comp rx=0 tx=0).stop 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2640389738 shutdown_connections 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/2640389738 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2640389738 >> 172.21.15.155:0/2640389738 conn(0x558258486400 msgr2=0x558258573000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2640389738 shutdown_connections 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.122+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2640389738 wait complete. 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.123+0000 7fb2e6e9ba80 1 Processor -- start 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.123+0000 7fb2e6e9ba80 1 -- start start 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.123+0000 7fb2e6e9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.123+0000 7fb2e6e9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582585283c0 con 0x558258486800 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.123+0000 7fb2e4e45700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.123+0000 7fb2e4e45700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34638/0 (socket says 172.21.15.155:34638) 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.123+0000 7fb2e4e45700 1 -- 172.21.15.155:0/3036955765 learned_addr learned my addr 172.21.15.155:0/3036955765 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.123+0000 7fb2e4e45700 1 -- 172.21.15.155:0/3036955765 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582584afa00 con 0x558258486800 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.123+0000 7fb2e4e45700 1 --2- 172.21.15.155:0/3036955765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x558259257e30 tx=0x558258577920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.123+0000 7fb2e1e3f700 1 -- 172.21.15.155:0/3036955765 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55825853f600 con 0x558258486800 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.124+0000 7fb2e1e3f700 1 -- 172.21.15.155:0/3036955765 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558258527c80 con 0x558258486800 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.124+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/3036955765 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5582584af860 con 0x558258486800 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.124+0000 7fb2e1e3f700 1 -- 172.21.15.155:0/3036955765 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55825853f1e0 con 0x558258486800 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.124+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/3036955765 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582584af6c0 con 0x558258486800 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.124+0000 7fb2e6e9ba80 1 Processor -- start 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.124+0000 7fb2e6e9ba80 1 -- start start 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.124+0000 7fb2e6e9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 0x55825876eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.124+0000 7fb2e6e9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558258528000 con 0x558258487400 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.124+0000 7fb2e1e3f700 1 -- 172.21.15.155:0/3036955765 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558259228b00 con 0x558258486800 2024-04-19T23:45:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2e5646700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 0x55825876eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2e5646700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 0x55825876eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34644/0 (socket says 172.21.15.155:34644) 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2e5646700 1 -- 172.21.15.155:0/1559962414 learned_addr learned my addr 172.21.15.155:0/1559962414 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2e1e3f700 1 --2- 172.21.15.155:0/3036955765 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55825880c000 0x55825876f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2e1e3f700 1 -- 172.21.15.155:0/3036955765 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558258501180 con 0x558258486800 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2e4e45700 1 --2- 172.21.15.155:0/3036955765 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55825880c000 0x55825876f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2e5646700 1 -- 172.21.15.155:0/1559962414 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582584ae000 con 0x558258487400 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2e4e45700 1 --2- 172.21.15.155:0/3036955765 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55825880c000 0x55825876f080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55825931af00 tx=0x5582587d2240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2e5646700 1 --2- 172.21.15.155:0/1559962414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 0x55825876eb00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x558258812030 tx=0x5582587d2120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41d15bf528bbbbd server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2df63a700 1 -- 172.21.15.155:0/1559962414 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55825853f600 con 0x558258487400 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2df63a700 1 -- 172.21.15.155:0/1559962414 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582587b0480 con 0x558258487400 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.125+0000 7fb2df63a700 1 -- 172.21.15.155:0/1559962414 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55825853f1e0 con 0x558258487400 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/1559962414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 msgr2=0x55825876eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/1559962414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 0x55825876eb00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x558258812030 tx=0x5582587d2120 comp rx=0 tx=0).stop 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/1559962414 shutdown_connections 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/1559962414 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 0x55825876eb00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/1559962414 >> 172.21.15.155:0/1559962414 conn(0x558258486c00 msgr2=0x558258573800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/1559962414 shutdown_connections 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/1559962414 wait complete. 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e6e9ba80 1 Processor -- start 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e6e9ba80 1 -- start start 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e6e9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 0x55825876eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e6e9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582584c2640 con 0x558258487400 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e5646700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 0x55825876eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e5646700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 0x55825876eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34660/0 (socket says 172.21.15.155:34660) 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 learned_addr learned my addr 172.21.15.155:0/329369362 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.126+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582584aeea0 con 0x558258487400 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.127+0000 7fb2e5646700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 0x55825876eb00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55825931a4e0 tx=0x5582587d28a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.127+0000 7fb2dde37700 1 -- 172.21.15.155:0/329369362 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55825853fa20 con 0x558258487400 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.127+0000 7fb2dde37700 1 -- 172.21.15.155:0/329369362 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582587b0180 con 0x558258487400 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.127+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5582584ae820 con 0x558258487400 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.127+0000 7fb2dde37700 1 -- 172.21.15.155:0/329369362 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55825853f600 con 0x558258487400 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.127+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582584ae9c0 con 0x558258487400 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.128+0000 7fb2dde37700 1 -- 172.21.15.155:0/329369362 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558259228dc0 con 0x558258487400 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.128+0000 7fb2dde37700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55825880cc00 0x55825876f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.128+0000 7fb2dde37700 1 -- 172.21.15.155:0/329369362 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558258501340 con 0x558258487400 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.128+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.128+0000 7fb2e4644700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55825880cc00 0x55825876f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.128+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558258487800 0x55825876fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.128+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258487c00 con 0x558258487800 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.128+0000 7fb2e5646700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558258487800 0x55825876fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.128+0000 7fb2e4644700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55825880cc00 0x55825876f600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x558258769890 tx=0x558258577800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.128+0000 7fb2e5646700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558258487800 0x55825876fb80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.128+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 20 realm 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55825880d000 con 0x558258487800 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55825880d400 con 0x558258487800 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55825880d800 con 0x558258487800 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55825880dc00 con 0x558258487800 2024-04-19T23:45:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.129+0000 7fb2e6e9ba80 20 searching for the correct realm 2024-04-19T23:45:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.130+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55825880d000 0x558258770100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.130+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55825880d400 con 0x55825880d000 2024-04-19T23:45:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.130+0000 7fb2e4e45700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55825880d000 0x558258770100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.130+0000 7fb2e4e45700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55825880d000 0x558258770100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.130+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.130+0000 7fb2e4e45700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55825880d400 0x558258770c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.130+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce000 con 0x55825880d400 2024-04-19T23:45:38.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.130+0000 7fb2e4644700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55825880d400 0x558258770c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.131+0000 7fb2e4644700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55825880d400 0x558258770c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.131+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.131+0000 7fb2e4644700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5582588ce000 0x558258771180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.131+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x5582588ce000 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.131+0000 7fb2e5646700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5582588ce000 0x558258771180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.131+0000 7fb2e5646700 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5582588ce000 0x558258771180 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.132+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.132+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x558258487800 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.132+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.132+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x558258487800 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.132+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.132+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x5582588ce000 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.132+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.132+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x5582588ce000 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.133+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.133+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d400 2024-04-19T23:45:38.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.133+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.133+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d000 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.133+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.133+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x558258487800 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.133+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.133+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x5582588ce000 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.134+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.134+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x558258487800 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.134+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.134+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d400 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.134+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.134+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d000 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.134+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.134+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d000 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.135+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.135+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x5582588ce000 2024-04-19T23:45:38.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.135+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.135+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d000 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.135+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.135+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d000 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.136+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.136+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x558258487800 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.136+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.136+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x558258487800 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.136+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.136+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x5582588ce000 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.136+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.136+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d000 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.137+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.137+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d400 2024-04-19T23:45:38.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.137+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.137+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x558258487800 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.137+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.137+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x5582588ce000 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.137+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.137+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d000 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.137+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.138+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x5582588ce000 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.138+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.138+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d400 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.138+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.138+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d000 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.138+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.138+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x5582588ce000 2024-04-19T23:45:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x558258487800 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d400 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e6e9ba80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e6e9ba80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e6e9ba80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e6e9ba80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258487c00 con 0x558258487800 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e6e9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.139+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cec00 con 0x558258487800 2024-04-19T23:45:38.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cf000 con 0x55825880d400 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 20 zone default found 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 4 Realm: () 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 20 zonegroup default 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cf400 con 0x5582588ce000 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cf800 con 0x55825880d000 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.140+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cfc00 con 0x55825880d000 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.141+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.141+0000 7fb2e6e9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.141+0000 7fb2e6e9ba80 20 started sync module instance, tier type = 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.141+0000 7fb2e6e9ba80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.141+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cec00 con 0x55825880d400 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.142+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.142+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94018318260992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258487c00 con 0x55825880d400 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.142+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55825880d800 con 0x558258487800 2024-04-19T23:45:38.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.144+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.144+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94018318262144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55825880dc00 con 0x558258487800 2024-04-19T23:45:38.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.144+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x55825880d000 2024-04-19T23:45:38.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.144+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94018318260992] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.147+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94018318262144] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.147+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.147+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94018318263296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cf000 con 0x55825880d000 2024-04-19T23:45:38.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.147+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cec00 con 0x55825880d400 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.148+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.148+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94018318263296] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.148+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94018318264448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce400 con 0x55825880d400 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.148+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cf800 con 0x558258487800 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.151+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94018318264448] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.151+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.151+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94018318265600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cfc00 con 0x558258487800 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.151+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588ce800 con 0x5582588ce000 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.152+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94018318265600] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.154+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.154+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94018318266752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cf400 con 0x5582588ce000 2024-04-19T23:45:38.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.154+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cf800 con 0x5582588ce000 2024-04-19T23:45:38.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.157+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.157+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94018318267904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cfc00 con 0x5582588ce000 2024-04-19T23:45:38.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.157+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55825880d800 con 0x5582588ce000 2024-04-19T23:45:38.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.157+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94018318266752] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.158+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94018318267904] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.158+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.158+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94018318269056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55825880dc00 con 0x5582588ce000 2024-04-19T23:45:38.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.158+0000 7fb2e6e9ba80 20 add_watcher() i=0 2024-04-19T23:45:38.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.158+0000 7fb2e6e9ba80 20 add_watcher() i=1 2024-04-19T23:45:38.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.158+0000 7fb2e6e9ba80 20 add_watcher() i=2 2024-04-19T23:45:38.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.158+0000 7fb2e6e9ba80 20 add_watcher() i=3 2024-04-19T23:45:38.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.158+0000 7fb2e6e9ba80 20 add_watcher() i=4 2024-04-19T23:45:38.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.158+0000 7fb2e6e9ba80 20 add_watcher() i=5 2024-04-19T23:45:38.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.158+0000 7fb2e6e9ba80 20 add_watcher() i=6 2024-04-19T23:45:38.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.159+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94018318269056] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.159+0000 7fb2e6e9ba80 20 add_watcher() i=7 2024-04-19T23:45:38.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.159+0000 7fb2e6e9ba80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:38.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.159+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55825880d800 con 0x558258487800 2024-04-19T23:45:38.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.160+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.160+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94018319802368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55825880dc00 con 0x558258487800 2024-04-19T23:45:38.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.161+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94018319802368] v30'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.161+0000 7fb2cbe13700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.161+0000 7fb2e6e9ba80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:38.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.161+0000 7fb2e6e9ba80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:38.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.161+0000 7fb2e6e9ba80 1 Processor -- start 2024-04-19T23:45:38.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.161+0000 7fb2e6e9ba80 1 -- start start 2024-04-19T23:45:38.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.161+0000 7fb2e6e9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.161+0000 7fb2e6e9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582584c2780 con 0x5582588cf400 2024-04-19T23:45:38.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.161+0000 7fb2e4644700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.161+0000 7fb2e4644700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34666/0 (socket says 172.21.15.155:34666) 2024-04-19T23:45:38.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.161+0000 7fb2e4644700 1 -- 172.21.15.155:0/728274657 learned_addr learned my addr 172.21.15.155:0/728274657 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.162+0000 7fb2e4644700 1 -- 172.21.15.155:0/728274657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582584aeb60 con 0x5582588cf400 2024-04-19T23:45:38.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.162+0000 7fb2e4644700 1 --2- 172.21.15.155:0/728274657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x5582588600c0 tx=0x5582587d36e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd97fcea1465192 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.162+0000 7fb2cb612700 1 -- 172.21.15.155:0/728274657 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55825853f760 con 0x5582588cf400 2024-04-19T23:45:38.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.162+0000 7fb2cb612700 1 -- 172.21.15.155:0/728274657 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582588f6000 con 0x5582588cf400 2024-04-19T23:45:38.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.162+0000 7fb2cb612700 1 -- 172.21.15.155:0/728274657 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5582588f8000 con 0x5582588cf400 2024-04-19T23:45:38.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/728274657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 msgr2=0x558258770680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/728274657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x5582588600c0 tx=0x5582587d36e0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/728274657 shutdown_connections 2024-04-19T23:45:38.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/728274657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/728274657 >> 172.21.15.155:0/728274657 conn(0x5582588ce800 msgr2=0x558258574000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/728274657 shutdown_connections 2024-04-19T23:45:38.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/728274657 wait complete. 2024-04-19T23:45:38.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e6e9ba80 1 Processor -- start 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e6e9ba80 1 -- start start 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e6e9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e6e9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558258528000 con 0x5582588cf400 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e4644700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e4644700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34678/0 (socket says 172.21.15.155:34678) 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.163+0000 7fb2e4644700 1 -- 172.21.15.155:0/2824650482 learned_addr learned my addr 172.21.15.155:0/2824650482 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.164+0000 7fb2e4644700 1 -- 172.21.15.155:0/2824650482 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582584aed00 con 0x5582588cf400 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.164+0000 7fb2e4644700 1 --2- 172.21.15.155:0/2824650482 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x5582588e3200 tx=0x5582587d3800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.164+0000 7fb2c9e0f700 1 -- 172.21.15.155:0/2824650482 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5582588f8160 con 0x5582588cf400 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.164+0000 7fb2c9e0f700 1 -- 172.21.15.155:0/2824650482 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582588f6180 con 0x5582588cf400 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.164+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2824650482 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5582584ae340 con 0x5582588cf400 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.164+0000 7fb2c9e0f700 1 -- 172.21.15.155:0/2824650482 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5582588f82c0 con 0x5582588cf400 2024-04-19T23:45:38.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.164+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2824650482 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582584afd40 con 0x5582588cf400 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.165+0000 7fb2c9e0f700 1 -- 172.21.15.155:0/2824650482 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558259229b80 con 0x5582588cf400 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.165+0000 7fb2c9e0f700 1 --2- 172.21.15.155:0/2824650482 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558258972000 0x558258771700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.165+0000 7fb2c9e0f700 1 -- 172.21.15.155:0/2824650482 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558258501500 con 0x5582588cf400 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.165+0000 7fb2e6e9ba80 5 note: GC not initialized 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.165+0000 7fb2e5646700 1 --2- 172.21.15.155:0/2824650482 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558258972000 0x558258771700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.165+0000 7fb2e5646700 1 --2- 172.21.15.155:0/2824650482 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558258972000 0x558258771700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x558258861950 tx=0x5582587d20c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.166+0000 7fb2c760a700 20 reqs_thread_entry: start 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.166+0000 7fb2e6e9ba80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.166+0000 7fb2e6e9ba80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.166+0000 7fb2c5606700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:08 2024 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.166+0000 7fb2c4de4700 20 reqs_thread_entry: start 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.166+0000 7fb2e6e9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.166+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5582588cfc00 con 0x558258487800 2024-04-19T23:45:38.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.167+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.167+0000 7fb2e6e9ba80 20 rados_obj.operate() r=0 bl.length=513 2024-04-19T23:45:38.169 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:38.169 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:38.169 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [ 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "foo:foo1", 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "permissions": "full-control" 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:38.170 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [ 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo:foo1", 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:38.171 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:38.172 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:38.173 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:38.173 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:38.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.168+0000 7fb2cbe13700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.168+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94018319802368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258972400 con 0x558258487800 2024-04-19T23:45:38.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.169+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94018319802368] v30'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.169+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94018318260992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258972800 con 0x55825880d400 2024-04-19T23:45:38.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.170+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94018318260992] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.170+0000 7fb2e6e9ba80 20 remove_watcher() i=0 2024-04-19T23:45:38.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.170+0000 7fb2e6e9ba80 2 removed watcher, disabling cache 2024-04-19T23:45:38.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.170+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94018318262144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258972c00 con 0x558258487800 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.171+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94018318262144] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.171+0000 7fb2e6e9ba80 20 remove_watcher() i=1 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.171+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94018318263296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258973000 con 0x55825880d000 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.172+0000 7fb2e4e45700 1 -- 172.21.15.155:0/329369362 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94018318263296] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c7200 con 0x55825880d000 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.172+0000 7fb2e6e9ba80 20 remove_watcher() i=2 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.172+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94018318264448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258973400 con 0x55825880d400 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.173+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94018318264448] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c7440 con 0x55825880d400 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.173+0000 7fb2e6e9ba80 20 remove_watcher() i=3 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.173+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94018318265600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258973800 con 0x558258487800 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.174+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94018318265600] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x558258487800 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.174+0000 7fb2e6e9ba80 20 remove_watcher() i=4 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.174+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94018318266752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258973c00 con 0x5582588ce000 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.175+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94018318266752] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.175+0000 7fb2e6e9ba80 20 remove_watcher() i=5 2024-04-19T23:45:38.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.175+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94018318267904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258972400 con 0x5582588ce000 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.176+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94018318267904] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.176+0000 7fb2e6e9ba80 20 remove_watcher() i=6 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.176+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94018318269056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558258972c00 con 0x5582588ce000 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e5646700 1 -- 172.21.15.155:0/329369362 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94018318269056] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5582588c6b40 con 0x5582588ce000 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 20 remove_watcher() i=7 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5582588ce000 msgr2=0x558258771180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5582588ce000 0x558258771180 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558258487800 msgr2=0x55825876fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558258487800 0x55825876fb80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55825880d400 msgr2=0x558258770c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55825880d400 0x558258770c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55825880d000 msgr2=0x558258770100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55825880d000 0x558258770100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55825880cc00 msgr2=0x55825876f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55825880cc00 0x55825876f600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x558258769890 tx=0x558258577800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 msgr2=0x55825876eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/329369362 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258487400 0x55825876eb00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55825931a4e0 tx=0x5582587d28a0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 reap_dead start 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 shutdown_connections 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e4644700 1 -- 172.21.15.155:0/329369362 reap_dead start 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 >> 172.21.15.155:0/329369362 conn(0x558258486c00 msgr2=0x558258573800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 shutdown_connections 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/329369362 wait complete. 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2824650482 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558258972000 msgr2=0x558258771700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/2824650482 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558258972000 0x558258771700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x558258861950 tx=0x5582587d20c0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2824650482 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 msgr2=0x558258770680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/2824650482 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x5582588e3200 tx=0x5582587d3800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2824650482 shutdown_connections 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/2824650482 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558258972000 0x558258771700 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/2824650482 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5582588cf400 0x558258770680 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2824650482 >> 172.21.15.155:0/2824650482 conn(0x5582588ce800 msgr2=0x558258574000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2824650482 shutdown_connections 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.177+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/2824650482 wait complete. 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.178+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/3036955765 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55825880c000 msgr2=0x55825876f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.178+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/3036955765 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55825880c000 0x55825876f080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55825931af00 tx=0x5582587d2240 comp rx=0 tx=0).stop 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.178+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/3036955765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 msgr2=0x55825876e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.178+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/3036955765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x558259257e30 tx=0x558258577920 comp rx=0 tx=0).stop 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.178+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/3036955765 shutdown_connections 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.178+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/3036955765 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55825880c000 0x55825876f080 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.178+0000 7fb2e6e9ba80 1 --2- 172.21.15.155:0/3036955765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558258486800 0x55825876e580 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.178+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/3036955765 >> 172.21.15.155:0/3036955765 conn(0x558258486400 msgr2=0x558258573000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.178+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/3036955765 shutdown_connections 2024-04-19T23:45:38.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.178+0000 7fb2e6e9ba80 1 -- 172.21.15.155:0/3036955765 wait complete. 2024-04-19T23:45:38.183 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:38.184 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-19T23:45:38.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-19T23:45:38.184 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-19T23:45:38.229 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:38.230 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:38.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.230+0000 7f99981a6a80 1 Processor -- start 2024-04-19T23:45:38.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.230+0000 7f99981a6a80 1 -- start start 2024-04-19T23:45:38.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.230+0000 7f99981a6a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56382ae32c00 0x56382b11a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.230+0000 7f99981a6a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56382b15d500 con 0x56382ae32800 2024-04-19T23:45:38.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.230+0000 7f99981a6a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x56382aed4a00 con 0x56382ae32c00 2024-04-19T23:45:38.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.231+0000 7f999594f700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56382ae32c00 0x56382b11a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.231+0000 7f9996150700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x56382ae32800 0x56382af1e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46594/0 (socket says 172.21.15.155:46594) 2024-04-19T23:45:38.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.231+0000 7f999594f700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56382ae32c00 0x56382b11a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34694/0 (socket says 172.21.15.155:34694) 2024-04-19T23:45:38.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.231+0000 7f9996150700 1 -- 172.21.15.155:0/3413893736 learned_addr learned my addr 172.21.15.155:0/3413893736 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:38.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.231+0000 7f999594f700 1 -- 172.21.15.155:0/3413893736 >> v1:172.21.15.76:6789/0 conn(0x56382ae32800 legacy=0x56382af1e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.231+0000 7f999594f700 1 -- 172.21.15.155:0/3413893736 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56382ae5bd40 con 0x56382ae32c00 2024-04-19T23:45:38.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.231+0000 7f999594f700 1 --2- 172.21.15.155:0/3413893736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32c00 0x56382b11a580 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x56382b115890 tx=0x56382af23920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2931f6de7a02ac1 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.231+0000 7f999514e700 1 -- 172.21.15.155:0/3413893736 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382aeeb4a0 con 0x56382ae32c00 2024-04-19T23:45:38.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.232+0000 7f999514e700 1 -- 172.21.15.155:0/3413893736 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56382b15d800 con 0x56382ae32c00 2024-04-19T23:45:38.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.232+0000 7f999514e700 1 -- 172.21.15.155:0/3413893736 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382aeeb600 con 0x56382ae32c00 2024-04-19T23:45:38.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.232+0000 7f99981a6a80 1 -- 172.21.15.155:0/3413893736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32c00 msgr2=0x56382b11a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.232+0000 7f99981a6a80 1 --2- 172.21.15.155:0/3413893736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32c00 0x56382b11a580 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x56382b115890 tx=0x56382af23920 comp rx=0 tx=0).stop 2024-04-19T23:45:38.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.232+0000 7f99981a6a80 1 -- 172.21.15.155:0/3413893736 shutdown_connections 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.232+0000 7f99981a6a80 1 --2- 172.21.15.155:0/3413893736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32c00 0x56382b11a580 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.232+0000 7f99981a6a80 1 -- 172.21.15.155:0/3413893736 >> 172.21.15.155:0/3413893736 conn(0x56382ae32400 msgr2=0x56382af1e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.232+0000 7f99981a6a80 1 -- 172.21.15.155:0/3413893736 shutdown_connections 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.232+0000 7f99981a6a80 1 -- 172.21.15.155:0/3413893736 wait complete. 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.233+0000 7f99981a6a80 1 Processor -- start 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.233+0000 7f99981a6a80 1 -- start start 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.233+0000 7f99981a6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.233+0000 7f99981a6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56382aed4500 con 0x56382ae32800 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.233+0000 7f9996150700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.233+0000 7f9996150700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34700/0 (socket says 172.21.15.155:34700) 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.233+0000 7f9996150700 1 -- 172.21.15.155:0/2186626187 learned_addr learned my addr 172.21.15.155:0/2186626187 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.233+0000 7f9996150700 1 -- 172.21.15.155:0/2186626187 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56382ae5bba0 con 0x56382ae32800 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.233+0000 7f9996150700 1 --2- 172.21.15.155:0/2186626187 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x56382bbf9800 tx=0x56382af23b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e62785b2c0f045d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f999494d700 1 -- 172.21.15.155:0/2186626187 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382aeeb1e0 con 0x56382ae32800 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f999494d700 1 -- 172.21.15.155:0/2186626187 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56382b15db00 con 0x56382ae32800 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f999494d700 1 -- 172.21.15.155:0/2186626187 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382aeeb4a0 con 0x56382ae32800 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f99981a6a80 1 -- 172.21.15.155:0/2186626187 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 msgr2=0x56382b11a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2186626187 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x56382bbf9800 tx=0x56382af23b60 comp rx=0 tx=0).stop 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f99981a6a80 1 -- 172.21.15.155:0/2186626187 shutdown_connections 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2186626187 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f99981a6a80 1 -- 172.21.15.155:0/2186626187 >> 172.21.15.155:0/2186626187 conn(0x56382ae32400 msgr2=0x56382af1f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f99981a6a80 1 -- 172.21.15.155:0/2186626187 shutdown_connections 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f99981a6a80 1 -- 172.21.15.155:0/2186626187 wait complete. 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f99981a6a80 1 Processor -- start 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f99981a6a80 1 -- start start 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.234+0000 7f99981a6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.235+0000 7f99981a6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56382aed43c0 con 0x56382ae32800 2024-04-19T23:45:38.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.235+0000 7f9996150700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.235+0000 7f9996150700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34712/0 (socket says 172.21.15.155:34712) 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.235+0000 7f9996150700 1 -- 172.21.15.155:0/2655521237 learned_addr learned my addr 172.21.15.155:0/2655521237 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.235+0000 7f9996150700 1 -- 172.21.15.155:0/2655521237 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56382ae5ba00 con 0x56382ae32800 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.235+0000 7f9996150700 1 --2- 172.21.15.155:0/2655521237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x56382bbf9a10 tx=0x56382af23a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.235+0000 7f999314a700 1 -- 172.21.15.155:0/2655521237 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382aeeb600 con 0x56382ae32800 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.235+0000 7f999314a700 1 -- 172.21.15.155:0/2655521237 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56382aed3c80 con 0x56382ae32800 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.235+0000 7f99981a6a80 1 -- 172.21.15.155:0/2655521237 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56382ae5b860 con 0x56382ae32800 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.235+0000 7f999314a700 1 -- 172.21.15.155:0/2655521237 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382aeeb1e0 con 0x56382ae32800 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.235+0000 7f99981a6a80 1 -- 172.21.15.155:0/2655521237 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56382ae5b6c0 con 0x56382ae32800 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f999314a700 1 -- 172.21.15.155:0/2655521237 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56382bbd4b00 con 0x56382ae32800 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f99981a6a80 1 Processor -- start 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f99981a6a80 1 -- start start 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f999314a700 1 --2- 172.21.15.155:0/2655521237 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382ae33400 0x56382b11b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f999314a700 1 -- 172.21.15.155:0/2655521237 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56382aead180 con 0x56382ae32800 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f99981a6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f99981a6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56382aed4000 con 0x56382ae33800 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f9996951700 1 --2- 172.21.15.155:0/2655521237 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382ae33400 0x56382b11b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f9996150700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f9996150700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34722/0 (socket says 172.21.15.155:34722) 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f9996150700 1 -- 172.21.15.155:0/2793153990 learned_addr learned my addr 172.21.15.155:0/2793153990 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f9996951700 1 --2- 172.21.15.155:0/2655521237 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382ae33400 0x56382b11b080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x56382bcc48a0 tx=0x56382b178060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.236+0000 7f9996150700 1 -- 172.21.15.155:0/2793153990 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56382ae5a000 con 0x56382ae33800 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f9996150700 1 --2- 172.21.15.155:0/2793153990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x56382bcc4360 tx=0x56382b178240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bca59a6949b842 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f9990945700 1 -- 172.21.15.155:0/2793153990 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382aeeb4a0 con 0x56382ae33800 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f9990945700 1 -- 172.21.15.155:0/2793153990 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56382b15c300 con 0x56382ae33800 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f9990945700 1 -- 172.21.15.155:0/2793153990 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382aeeb8c0 con 0x56382ae33800 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f99981a6a80 1 -- 172.21.15.155:0/2793153990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 msgr2=0x56382b11ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2793153990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x56382bcc4360 tx=0x56382b178240 comp rx=0 tx=0).stop 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f99981a6a80 1 -- 172.21.15.155:0/2793153990 shutdown_connections 2024-04-19T23:45:38.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2793153990 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f99981a6a80 1 -- 172.21.15.155:0/2793153990 >> 172.21.15.155:0/2793153990 conn(0x56382ae32c00 msgr2=0x56382af1f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f99981a6a80 1 -- 172.21.15.155:0/2793153990 shutdown_connections 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f99981a6a80 1 -- 172.21.15.155:0/2793153990 wait complete. 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f99981a6a80 1 Processor -- start 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.237+0000 7f99981a6a80 1 -- start start 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f99981a6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f99981a6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56382ae6e640 con 0x56382ae33800 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f9996150700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f9996150700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34730/0 (socket says 172.21.15.155:34730) 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 learned_addr learned my addr 172.21.15.155:0/2716685707 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56382ae5aea0 con 0x56382ae33800 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f9996150700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x56382bcc4690 tx=0x56382b1788a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f998f142700 1 -- 172.21.15.155:0/2716685707 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382aeeb4a0 con 0x56382ae33800 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f998f142700 1 -- 172.21.15.155:0/2716685707 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56382aed3e00 con 0x56382ae33800 2024-04-19T23:45:38.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56382ae5a820 con 0x56382ae33800 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f998f142700 1 -- 172.21.15.155:0/2716685707 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382aeeb8c0 con 0x56382ae33800 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.238+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56382ae5a9c0 con 0x56382ae33800 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.239+0000 7f998f142700 1 -- 172.21.15.155:0/2716685707 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56382bbd4dc0 con 0x56382ae33800 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.239+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.239+0000 7f998f142700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382b1d6c00 0x56382b11b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.239+0000 7f998f142700 1 -- 172.21.15.155:0/2716685707 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56382aead340 con 0x56382ae33800 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.239+0000 7f999594f700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382b1d6c00 0x56382b11b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.239+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56382ae33c00 0x56382b11bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.239+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d7000 con 0x56382ae33c00 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f9996951700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56382ae33c00 0x56382b11bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f999594f700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382b1d6c00 0x56382b11b600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x56382b115890 tx=0x56382af23800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f9996951700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56382ae33c00 0x56382b11bb80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f99981a6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f99981a6a80 20 realm 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d7400 con 0x56382ae33c00 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f99981a6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f99981a6a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.240+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d7800 con 0x56382ae33c00 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f99981a6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d7c00 con 0x56382ae33c00 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f99981a6a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d7000 con 0x56382ae33c00 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f99981a6a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f99981a6a80 20 searching for the correct realm 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56382b1d7400 0x56382b11c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d7800 con 0x56382b1d7400 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.241+0000 7f9996150700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56382b1d7400 0x56382b11c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.242+0000 7f9996150700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56382b1d7400 0x56382b11c100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.242+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.242+0000 7f9996150700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56382b1d7800 0x56382b11cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.242+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d6400 con 0x56382b1d7800 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.242+0000 7f999594f700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56382b1d7800 0x56382b11cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.243+0000 7f999594f700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56382b1d7800 0x56382b11cc00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.243+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.243+0000 7f999594f700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56382b1d6400 0x56382b11d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.243+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d6400 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.243+0000 7f9996951700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56382b1d6400 0x56382b11d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.243+0000 7f9996951700 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56382b1d6400 0x56382b11d180 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.244+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.244+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382ae33c00 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.244+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.244+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382ae33c00 2024-04-19T23:45:38.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.244+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.244+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d6400 2024-04-19T23:45:38.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.244+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.244+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d6400 2024-04-19T23:45:38.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.245+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.245+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7800 2024-04-19T23:45:38.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.245+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.245+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7400 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.245+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.245+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382ae33c00 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.245+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.245+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d6400 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.245+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.245+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382ae33c00 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.246+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.246+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7800 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.246+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.246+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7400 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.246+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.246+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.246+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.246+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d6400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.247+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.247+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.247+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.247+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.247+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.247+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382ae33c00 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.247+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.247+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382ae33c00 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.248+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.248+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d6400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.248+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.248+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.248+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.248+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7800 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.248+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.248+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382ae33c00 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.249+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.249+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d6400 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.249+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.249+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7400 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.249+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.249+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d6400 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.250+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.250+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7800 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.250+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.250+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7400 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.250+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.250+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d6400 2024-04-19T23:45:38.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.250+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.250+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382ae33c00 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.250+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7800 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d7c00 con 0x56382ae33c00 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d7000 con 0x56382ae33c00 2024-04-19T23:45:38.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e400 con 0x56382b1d7800 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 zone default found 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 4 Realm: () 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 zonegroup default 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.251+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e800 con 0x56382b1d6400 2024-04-19T23:45:38.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f99981a6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25ec00 con 0x56382b1d7400 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f99981a6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25f000 con 0x56382b1d7400 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f99981a6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f99981a6a80 20 started sync module instance, tier type = 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f99981a6a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.252+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25f400 con 0x56382b1d7800 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.253+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.253+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94799240698624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25f800 con 0x56382b1d7800 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.253+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25fc00 con 0x56382ae33c00 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.254+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94799240698624] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.255+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.255+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94799240699776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e800 con 0x56382ae33c00 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.255+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25fc00 con 0x56382b1d7400 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.255+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94799240699776] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.256+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.256+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94799240700928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d7400 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.256+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e400 con 0x56382b1d7800 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.257+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94799240700928] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.257+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.257+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94799240702080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25f400 con 0x56382b1d7800 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.257+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d7c00 con 0x56382ae33c00 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.258+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94799240702080] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.258+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.258+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94799240703232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d7000 con 0x56382ae33c00 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.258+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25ec00 con 0x56382b1d6400 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.259+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.259+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94799240704384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25f000 con 0x56382b1d6400 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.259+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25fc00 con 0x56382b1d6400 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.259+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94799240703232] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.260+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94799240704384] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.261+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.261+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94799240705536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382b1d6400 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.261+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e800 con 0x56382b1d6400 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.262+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94799240705536] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.262+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.262+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94799240706688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25ec00 con 0x56382b1d6400 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.262+0000 7f99981a6a80 20 add_watcher() i=0 2024-04-19T23:45:38.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.262+0000 7f99981a6a80 20 add_watcher() i=1 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.262+0000 7f99981a6a80 20 add_watcher() i=2 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.262+0000 7f99981a6a80 20 add_watcher() i=3 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.262+0000 7f99981a6a80 20 add_watcher() i=4 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.262+0000 7f99981a6a80 20 add_watcher() i=5 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.262+0000 7f99981a6a80 20 add_watcher() i=6 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.263+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94799240706688] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.263+0000 7f99981a6a80 20 add_watcher() i=7 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.263+0000 7f99981a6a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.263+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25f000 con 0x56382ae33c00 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.263+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.263+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94799242117120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b1d7c00 con 0x56382ae33c00 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.265+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94799242117120] v30'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.265+0000 7f997d11e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.265+0000 7f99981a6a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:38.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.265+0000 7f99981a6a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.265+0000 7f99981a6a80 1 Processor -- start 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.265+0000 7f99981a6a80 1 -- start start 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.265+0000 7f99981a6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.265+0000 7f99981a6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56382ae6e780 con 0x56382b1d7c00 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.265+0000 7f999594f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.265+0000 7f999594f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34736/0 (socket says 172.21.15.155:34736) 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.265+0000 7f999594f700 1 -- 172.21.15.155:0/873477609 learned_addr learned my addr 172.21.15.155:0/873477609 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.266+0000 7f999594f700 1 -- 172.21.15.155:0/873477609 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56382ae5ab60 con 0x56382b1d7c00 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.266+0000 7f999594f700 1 --2- 172.21.15.155:0/873477609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x56382b274000 tx=0x56382b1781e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8b199dcc52aa46 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.266+0000 7f997c91d700 1 -- 172.21.15.155:0/873477609 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382aeeb760 con 0x56382b1d7c00 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.266+0000 7f997c91d700 1 -- 172.21.15.155:0/873477609 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56382b27e000 con 0x56382b1d7c00 2024-04-19T23:45:38.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.266+0000 7f997c91d700 1 -- 172.21.15.155:0/873477609 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382b26a160 con 0x56382b1d7c00 2024-04-19T23:45:38.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.266+0000 7f99981a6a80 1 -- 172.21.15.155:0/873477609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 msgr2=0x56382b11c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.266+0000 7f99981a6a80 1 --2- 172.21.15.155:0/873477609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x56382b274000 tx=0x56382b1781e0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f99981a6a80 1 -- 172.21.15.155:0/873477609 shutdown_connections 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f99981a6a80 1 --2- 172.21.15.155:0/873477609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f99981a6a80 1 -- 172.21.15.155:0/873477609 >> 172.21.15.155:0/873477609 conn(0x56382b1d7000 msgr2=0x56382af20000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f99981a6a80 1 -- 172.21.15.155:0/873477609 shutdown_connections 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f99981a6a80 1 -- 172.21.15.155:0/873477609 wait complete. 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f99981a6a80 1 Processor -- start 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f99981a6a80 1 -- start start 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f99981a6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f99981a6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56382aed4000 con 0x56382b1d7c00 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f999594f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f999594f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34742/0 (socket says 172.21.15.155:34742) 2024-04-19T23:45:38.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.267+0000 7f999594f700 1 -- 172.21.15.155:0/1288743048 learned_addr learned my addr 172.21.15.155:0/1288743048 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.268+0000 7f999594f700 1 -- 172.21.15.155:0/1288743048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56382ae5ad00 con 0x56382b1d7c00 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.268+0000 7f999594f700 1 --2- 172.21.15.155:0/1288743048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x56382b274210 tx=0x56382b179740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.268+0000 7f997b11a700 1 -- 172.21.15.155:0/1288743048 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382b26a2c0 con 0x56382b1d7c00 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.268+0000 7f997b11a700 1 -- 172.21.15.155:0/1288743048 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56382b27e180 con 0x56382b1d7c00 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.268+0000 7f99981a6a80 1 -- 172.21.15.155:0/1288743048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56382ae5a340 con 0x56382b1d7c00 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.268+0000 7f997b11a700 1 -- 172.21.15.155:0/1288743048 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56382b26a420 con 0x56382b1d7c00 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.268+0000 7f99981a6a80 1 -- 172.21.15.155:0/1288743048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56382ae5bd40 con 0x56382b1d7c00 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.269+0000 7f997b11a700 1 -- 172.21.15.155:0/1288743048 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56382bbd5b80 con 0x56382b1d7c00 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.269+0000 7f997b11a700 1 --2- 172.21.15.155:0/1288743048 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382b2fe000 0x56382b11d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.269+0000 7f997b11a700 1 -- 172.21.15.155:0/1288743048 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56382aead6c0 con 0x56382b1d7c00 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.269+0000 7f99981a6a80 5 note: GC not initialized 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.269+0000 7f9996951700 1 --2- 172.21.15.155:0/1288743048 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382b2fe000 0x56382b11d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.269+0000 7f9996951700 1 --2- 172.21.15.155:0/1288743048 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382b2fe000 0x56382b11d700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x56382b275e60 tx=0x56382b178900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.270+0000 7f9978915700 20 reqs_thread_entry: start 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.270+0000 7f99981a6a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.270+0000 7f99981a6a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.270+0000 7f9976911700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:08 2024 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.270+0000 7f99760ef700 20 reqs_thread_entry: start 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.270+0000 7f99981a6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.270+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e000 con 0x56382ae33c00 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.271+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.271+0000 7f99981a6a80 20 rados_obj.operate() r=0 bl.length=513 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:38.281 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [ 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "foo:foo1", 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: "permissions": "full-control" 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:38.282 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [ 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo:foo1", 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.283 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:38.284 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.271+0000 7f997d11e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.271+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94799242117120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25e800 con 0x56382ae33c00 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.272+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94799242117120] v30'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.272+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94799240698624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25ec00 con 0x56382b1d7800 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.273+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94799240698624] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.273+0000 7f99981a6a80 20 remove_watcher() i=0 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.273+0000 7f99981a6a80 2 removed watcher, disabling cache 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.273+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94799240699776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b25f000 con 0x56382ae33c00 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.274+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94799240699776] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.274+0000 7f99981a6a80 20 remove_watcher() i=1 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.274+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94799240700928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b2fe400 con 0x56382b1d7400 2024-04-19T23:45:38.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.275+0000 7f9996150700 1 -- 172.21.15.155:0/2716685707 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94799240700928] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b247200 con 0x56382b1d7400 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.275+0000 7f99981a6a80 20 remove_watcher() i=2 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.275+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94799240702080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b2fe800 con 0x56382b1d7800 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.276+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94799240702080] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b247440 con 0x56382b1d7800 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.276+0000 7f99981a6a80 20 remove_watcher() i=3 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.276+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94799240703232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b2fec00 con 0x56382ae33c00 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.277+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94799240703232] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382ae33c00 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.277+0000 7f99981a6a80 20 remove_watcher() i=4 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.277+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94799240704384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b2ff000 con 0x56382b1d6400 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.278+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94799240704384] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.278+0000 7f99981a6a80 20 remove_watcher() i=5 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.278+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94799240705536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b2ff400 con 0x56382b1d6400 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.279+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94799240705536] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.279+0000 7f99981a6a80 20 remove_watcher() i=6 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.279+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94799240706688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56382b2ff800 con 0x56382b1d6400 2024-04-19T23:45:38.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.280+0000 7f9996951700 1 -- 172.21.15.155:0/2716685707 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94799240706688] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56382b246b40 con 0x56382b1d6400 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.280+0000 7f99981a6a80 20 remove_watcher() i=7 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.280+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56382b1d6400 msgr2=0x56382b11d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.280+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56382b1d6400 0x56382b11d180 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.280+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56382ae33c00 msgr2=0x56382b11bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.280+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56382ae33c00 0x56382b11bb80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.280+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56382b1d7800 msgr2=0x56382b11cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.280+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56382b1d7800 0x56382b11cc00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.280+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56382b1d7400 msgr2=0x56382b11c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.280+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56382b1d7400 0x56382b11c100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.280+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382b1d6c00 msgr2=0x56382b11b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382b1d6c00 0x56382b11b600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x56382b115890 tx=0x56382af23800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 msgr2=0x56382b11ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x56382bcc4690 tx=0x56382b1788a0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f999594f700 1 -- 172.21.15.155:0/2716685707 reap_dead start 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 shutdown_connections 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2716685707 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae33800 0x56382b11ab00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 >> 172.21.15.155:0/2716685707 conn(0x56382ae32c00 msgr2=0x56382af1f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 shutdown_connections 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/2716685707 wait complete. 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/1288743048 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382b2fe000 msgr2=0x56382b11d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 --2- 172.21.15.155:0/1288743048 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382b2fe000 0x56382b11d700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x56382b275e60 tx=0x56382b178900 comp rx=0 tx=0).stop 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/1288743048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 msgr2=0x56382b11c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 --2- 172.21.15.155:0/1288743048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x56382b274210 tx=0x56382b179740 comp rx=0 tx=0).stop 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/1288743048 shutdown_connections 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 --2- 172.21.15.155:0/1288743048 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382b2fe000 0x56382b11d700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 --2- 172.21.15.155:0/1288743048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382b1d7c00 0x56382b11c680 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/1288743048 >> 172.21.15.155:0/1288743048 conn(0x56382b1d7000 msgr2=0x56382af20000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/1288743048 shutdown_connections 2024-04-19T23:45:38.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/1288743048 wait complete. 2024-04-19T23:45:38.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/2655521237 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382ae33400 msgr2=0x56382b11b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2655521237 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382ae33400 0x56382b11b080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x56382bcc48a0 tx=0x56382b178060 comp rx=0 tx=0).stop 2024-04-19T23:45:38.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/2655521237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 msgr2=0x56382b11a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2655521237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x56382bbf9a10 tx=0x56382af23a40 comp rx=0 tx=0).stop 2024-04-19T23:45:38.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/2655521237 shutdown_connections 2024-04-19T23:45:38.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2655521237 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56382ae33400 0x56382b11b080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 --2- 172.21.15.155:0/2655521237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56382ae32800 0x56382b11a580 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.281+0000 7f99981a6a80 1 -- 172.21.15.155:0/2655521237 >> 172.21.15.155:0/2655521237 conn(0x56382ae32400 msgr2=0x56382af1f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.282+0000 7f99981a6a80 1 -- 172.21.15.155:0/2655521237 shutdown_connections 2024-04-19T23:45:38.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.282+0000 7f99981a6a80 1 -- 172.21.15.155:0/2655521237 wait complete. 2024-04-19T23:45:38.295 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:38.295 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-19T23:45:38.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-19T23:45:38.295 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-04-19T23:45:38.344 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:38.344 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:38.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.345+0000 7f76e41d7a80 1 Processor -- start 2024-04-19T23:45:38.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.345+0000 7f76e41d7a80 1 -- start start 2024-04-19T23:45:38.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.345+0000 7f76e41d7a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5621965e0c00 0x5621968c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.345+0000 7f76e41d7a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56219690b500 con 0x5621965e0800 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.345+0000 7f76e41d7a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x562196682a00 con 0x5621965e0c00 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.345+0000 7f76e1980700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5621965e0c00 0x5621968c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.345+0000 7f76e2181700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5621965e0800 0x5621966cc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46602/0 (socket says 172.21.15.155:46602) 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.345+0000 7f76e1980700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5621965e0c00 0x5621968c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34752/0 (socket says 172.21.15.155:34752) 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.345+0000 7f76e2181700 1 -- 172.21.15.155:0/3454135467 learned_addr learned my addr 172.21.15.155:0/3454135467 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.345+0000 7f76e1980700 1 -- 172.21.15.155:0/3454135467 >> v1:172.21.15.76:6789/0 conn(0x5621965e0800 legacy=0x5621966cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.345+0000 7f76e1980700 1 -- 172.21.15.155:0/3454135467 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562196609d40 con 0x5621965e0c00 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.346+0000 7f76e1980700 1 --2- 172.21.15.155:0/3454135467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0c00 0x5621968c8580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5621968c3890 tx=0x5621966d1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe74dfe45c5e7cb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.346+0000 7f76e117f700 1 -- 172.21.15.155:0/3454135467 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5621966994a0 con 0x5621965e0c00 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.346+0000 7f76e117f700 1 -- 172.21.15.155:0/3454135467 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56219690b800 con 0x5621965e0c00 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.346+0000 7f76e117f700 1 -- 172.21.15.155:0/3454135467 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562196699600 con 0x5621965e0c00 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.346+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3454135467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0c00 msgr2=0x5621968c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.346+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/3454135467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0c00 0x5621968c8580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5621968c3890 tx=0x5621966d1920 comp rx=0 tx=0).stop 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.346+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3454135467 shutdown_connections 2024-04-19T23:45:38.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.346+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/3454135467 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0c00 0x5621968c8580 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.346+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3454135467 >> 172.21.15.155:0/3454135467 conn(0x5621965e0400 msgr2=0x5621966cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.346+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3454135467 shutdown_connections 2024-04-19T23:45:38.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.346+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3454135467 wait complete. 2024-04-19T23:45:38.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.347+0000 7f76e41d7a80 1 Processor -- start 2024-04-19T23:45:38.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.347+0000 7f76e41d7a80 1 -- start start 2024-04-19T23:45:38.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.347+0000 7f76e41d7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0800 0x5621968c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.347+0000 7f76e41d7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562196682500 con 0x5621965e0800 2024-04-19T23:45:38.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.347+0000 7f76e2181700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0800 0x5621968c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.347+0000 7f76e2181700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0800 0x5621968c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34758/0 (socket says 172.21.15.155:34758) 2024-04-19T23:45:38.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.347+0000 7f76e2181700 1 -- 172.21.15.155:0/3026823320 learned_addr learned my addr 172.21.15.155:0/3026823320 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.348+0000 7f76e2181700 1 -- 172.21.15.155:0/3026823320 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562196609ba0 con 0x5621965e0800 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.348+0000 7f76e2181700 1 --2- 172.21.15.155:0/3026823320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0800 0x5621968c8580 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5621973b9e00 tx=0x5621966d1b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8b80eac34f080e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.348+0000 7f76e097e700 1 -- 172.21.15.155:0/3026823320 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5621966991e0 con 0x5621965e0800 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.348+0000 7f76e097e700 1 -- 172.21.15.155:0/3026823320 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56219690bb00 con 0x5621965e0800 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.348+0000 7f76e097e700 1 -- 172.21.15.155:0/3026823320 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5621966994a0 con 0x5621965e0800 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.348+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3026823320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0800 msgr2=0x5621968c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.348+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/3026823320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0800 0x5621968c8580 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5621973b9e00 tx=0x5621966d1b60 comp rx=0 tx=0).stop 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3026823320 shutdown_connections 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/3026823320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0800 0x5621968c8580 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3026823320 >> 172.21.15.155:0/3026823320 conn(0x5621965e0400 msgr2=0x5621966cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3026823320 shutdown_connections 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3026823320 wait complete. 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e41d7a80 1 Processor -- start 2024-04-19T23:45:38.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e41d7a80 1 -- start start 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e41d7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0c00 0x5621968c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e41d7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621966823c0 con 0x5621965e0c00 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e2181700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0c00 0x5621968c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e2181700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0c00 0x5621968c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34768/0 (socket says 172.21.15.155:34768) 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e2181700 1 -- 172.21.15.155:0/3536482315 learned_addr learned my addr 172.21.15.155:0/3536482315 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.349+0000 7f76e2181700 1 -- 172.21.15.155:0/3536482315 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562196609a00 con 0x5621965e0c00 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.350+0000 7f76e2181700 1 --2- 172.21.15.155:0/3536482315 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0c00 0x5621968c8b00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5621973b9e60 tx=0x5621966d1a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.350+0000 7f76df17b700 1 -- 172.21.15.155:0/3536482315 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562196699600 con 0x5621965e0c00 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.350+0000 7f76df17b700 1 -- 172.21.15.155:0/3536482315 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562196681c80 con 0x5621965e0c00 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.350+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3536482315 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562196609860 con 0x5621965e0c00 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.350+0000 7f76df17b700 1 -- 172.21.15.155:0/3536482315 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5621966991e0 con 0x5621965e0c00 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.350+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3536482315 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621966096c0 con 0x5621965e0c00 2024-04-19T23:45:38.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.350+0000 7f76e41d7a80 1 Processor -- start 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.350+0000 7f76e41d7a80 1 -- start start 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76df17b700 1 -- 172.21.15.155:0/3536482315 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562197382b00 con 0x5621965e0c00 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76e41d7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 0x5621968c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76e41d7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56219661c640 con 0x5621965e1400 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76df17b700 1 --2- 172.21.15.155:0/3536482315 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5621965e1c00 0x5621968ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76df17b700 1 -- 172.21.15.155:0/3536482315 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56219665b180 con 0x5621965e0c00 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76e2982700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 0x5621968c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76e2982700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 0x5621968c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34780/0 (socket says 172.21.15.155:34780) 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76e2982700 1 -- 172.21.15.155:0/4142882759 learned_addr learned my addr 172.21.15.155:0/4142882759 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76e2181700 1 --2- 172.21.15.155:0/3536482315 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5621965e1c00 0x5621968ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76e2982700 1 -- 172.21.15.155:0/4142882759 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562196608000 con 0x5621965e1400 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76e2181700 1 --2- 172.21.15.155:0/3536482315 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5621965e1c00 0x5621968ca100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x562197473500 tx=0x56219692e240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76e2982700 1 --2- 172.21.15.155:0/4142882759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 0x5621968c9080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x562197472240 tx=0x56219692e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b148665b4b512bfd server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76dc976700 1 -- 172.21.15.155:0/4142882759 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562196699600 con 0x5621965e1400 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76dc976700 1 -- 172.21.15.155:0/4142882759 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56219690a300 con 0x5621965e1400 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.351+0000 7f76dc976700 1 -- 172.21.15.155:0/4142882759 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5621966991e0 con 0x5621965e1400 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e41d7a80 1 -- 172.21.15.155:0/4142882759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 msgr2=0x5621968c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/4142882759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 0x5621968c9080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x562197472240 tx=0x56219692e9c0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e41d7a80 1 -- 172.21.15.155:0/4142882759 shutdown_connections 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/4142882759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 0x5621968c9080 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e41d7a80 1 -- 172.21.15.155:0/4142882759 >> 172.21.15.155:0/4142882759 conn(0x5621965e1000 msgr2=0x5621966cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e41d7a80 1 -- 172.21.15.155:0/4142882759 shutdown_connections 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e41d7a80 1 -- 172.21.15.155:0/4142882759 wait complete. 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e41d7a80 1 Processor -- start 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e41d7a80 1 -- start start 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e41d7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 0x5621968c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e41d7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56219661c8c0 con 0x5621965e1400 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.352+0000 7f76e2982700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 0x5621968c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.353+0000 7f76e2982700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 0x5621968c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34784/0 (socket says 172.21.15.155:34784) 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.353+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 learned_addr learned my addr 172.21.15.155:0/2800032399 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.353+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562196608ea0 con 0x5621965e1400 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.353+0000 7f76e2982700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 0x5621968c9080 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5621974720f0 tx=0x56219692e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.353+0000 7f76db173700 1 -- 172.21.15.155:0/2800032399 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562196699a20 con 0x5621965e1400 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.353+0000 7f76db173700 1 -- 172.21.15.155:0/2800032399 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562196681c80 con 0x5621965e1400 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.353+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562196608820 con 0x5621965e1400 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.353+0000 7f76db173700 1 -- 172.21.15.155:0/2800032399 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562196699600 con 0x5621965e1400 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.353+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621966089c0 con 0x5621965e1400 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.354+0000 7f76db173700 1 -- 172.21.15.155:0/2800032399 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562197382dc0 con 0x5621965e1400 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.354+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.354+0000 7f76db173700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562196980800 0x5621968ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.354+0000 7f76db173700 1 -- 172.21.15.155:0/2800032399 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56219665b340 con 0x5621965e1400 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.354+0000 7f76e1980700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562196980800 0x5621968ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.354+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5621965e1800 0x5621968c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.354+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196980c00 con 0x5621965e1800 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.354+0000 7f76e2982700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5621965e1800 0x5621968c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.354+0000 7f76e1980700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562196980800 0x5621968ca680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5621968c3890 tx=0x5621966d1800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e2982700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5621965e1800 0x5621968c9600 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 20 realm 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196981000 con 0x5621965e1800 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196981400 con 0x5621965e1800 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196981800 con 0x5621965e1800 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.355+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.356+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196980c00 con 0x5621965e1800 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.356+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.356+0000 7f76e41d7a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.356+0000 7f76e41d7a80 20 searching for the correct realm 2024-04-19T23:45:38.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.356+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562196981000 0x5621968c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.356+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196981400 con 0x562196981000 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.356+0000 7f76e2181700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562196981000 0x5621968c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.356+0000 7f76e2181700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562196981000 0x5621968c9b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.357+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.357+0000 7f76e2181700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562196981400 0x5621968c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.357+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e000 con 0x562196981400 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.357+0000 7f76e1980700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562196981400 0x5621968c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.357+0000 7f76e1980700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562196981400 0x5621968c8580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.357+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.357+0000 7f76e1980700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56219747e000 0x5621968cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.357+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x56219747e000 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.358+0000 7f76e2982700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56219747e000 0x5621968cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.358+0000 7f76e2982700 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56219747e000 0x5621968cac00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.358+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.358+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x5621965e1800 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.358+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.358+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x5621965e1800 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.359+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.359+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x56219747e000 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.359+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.359+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x56219747e000 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.359+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.359+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981400 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.359+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.359+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981000 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.359+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.359+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x5621965e1800 2024-04-19T23:45:38.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.360+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.360+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x56219747e000 2024-04-19T23:45:38.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.360+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.360+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x5621965e1800 2024-04-19T23:45:38.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.360+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.360+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981400 2024-04-19T23:45:38.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.360+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.360+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981000 2024-04-19T23:45:38.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.361+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.361+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981000 2024-04-19T23:45:38.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.361+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.361+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x56219747e000 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.361+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.361+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981000 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.361+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.361+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981000 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.361+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.361+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x5621965e1800 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.362+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.362+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x5621965e1800 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.362+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.362+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x56219747e000 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.362+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.362+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981000 2024-04-19T23:45:38.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.362+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.362+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981400 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.362+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.362+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x5621965e1800 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.363+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.363+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x56219747e000 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.363+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.363+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981000 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.363+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.363+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x56219747e000 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.364+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.364+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981400 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.364+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.364+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981000 2024-04-19T23:45:38.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.364+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.364+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x56219747e000 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.364+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.364+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x5621965e1800 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981400 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196981c00 con 0x5621965e1800 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e800 con 0x5621965e1800 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.365+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747ec00 con 0x562196981400 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 20 zone default found 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 4 Realm: () 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 20 zonegroup default 2024-04-19T23:45:38.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747f000 con 0x56219747e000 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747f400 con 0x562196981000 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.366+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747f800 con 0x562196981000 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.367+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.367+0000 7f76e41d7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.367+0000 7f76e41d7a80 20 started sync module instance, tier type = 2024-04-19T23:45:38.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.367+0000 7f76e41d7a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.367+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747fc00 con 0x562196981400 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.368+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.368+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94702259665664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e400 con 0x562196981400 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.368+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747ec00 con 0x5621965e1800 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.369+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94702259665664] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.369+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.369+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94702259666816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747fc00 con 0x5621965e1800 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.369+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e800 con 0x562196981000 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.370+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94702259666816] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.373+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.373+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94702259667968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196981800 con 0x562196981000 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.373+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196980c00 con 0x562196981400 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.374+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.374+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94702259669120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196981c00 con 0x562196981400 2024-04-19T23:45:38.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.374+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747f400 con 0x5621965e1800 2024-04-19T23:45:38.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.375+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94702259669120] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.375+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94702259667968] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.378+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.378+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94702259670272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747f800 con 0x5621965e1800 2024-04-19T23:45:38.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.378+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e800 con 0x56219747e000 2024-04-19T23:45:38.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.381+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.381+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94702259671424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747f000 con 0x56219747e000 2024-04-19T23:45:38.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.381+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747ec00 con 0x56219747e000 2024-04-19T23:45:38.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.384+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94702259670272] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.387+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94702259671424] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.387+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.387+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94702259672576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747fc00 con 0x56219747e000 2024-04-19T23:45:38.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.387+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747f400 con 0x56219747e000 2024-04-19T23:45:38.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.390+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94702259672576] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.392+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.393+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94702259673728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747f800 con 0x56219747e000 2024-04-19T23:45:38.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.393+0000 7f76e41d7a80 20 add_watcher() i=0 2024-04-19T23:45:38.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.393+0000 7f76e41d7a80 20 add_watcher() i=1 2024-04-19T23:45:38.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.393+0000 7f76e41d7a80 20 add_watcher() i=2 2024-04-19T23:45:38.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.393+0000 7f76e41d7a80 20 add_watcher() i=3 2024-04-19T23:45:38.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.393+0000 7f76e41d7a80 20 add_watcher() i=4 2024-04-19T23:45:38.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.393+0000 7f76e41d7a80 20 add_watcher() i=5 2024-04-19T23:45:38.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.393+0000 7f76e41d7a80 20 add_watcher() i=6 2024-04-19T23:45:38.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.395+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94702259673728] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.395+0000 7f76e41d7a80 20 add_watcher() i=7 2024-04-19T23:45:38.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.395+0000 7f76e41d7a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:38.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.395+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747e800 con 0x5621965e1800 2024-04-19T23:45:38.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.395+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.395+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94702261223424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747f000 con 0x5621965e1800 2024-04-19T23:45:38.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.396+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94702261223424] v30'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.396+0000 7f76c914f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.397+0000 7f76e41d7a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:38.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.397+0000 7f76e41d7a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:38.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.397+0000 7f76e41d7a80 1 Processor -- start 2024-04-19T23:45:38.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.397+0000 7f76e41d7a80 1 -- start start 2024-04-19T23:45:38.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.397+0000 7f76e41d7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.397+0000 7f76e41d7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621966823c0 con 0x56219747fc00 2024-04-19T23:45:38.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.397+0000 7f76e1980700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.397+0000 7f76e1980700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34792/0 (socket says 172.21.15.155:34792) 2024-04-19T23:45:38.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.397+0000 7f76e1980700 1 -- 172.21.15.155:0/1055952484 learned_addr learned my addr 172.21.15.155:0/1055952484 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.398+0000 7f76e1980700 1 -- 172.21.15.155:0/1055952484 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562196608b60 con 0x56219747fc00 2024-04-19T23:45:38.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.398+0000 7f76e1980700 1 --2- 172.21.15.155:0/1055952484 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5621969cb410 tx=0x56219692f6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e53b8d1fc01ec9 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.398+0000 7f76c894e700 1 -- 172.21.15.155:0/1055952484 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562196699760 con 0x56219747fc00 2024-04-19T23:45:38.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.398+0000 7f76c894e700 1 -- 172.21.15.155:0/1055952484 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562196a54000 con 0x56219747fc00 2024-04-19T23:45:38.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.398+0000 7f76c894e700 1 -- 172.21.15.155:0/1055952484 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562196a56000 con 0x56219747fc00 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.398+0000 7f76e41d7a80 1 -- 172.21.15.155:0/1055952484 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 msgr2=0x5621968cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.398+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/1055952484 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5621969cb410 tx=0x56219692f6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.399+0000 7f76e41d7a80 1 -- 172.21.15.155:0/1055952484 shutdown_connections 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.399+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/1055952484 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.399+0000 7f76e41d7a80 1 -- 172.21.15.155:0/1055952484 >> 172.21.15.155:0/1055952484 conn(0x56219747ec00 msgr2=0x5621966ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.399+0000 7f76e41d7a80 1 -- 172.21.15.155:0/1055952484 shutdown_connections 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.399+0000 7f76e41d7a80 1 -- 172.21.15.155:0/1055952484 wait complete. 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.399+0000 7f76e41d7a80 1 Processor -- start 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.399+0000 7f76e41d7a80 1 -- start start 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.399+0000 7f76e41d7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.399+0000 7f76e41d7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562196682500 con 0x56219747fc00 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.400+0000 7f76e1980700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.400+0000 7f76e1980700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34794/0 (socket says 172.21.15.155:34794) 2024-04-19T23:45:38.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.400+0000 7f76e1980700 1 -- 172.21.15.155:0/2876366340 learned_addr learned my addr 172.21.15.155:0/2876366340 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.400+0000 7f76e1980700 1 -- 172.21.15.155:0/2876366340 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562196608d00 con 0x56219747fc00 2024-04-19T23:45:38.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.400+0000 7f76e1980700 1 --2- 172.21.15.155:0/2876366340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5621969cbad0 tx=0x56219692f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.400+0000 7f76c714b700 1 -- 172.21.15.155:0/2876366340 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562196a56160 con 0x56219747fc00 2024-04-19T23:45:38.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.400+0000 7f76c714b700 1 -- 172.21.15.155:0/2876366340 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562196a54180 con 0x56219747fc00 2024-04-19T23:45:38.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.400+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2876366340 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562196608340 con 0x56219747fc00 2024-04-19T23:45:38.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.400+0000 7f76c714b700 1 -- 172.21.15.155:0/2876366340 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562196a562c0 con 0x56219747fc00 2024-04-19T23:45:38.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.400+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2876366340 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562196609d40 con 0x56219747fc00 2024-04-19T23:45:38.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.401+0000 7f76c714b700 1 -- 172.21.15.155:0/2876366340 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562197383b80 con 0x56219747fc00 2024-04-19T23:45:38.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.401+0000 7f76c714b700 1 --2- 172.21.15.155:0/2876366340 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562196ace000 0x562196ad4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.401+0000 7f76c714b700 1 -- 172.21.15.155:0/2876366340 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56219665b500 con 0x56219747fc00 2024-04-19T23:45:38.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.401+0000 7f76e41d7a80 5 note: GC not initialized 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.401+0000 7f76e2982700 1 --2- 172.21.15.155:0/2876366340 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562196ace000 0x562196ad4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.401+0000 7f76e2982700 1 --2- 172.21.15.155:0/2876366340 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562196ace000 0x562196ad4000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x562196a41fb0 tx=0x56219692ea20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.402+0000 7f76c4946700 20 reqs_thread_entry: start 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.402+0000 7f76e41d7a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.402+0000 7f76e41d7a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.402+0000 7f76c2942700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:08 2024 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.402+0000 7f76c2120700 20 reqs_thread_entry: start 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.402+0000 7f76e41d7a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.402+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.402+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56219747f800 con 0x5621965e1800 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 20 rados_obj.operate() r=0 bl.length=513 2024-04-19T23:45:38.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196ace400 con 0x562196981400 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.403+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~621 in=621b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196acec00 con 0x5621965e1800 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.404+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~621] v30'8 uv8 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76e41d7a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76e41d7a80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76e41d7a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:38.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94702261225728 in=809b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196acf000 con 0x5621965e1800 2024-04-19T23:45:38.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94702259670272 notify 128849018887 ret 0) v3 ==== 839+0+0 (crc 0 0 0) 0x5621969d7d40 con 0x5621965e1800 2024-04-19T23:45:38.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(65 notify.4 [notify cookie 94702261225728 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76dc976700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94702259670272 notifier 4405 bl.length()=797 2024-04-19T23:45:38.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76dc976700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:38.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76dc976700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76dc976700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196b46000 con 0x5621965e1800 2024-04-19T23:45:38.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 94702261225728 notify 128849018887 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562196a97ba0 con 0x5621965e1800 2024-04-19T23:45:38.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.405+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196acf400 con 0x562196981400 2024-04-19T23:45:38.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76e41d7a80 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76e41d7a80 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76e41d7a80 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94702261225728 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196acf800 con 0x562196981400 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== watch-notify(notify (1) cookie 94702259665664 notify 128849018883 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x562196a95a00 con 0x562196981400 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76dc976700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94702259665664 notifier 4405 bl.length()=166 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76dc976700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76dc976700 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(68 notify.0 [notify cookie 94702261225728 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76dc976700 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196b46400 con 0x562196981400 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.407+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== watch-notify(notify_complete (2) cookie 94702261225728 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562196a93040 con 0x562196981400 2024-04-19T23:45:38.410 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [ 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "foo:foo1", 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: "permissions": "full-control" 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "foo:foo2", 2024-04-19T23:45:38.411 INFO:teuthology.orchestra.run.smithi155.stdout: "permissions": "" 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [ 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo:foo1", 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.412 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo:foo2", 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.413 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:38.414 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:38.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.408+0000 7f76c914f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.408+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94702261223424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196acfc00 con 0x5621965e1800 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.409+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94702261223424] v30'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.409+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94702259665664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196b46000 con 0x562196981400 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.410+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94702259665664] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.410+0000 7f76e41d7a80 20 remove_watcher() i=0 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.410+0000 7f76e41d7a80 2 removed watcher, disabling cache 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.410+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94702259666816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196acf000 con 0x5621965e1800 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.411+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94702259666816] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.411+0000 7f76e41d7a80 20 remove_watcher() i=1 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.411+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94702259667968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196b46800 con 0x562196981000 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.414+0000 7f76e2181700 1 -- 172.21.15.155:0/2800032399 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94702259667968] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a21200 con 0x562196981000 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.414+0000 7f76e41d7a80 20 remove_watcher() i=2 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.414+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94702259669120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196acec00 con 0x562196981400 2024-04-19T23:45:38.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.415+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94702259669120] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a21440 con 0x562196981400 2024-04-19T23:45:38.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.415+0000 7f76e41d7a80 20 remove_watcher() i=3 2024-04-19T23:45:38.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.415+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94702259670272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196ace800 con 0x5621965e1800 2024-04-19T23:45:38.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.416+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94702259670272] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x5621965e1800 2024-04-19T23:45:38.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.416+0000 7f76e41d7a80 20 remove_watcher() i=4 2024-04-19T23:45:38.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.416+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94702259671424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196acfc00 con 0x56219747e000 2024-04-19T23:45:38.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.418+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94702259671424] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.418+0000 7f76e41d7a80 20 remove_watcher() i=5 2024-04-19T23:45:38.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.418+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94702259672576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196ace400 con 0x56219747e000 2024-04-19T23:45:38.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.419+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94702259672576] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.419+0000 7f76e41d7a80 20 remove_watcher() i=6 2024-04-19T23:45:38.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.419+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94702259673728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562196acf400 con 0x56219747e000 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.419+0000 7f76e2982700 1 -- 172.21.15.155:0/2800032399 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94702259673728] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562196a20b40 con 0x56219747e000 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.419+0000 7f76e41d7a80 20 remove_watcher() i=7 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.419+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56219747e000 msgr2=0x5621968cac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.419+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56219747e000 0x5621968cac00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5621965e1800 msgr2=0x5621968c9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5621965e1800 0x5621968c9600 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562196981400 msgr2=0x5621968c8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562196981400 0x5621968c8580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562196981000 msgr2=0x5621968c9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562196981000 0x5621968c9b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562196980800 msgr2=0x5621968ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562196980800 0x5621968ca680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5621968c3890 tx=0x5621966d1800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 msgr2=0x5621968c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2800032399 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e1400 0x5621968c9080 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5621974720f0 tx=0x56219692e120 comp rx=0 tx=0).stop 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 reap_dead start 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e1980700 1 -- 172.21.15.155:0/2800032399 reap_dead start 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 shutdown_connections 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 >> 172.21.15.155:0/2800032399 conn(0x5621965e1000 msgr2=0x5621966cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 shutdown_connections 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2800032399 wait complete. 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2876366340 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562196ace000 msgr2=0x562196ad4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2876366340 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562196ace000 0x562196ad4000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x562196a41fb0 tx=0x56219692ea20 comp rx=0 tx=0).stop 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2876366340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 msgr2=0x5621968cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2876366340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5621969cbad0 tx=0x56219692f800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2876366340 shutdown_connections 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2876366340 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562196ace000 0x562196ad4000 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/2876366340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56219747fc00 0x5621968cb180 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2876366340 >> 172.21.15.155:0/2876366340 conn(0x56219747ec00 msgr2=0x5621966ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2876366340 shutdown_connections 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.420+0000 7f76e41d7a80 1 -- 172.21.15.155:0/2876366340 wait complete. 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.421+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3536482315 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5621965e1c00 msgr2=0x5621968ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.421+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/3536482315 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5621965e1c00 0x5621968ca100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x562197473500 tx=0x56219692e240 comp rx=0 tx=0).stop 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.421+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3536482315 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0c00 msgr2=0x5621968c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.421+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/3536482315 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0c00 0x5621968c8b00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5621973b9e60 tx=0x5621966d1a40 comp rx=0 tx=0).stop 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.421+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3536482315 shutdown_connections 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.421+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/3536482315 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5621965e1c00 0x5621968ca100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.421+0000 7f76e41d7a80 1 --2- 172.21.15.155:0/3536482315 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5621965e0c00 0x5621968c8b00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.421+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3536482315 >> 172.21.15.155:0/3536482315 conn(0x5621965e0400 msgr2=0x5621966cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.421+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3536482315 shutdown_connections 2024-04-19T23:45:38.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.421+0000 7f76e41d7a80 1 -- 172.21.15.155:0/3536482315 wait complete. 2024-04-19T23:45:38.425 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:38.425 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-19T23:45:38.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-19T23:45:38.426 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-19T23:45:38.471 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:38.471 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:38.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.472+0000 7fdfbe11da80 1 Processor -- start 2024-04-19T23:45:38.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.472+0000 7fdfbe11da80 1 -- start start 2024-04-19T23:45:38.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.472+0000 7fdfbe11da80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x562888ca6c00 0x562888f8e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.472+0000 7fdfbe11da80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562888fd1500 con 0x562888ca6800 2024-04-19T23:45:38.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.472+0000 7fdfbe11da80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x562888d48a00 con 0x562888ca6c00 2024-04-19T23:45:38.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.473+0000 7fdfbb8c6700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x562888ca6c00 0x562888f8e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.473+0000 7fdfbb8c6700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x562888ca6c00 0x562888f8e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34804/0 (socket says 172.21.15.155:34804) 2024-04-19T23:45:38.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.473+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3031441042 learned_addr learned my addr 172.21.15.155:0/3031441042 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.473+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3031441042 >> v1:172.21.15.76:6789/0 conn(0x562888ca6800 legacy=0x562888d92800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.473+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3031441042 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562888ccfd40 con 0x562888ca6c00 2024-04-19T23:45:38.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.473+0000 7fdfbb8c6700 1 --2- 172.21.15.155:0/3031441042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6c00 0x562888f8e580 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x562888f89890 tx=0x562888d97920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecb6868dd3d4df6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.473+0000 7fdfbb0c5700 1 -- 172.21.15.155:0/3031441042 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562888d5f4a0 con 0x562888ca6c00 2024-04-19T23:45:38.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.473+0000 7fdfbb0c5700 1 -- 172.21.15.155:0/3031441042 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562888fd1800 con 0x562888ca6c00 2024-04-19T23:45:38.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.473+0000 7fdfbb0c5700 1 -- 172.21.15.155:0/3031441042 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562888d5f600 con 0x562888ca6c00 2024-04-19T23:45:38.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.474+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3031441042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6c00 msgr2=0x562888f8e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.474+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/3031441042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6c00 0x562888f8e580 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x562888f89890 tx=0x562888d97920 comp rx=0 tx=0).stop 2024-04-19T23:45:38.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.474+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3031441042 shutdown_connections 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.474+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/3031441042 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6c00 0x562888f8e580 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.474+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3031441042 >> 172.21.15.155:0/3031441042 conn(0x562888ca6400 msgr2=0x562888d92000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.474+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3031441042 shutdown_connections 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.474+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3031441042 wait complete. 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.474+0000 7fdfbe11da80 1 Processor -- start 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.474+0000 7fdfbe11da80 1 -- start start 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.475+0000 7fdfbe11da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.475+0000 7fdfbe11da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562888d48500 con 0x562888ca6800 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.475+0000 7fdfbc0c7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.475+0000 7fdfbc0c7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34820/0 (socket says 172.21.15.155:34820) 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.475+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/4271004151 learned_addr learned my addr 172.21.15.155:0/4271004151 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.475+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/4271004151 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562888ccfba0 con 0x562888ca6800 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.475+0000 7fdfbc0c7700 1 --2- 172.21.15.155:0/4271004151 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x562889a71890 tx=0x562888d97b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c9ccabfa12df66 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.475+0000 7fdfba8c4700 1 -- 172.21.15.155:0/4271004151 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562888d5f1e0 con 0x562888ca6800 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.475+0000 7fdfba8c4700 1 -- 172.21.15.155:0/4271004151 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562888fd1b00 con 0x562888ca6800 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.475+0000 7fdfba8c4700 1 -- 172.21.15.155:0/4271004151 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562888d5f4a0 con 0x562888ca6800 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbe11da80 1 -- 172.21.15.155:0/4271004151 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 msgr2=0x562888f8e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/4271004151 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x562889a71890 tx=0x562888d97b60 comp rx=0 tx=0).stop 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbe11da80 1 -- 172.21.15.155:0/4271004151 shutdown_connections 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/4271004151 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbe11da80 1 -- 172.21.15.155:0/4271004151 >> 172.21.15.155:0/4271004151 conn(0x562888ca6400 msgr2=0x562888d93000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbe11da80 1 -- 172.21.15.155:0/4271004151 shutdown_connections 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbe11da80 1 -- 172.21.15.155:0/4271004151 wait complete. 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbe11da80 1 Processor -- start 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbe11da80 1 -- start start 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbe11da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbe11da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562888d483c0 con 0x562888ca6800 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbc0c7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbc0c7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34834/0 (socket says 172.21.15.155:34834) 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.476+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/646437260 learned_addr learned my addr 172.21.15.155:0/646437260 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.477+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/646437260 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562888ccfa00 con 0x562888ca6800 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.477+0000 7fdfbc0c7700 1 --2- 172.21.15.155:0/646437260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x562889a716b0 tx=0x562888d97a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.477+0000 7fdfb90c1700 1 -- 172.21.15.155:0/646437260 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562888d5f600 con 0x562888ca6800 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.477+0000 7fdfb90c1700 1 -- 172.21.15.155:0/646437260 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562888d47c80 con 0x562888ca6800 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.477+0000 7fdfbe11da80 1 -- 172.21.15.155:0/646437260 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562888ccf860 con 0x562888ca6800 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.477+0000 7fdfb90c1700 1 -- 172.21.15.155:0/646437260 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562888d5f1e0 con 0x562888ca6800 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.477+0000 7fdfbe11da80 1 -- 172.21.15.155:0/646437260 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562888ccf6c0 con 0x562888ca6800 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.477+0000 7fdfbe11da80 1 Processor -- start 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfbe11da80 1 -- start start 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfb90c1700 1 -- 172.21.15.155:0/646437260 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562889a48b00 con 0x562888ca6800 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfbe11da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 0x562888f8eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfbe11da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562888d48000 con 0x562888ca7400 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfb90c1700 1 --2- 172.21.15.155:0/646437260 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889034000 0x562888f8f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfbc8c8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 0x562888f8eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfbc8c8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 0x562888f8eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34848/0 (socket says 172.21.15.155:34848) 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/640605705 learned_addr learned my addr 172.21.15.155:0/640605705 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfb90c1700 1 -- 172.21.15.155:0/646437260 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x562888d21180 con 0x562888ca6800 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfbc0c7700 1 --2- 172.21.15.155:0/646437260 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889034000 0x562888f8f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/640605705 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562888cce000 con 0x562888ca7400 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfbc0c7700 1 --2- 172.21.15.155:0/646437260 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889034000 0x562888f8f080 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x562889b25020 tx=0x562888ffa240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfbc8c8700 1 --2- 172.21.15.155:0/640605705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 0x562888f8eb00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x562889b24870 tx=0x562888ffa0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c5ff7992f8c5a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfb68bc700 1 -- 172.21.15.155:0/640605705 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562888d5f600 con 0x562888ca7400 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfb68bc700 1 -- 172.21.15.155:0/640605705 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562888fd0300 con 0x562888ca7400 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.478+0000 7fdfb68bc700 1 -- 172.21.15.155:0/640605705 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562888d5f1e0 con 0x562888ca7400 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbe11da80 1 -- 172.21.15.155:0/640605705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 msgr2=0x562888f8eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/640605705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 0x562888f8eb00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x562889b24870 tx=0x562888ffa0c0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbe11da80 1 -- 172.21.15.155:0/640605705 shutdown_connections 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/640605705 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 0x562888f8eb00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbe11da80 1 -- 172.21.15.155:0/640605705 >> 172.21.15.155:0/640605705 conn(0x562888ca6c00 msgr2=0x562888d93800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbe11da80 1 -- 172.21.15.155:0/640605705 shutdown_connections 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbe11da80 1 -- 172.21.15.155:0/640605705 wait complete. 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbe11da80 1 Processor -- start 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbe11da80 1 -- start start 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbe11da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 0x562888f8eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbe11da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562888ce2640 con 0x562888ca7400 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbc8c8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 0x562888f8eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbc8c8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 0x562888f8eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34862/0 (socket says 172.21.15.155:34862) 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.479+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 learned_addr learned my addr 172.21.15.155:0/3468810511 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.480+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562888cceea0 con 0x562888ca7400 2024-04-19T23:45:38.485 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.480+0000 7fdfbc8c8700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 0x562888f8eb00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x562889b24990 tx=0x562888ffa840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.480+0000 7fdfb50b9700 1 -- 172.21.15.155:0/3468810511 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562888d5fa20 con 0x562888ca7400 2024-04-19T23:45:38.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.480+0000 7fdfb50b9700 1 -- 172.21.15.155:0/3468810511 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562888d47c80 con 0x562888ca7400 2024-04-19T23:45:38.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.480+0000 7fdfb50b9700 1 -- 172.21.15.155:0/3468810511 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562888d5f600 con 0x562888ca7400 2024-04-19T23:45:38.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.480+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562888cce820 con 0x562888ca7400 2024-04-19T23:45:38.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.480+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562888cce9c0 con 0x562888ca7400 2024-04-19T23:45:38.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.481+0000 7fdfb50b9700 1 -- 172.21.15.155:0/3468810511 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562889a48dc0 con 0x562888ca7400 2024-04-19T23:45:38.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.481+0000 7fdfb50b9700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889034c00 0x562888f8f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.481+0000 7fdfb50b9700 1 -- 172.21.15.155:0/3468810511 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x562888d21340 con 0x562888ca7400 2024-04-19T23:45:38.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.481+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.481+0000 7fdfbb8c6700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889034c00 0x562888f8f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.481+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562888ca7800 0x562888f8fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.481+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562888ca7c00 con 0x562888ca7800 2024-04-19T23:45:38.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.481+0000 7fdfbb8c6700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889034c00 0x562888f8f600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x562888f89890 tx=0x562888d97800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbc8c8700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562888ca7800 0x562888f8fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbc8c8700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562888ca7800 0x562888f8fb80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbe11da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbe11da80 20 realm 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889035000 con 0x562888ca7800 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbe11da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbe11da80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889035400 con 0x562888ca7800 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.482+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbe11da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889035800 con 0x562888ca7800 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbe11da80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889035c00 con 0x562888ca7800 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbe11da80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbe11da80 20 searching for the correct realm 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562889035000 0x562888f90100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889035400 con 0x562889035000 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbc0c7700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562889035000 0x562888f90100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.483+0000 7fdfbc0c7700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562889035000 0x562888f90100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.484+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.484+0000 7fdfbc0c7700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562889035400 0x562888f90c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.484+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2000 con 0x562889035400 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.484+0000 7fdfbb8c6700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562889035400 0x562888f90c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.484+0000 7fdfbb8c6700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562889035400 0x562888f90c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.484+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.484+0000 7fdfbb8c6700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5628890f2000 0x562888f91180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.484+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x5628890f2000 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.485+0000 7fdfbc8c8700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5628890f2000 0x562888f91180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.485+0000 7fdfbc8c8700 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5628890f2000 0x562888f91180 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.486+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.486+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562888ca7800 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.486+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.486+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562888ca7800 2024-04-19T23:45:38.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.486+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.486+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x5628890f2000 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.486+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.486+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x5628890f2000 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.486+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.486+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035400 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.487+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.487+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035000 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.487+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.487+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562888ca7800 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.487+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.487+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x5628890f2000 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.487+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.488+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562888ca7800 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.488+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.488+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035400 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.488+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.488+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035000 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.488+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.488+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035000 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.488+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.488+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x5628890f2000 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.489+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.489+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035000 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.489+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.489+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035000 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.489+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.489+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562888ca7800 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.489+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.489+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562888ca7800 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.489+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.489+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x5628890f2000 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.490+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.490+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035000 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.490+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.490+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035400 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.490+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.490+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562888ca7800 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.490+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.490+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x5628890f2000 2024-04-19T23:45:38.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.491+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.491+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035000 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.491+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.491+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x5628890f2000 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.491+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.491+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035400 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.492+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.492+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035000 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.492+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.492+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x5628890f2000 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.492+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.492+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562888ca7800 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.492+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.492+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035400 2024-04-19T23:45:38.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562888ca7c00 con 0x562888ca7800 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2c00 con 0x562888ca7800 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f3000 con 0x562889035400 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 zone default found 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 4 Realm: () 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 zonegroup default 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.493+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f3400 con 0x5628890f2000 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbe11da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f3800 con 0x562889035000 2024-04-19T23:45:38.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbe11da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f3c00 con 0x562889035000 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbe11da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbe11da80 20 started sync module instance, tier type = 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbe11da80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.494+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2c00 con 0x562889035400 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.495+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.495+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94732096658176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562888ca7c00 con 0x562889035400 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.495+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889035800 con 0x562888ca7800 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.496+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94732096658176] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.497+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.497+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94732096659328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889035c00 con 0x562888ca7800 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.497+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x562889035000 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.498+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94732096659328] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.498+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.498+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94732096660480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f3000 con 0x562889035000 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.498+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2c00 con 0x562889035400 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.499+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.499+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94732096661632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2400 con 0x562889035400 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.499+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f3800 con 0x562888ca7800 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.499+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94732096660480] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.500+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94732096661632] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.500+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.500+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94732096662784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f3c00 con 0x562888ca7800 2024-04-19T23:45:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.500+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f2800 con 0x5628890f2000 2024-04-19T23:45:38.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.501+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94732096662784] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.501+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.501+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94732096663936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f3400 con 0x5628890f2000 2024-04-19T23:45:38.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.501+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f3800 con 0x5628890f2000 2024-04-19T23:45:38.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.502+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94732096663936] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.503+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.503+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94732096665088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f3c00 con 0x5628890f2000 2024-04-19T23:45:38.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.503+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889035800 con 0x5628890f2000 2024-04-19T23:45:38.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.504+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94732096665088] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.504+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.504+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94732096666240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889035c00 con 0x5628890f2000 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.504+0000 7fdfbe11da80 20 add_watcher() i=0 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.504+0000 7fdfbe11da80 20 add_watcher() i=1 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.504+0000 7fdfbe11da80 20 add_watcher() i=2 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.504+0000 7fdfbe11da80 20 add_watcher() i=3 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.504+0000 7fdfbe11da80 20 add_watcher() i=4 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.504+0000 7fdfbe11da80 20 add_watcher() i=5 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.504+0000 7fdfbe11da80 20 add_watcher() i=6 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.505+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94732096666240] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.505+0000 7fdfbe11da80 20 add_watcher() i=7 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.505+0000 7fdfbe11da80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.505+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889035800 con 0x562888ca7800 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.505+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.505+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94732098224128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889035c00 con 0x562888ca7800 2024-04-19T23:45:38.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.506+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94732098224128] v30'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.506+0000 7fdfa3095700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.506+0000 7fdfbe11da80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.506+0000 7fdfbe11da80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.506+0000 7fdfbe11da80 1 Processor -- start 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.506+0000 7fdfbe11da80 1 -- start start 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.506+0000 7fdfbe11da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.507+0000 7fdfbe11da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562888ce2780 con 0x5628890f3400 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.507+0000 7fdfbb8c6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.507+0000 7fdfbb8c6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34872/0 (socket says 172.21.15.155:34872) 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.507+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/1043707776 learned_addr learned my addr 172.21.15.155:0/1043707776 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.507+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/1043707776 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562888cceb60 con 0x5628890f3400 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.507+0000 7fdfbb8c6700 1 --2- 172.21.15.155:0/1043707776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x56288902ef30 tx=0x562888ffb6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db2d3c3b80ff9c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.508+0000 7fdfa2894700 1 -- 172.21.15.155:0/1043707776 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562888d5f760 con 0x5628890f3400 2024-04-19T23:45:38.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.508+0000 7fdfa2894700 1 -- 172.21.15.155:0/1043707776 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562889116000 con 0x5628890f3400 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.508+0000 7fdfa2894700 1 -- 172.21.15.155:0/1043707776 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562889118000 con 0x5628890f3400 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.508+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1043707776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 msgr2=0x562888f90680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.508+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/1043707776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x56288902ef30 tx=0x562888ffb6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.508+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1043707776 shutdown_connections 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.508+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/1043707776 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.508+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1043707776 >> 172.21.15.155:0/1043707776 conn(0x5628890f2800 msgr2=0x562888d94000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.508+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1043707776 shutdown_connections 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.508+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1043707776 wait complete. 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.509+0000 7fdfbe11da80 1 Processor -- start 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.509+0000 7fdfbe11da80 1 -- start start 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.509+0000 7fdfbe11da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.509+0000 7fdfbe11da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562888d48000 con 0x5628890f3400 2024-04-19T23:45:38.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.509+0000 7fdfbb8c6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.509+0000 7fdfbb8c6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34884/0 (socket says 172.21.15.155:34884) 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.509+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/1302097186 learned_addr learned my addr 172.21.15.155:0/1302097186 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.509+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/1302097186 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562888cced00 con 0x5628890f3400 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.509+0000 7fdfbb8c6700 1 --2- 172.21.15.155:0/1302097186 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x562889114210 tx=0x562888ffb800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.509+0000 7fdfa1091700 1 -- 172.21.15.155:0/1302097186 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562889118160 con 0x5628890f3400 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.509+0000 7fdfa1091700 1 -- 172.21.15.155:0/1302097186 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562889116180 con 0x5628890f3400 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.510+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1302097186 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562888cce340 con 0x5628890f3400 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.510+0000 7fdfa1091700 1 -- 172.21.15.155:0/1302097186 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5628891182c0 con 0x5628890f3400 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.510+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1302097186 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562888ccfd40 con 0x5628890f3400 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.510+0000 7fdfa1091700 1 -- 172.21.15.155:0/1302097186 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562889a49b80 con 0x5628890f3400 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.510+0000 7fdfa1091700 1 --2- 172.21.15.155:0/1302097186 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889196000 0x562888f91700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.510+0000 7fdfa1091700 1 -- 172.21.15.155:0/1302097186 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x562888d21500 con 0x5628890f3400 2024-04-19T23:45:38.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.510+0000 7fdfbe11da80 5 note: GC not initialized 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.510+0000 7fdfbc8c8700 1 --2- 172.21.15.155:0/1302097186 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889196000 0x562888f91700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.511+0000 7fdfbc8c8700 1 --2- 172.21.15.155:0/1302097186 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889196000 0x562888f91700 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x56288908bf20 tx=0x562888ffb5c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.511+0000 7fdf9e88c700 20 reqs_thread_entry: start 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.511+0000 7fdfbe11da80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.511+0000 7fdfbe11da80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.511+0000 7fdf9c888700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:08 2024 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.512+0000 7fdf9c066700 20 reqs_thread_entry: start 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.512+0000 7fdfbe11da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.512+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5628890f3c00 con 0x562888ca7800 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.512+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.512+0000 7fdfbe11da80 20 rados_obj.operate() r=0 bl.length=621 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [ 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "foo:foo1", 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: "permissions": "full-control" 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "foo:foo2", 2024-04-19T23:45:38.524 INFO:teuthology.orchestra.run.smithi155.stdout: "permissions": "" 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [ 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo:foo1", 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.525 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo:foo2", 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.526 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:38.527 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.513+0000 7fdfa3095700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.513+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94732098224128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889196400 con 0x562888ca7800 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.514+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94732098224128] v30'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.514+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94732096658176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889196800 con 0x562889035400 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.515+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94732096658176] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.515+0000 7fdfbe11da80 20 remove_watcher() i=0 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.515+0000 7fdfbe11da80 2 removed watcher, disabling cache 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.515+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94732096659328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889196c00 con 0x562888ca7800 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.516+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94732096659328] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.516+0000 7fdfbe11da80 20 remove_watcher() i=1 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.516+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94732096660480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889197000 con 0x562889035000 2024-04-19T23:45:38.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.517+0000 7fdfbc0c7700 1 -- 172.21.15.155:0/3468810511 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94732096660480] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e7200 con 0x562889035000 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.517+0000 7fdfbe11da80 20 remove_watcher() i=2 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.517+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94732096661632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889197400 con 0x562889035400 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.518+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94732096661632] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e7440 con 0x562889035400 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.518+0000 7fdfbe11da80 20 remove_watcher() i=3 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.518+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94732096662784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889197800 con 0x562888ca7800 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.519+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94732096662784] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x562888ca7800 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.519+0000 7fdfbe11da80 20 remove_watcher() i=4 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.519+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94732096663936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889197c00 con 0x5628890f2000 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.521+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94732096663936] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.521+0000 7fdfbe11da80 20 remove_watcher() i=5 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.521+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94732096665088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889196400 con 0x5628890f2000 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.522+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94732096665088] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.522+0000 7fdfbe11da80 20 remove_watcher() i=6 2024-04-19T23:45:38.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.522+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94732096666240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562889196c00 con 0x5628890f2000 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbc8c8700 1 -- 172.21.15.155:0/3468810511 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94732096666240] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5628890e6b40 con 0x5628890f2000 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 20 remove_watcher() i=7 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5628890f2000 msgr2=0x562888f91180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5628890f2000 0x562888f91180 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562888ca7800 msgr2=0x562888f8fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562888ca7800 0x562888f8fb80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562889035400 msgr2=0x562888f90c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562889035400 0x562888f90c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562889035000 msgr2=0x562888f90100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562889035000 0x562888f90100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889034c00 msgr2=0x562888f8f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889034c00 0x562888f8f600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x562888f89890 tx=0x562888d97800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 msgr2=0x562888f8eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/3468810511 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca7400 0x562888f8eb00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x562889b24990 tx=0x562888ffa840 comp rx=0 tx=0).stop 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 reap_dead start 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbb8c6700 1 -- 172.21.15.155:0/3468810511 reap_dead start 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 shutdown_connections 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 >> 172.21.15.155:0/3468810511 conn(0x562888ca6c00 msgr2=0x562888d93800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 shutdown_connections 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/3468810511 wait complete. 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1302097186 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889196000 msgr2=0x562888f91700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/1302097186 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889196000 0x562888f91700 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x56288908bf20 tx=0x562888ffb5c0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1302097186 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 msgr2=0x562888f90680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/1302097186 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x562889114210 tx=0x562888ffb800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1302097186 shutdown_connections 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/1302097186 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889196000 0x562888f91700 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/1302097186 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5628890f3400 0x562888f90680 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1302097186 >> 172.21.15.155:0/1302097186 conn(0x5628890f2800 msgr2=0x562888d94000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1302097186 shutdown_connections 2024-04-19T23:45:38.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.523+0000 7fdfbe11da80 1 -- 172.21.15.155:0/1302097186 wait complete. 2024-04-19T23:45:38.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.524+0000 7fdfbe11da80 1 -- 172.21.15.155:0/646437260 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889034000 msgr2=0x562888f8f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.524+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/646437260 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889034000 0x562888f8f080 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x562889b25020 tx=0x562888ffa240 comp rx=0 tx=0).stop 2024-04-19T23:45:38.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.524+0000 7fdfbe11da80 1 -- 172.21.15.155:0/646437260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 msgr2=0x562888f8e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.524+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/646437260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x562889a716b0 tx=0x562888d97a40 comp rx=0 tx=0).stop 2024-04-19T23:45:38.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.524+0000 7fdfbe11da80 1 -- 172.21.15.155:0/646437260 shutdown_connections 2024-04-19T23:45:38.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.524+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/646437260 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562889034000 0x562888f8f080 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.524+0000 7fdfbe11da80 1 --2- 172.21.15.155:0/646437260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562888ca6800 0x562888f8e580 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.524+0000 7fdfbe11da80 1 -- 172.21.15.155:0/646437260 >> 172.21.15.155:0/646437260 conn(0x562888ca6400 msgr2=0x562888d93000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.524+0000 7fdfbe11da80 1 -- 172.21.15.155:0/646437260 shutdown_connections 2024-04-19T23:45:38.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.524+0000 7fdfbe11da80 1 -- 172.21.15.155:0/646437260 wait complete. 2024-04-19T23:45:38.537 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:38.538 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-19T23:45:38.538 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-19T23:45:38.538 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-04-19T23:45:38.585 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:38.585 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:38.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.586+0000 7ff816415a80 1 Processor -- start 2024-04-19T23:45:38.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.586+0000 7ff816415a80 1 -- start start 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.586+0000 7ff816415a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5583f54ba800 0x5583f57a2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.586+0000 7ff816415a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5583f57e5500 con 0x5583f54bac00 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.586+0000 7ff816415a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5583f555ca00 con 0x5583f54ba800 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.586+0000 7ff8143bf700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5583f54ba800 0x5583f57a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.586+0000 7ff813bbe700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5583f54bac00 0x5583f55a6800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46618/0 (socket says 172.21.15.155:46618) 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.586+0000 7ff813bbe700 1 -- 172.21.15.155:0/672257013 learned_addr learned my addr 172.21.15.155:0/672257013 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.587+0000 7ff8133bd700 1 -- 172.21.15.155:0/672257013 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234134652 0 0) 0x5583f6280000 con 0x5583f54bac00 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.587+0000 7ff8133bd700 1 -- 172.21.15.155:0/672257013 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5583f57e5680 con 0x5583f54bac00 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.587+0000 7ff8143bf700 1 -- 172.21.15.155:0/672257013 >> v1:172.21.15.76:6789/0 conn(0x5583f54bac00 legacy=0x5583f55a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.587+0000 7ff8143bf700 1 -- 172.21.15.155:0/672257013 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583f54e3d40 con 0x5583f54ba800 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.587+0000 7ff8143bf700 1 --2- 172.21.15.155:0/672257013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5583f579d9e0 tx=0x5583f55ab980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533a9e350de8364a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.587+0000 7ff8133bd700 1 -- 172.21.15.155:0/672257013 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f55734a0 con 0x5583f54ba800 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.587+0000 7ff8133bd700 1 -- 172.21.15.155:0/672257013 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583f57e5500 con 0x5583f54ba800 2024-04-19T23:45:38.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.587+0000 7ff8133bd700 1 -- 172.21.15.155:0/672257013 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f5573600 con 0x5583f54ba800 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.588+0000 7ff816415a80 1 -- 172.21.15.155:0/672257013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 msgr2=0x5583f57a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.588+0000 7ff816415a80 1 --2- 172.21.15.155:0/672257013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5583f579d9e0 tx=0x5583f55ab980 comp rx=0 tx=0).stop 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.588+0000 7ff816415a80 1 -- 172.21.15.155:0/672257013 shutdown_connections 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.588+0000 7ff816415a80 1 --2- 172.21.15.155:0/672257013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.588+0000 7ff816415a80 1 -- 172.21.15.155:0/672257013 >> 172.21.15.155:0/672257013 conn(0x5583f54ba400 msgr2=0x5583f55a6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.588+0000 7ff816415a80 1 -- 172.21.15.155:0/672257013 shutdown_connections 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.588+0000 7ff816415a80 1 -- 172.21.15.155:0/672257013 wait complete. 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.588+0000 7ff816415a80 1 Processor -- start 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.588+0000 7ff816415a80 1 -- start start 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.588+0000 7ff816415a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.588+0000 7ff816415a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583f555c500 con 0x5583f54ba800 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.589+0000 7ff8143bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.589+0000 7ff8143bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34912/0 (socket says 172.21.15.155:34912) 2024-04-19T23:45:38.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.589+0000 7ff8143bf700 1 -- 172.21.15.155:0/226103716 learned_addr learned my addr 172.21.15.155:0/226103716 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.589+0000 7ff8143bf700 1 -- 172.21.15.155:0/226103716 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583f54e3ba0 con 0x5583f54ba800 2024-04-19T23:45:38.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.589+0000 7ff8143bf700 1 --2- 172.21.15.155:0/226103716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5583f6283800 tx=0x5583f55ab800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6c3938e293227f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.589+0000 7ff812bbc700 1 -- 172.21.15.155:0/226103716 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f5573760 con 0x5583f54ba800 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.589+0000 7ff812bbc700 1 -- 172.21.15.155:0/226103716 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583f57e5980 con 0x5583f54ba800 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.589+0000 7ff812bbc700 1 -- 172.21.15.155:0/226103716 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f55734a0 con 0x5583f54ba800 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff816415a80 1 -- 172.21.15.155:0/226103716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 msgr2=0x5583f57a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff816415a80 1 --2- 172.21.15.155:0/226103716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5583f6283800 tx=0x5583f55ab800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff816415a80 1 -- 172.21.15.155:0/226103716 shutdown_connections 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff816415a80 1 --2- 172.21.15.155:0/226103716 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff816415a80 1 -- 172.21.15.155:0/226103716 >> 172.21.15.155:0/226103716 conn(0x5583f54ba400 msgr2=0x5583f55a7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff816415a80 1 -- 172.21.15.155:0/226103716 shutdown_connections 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff816415a80 1 -- 172.21.15.155:0/226103716 wait complete. 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff816415a80 1 Processor -- start 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff816415a80 1 -- start start 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff816415a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff816415a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583f555c3c0 con 0x5583f54ba800 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff8143bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff8143bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34928/0 (socket says 172.21.15.155:34928) 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff8143bf700 1 -- 172.21.15.155:0/3434255377 learned_addr learned my addr 172.21.15.155:0/3434255377 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.590+0000 7ff8143bf700 1 -- 172.21.15.155:0/3434255377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583f54e3a00 con 0x5583f54ba800 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.591+0000 7ff8143bf700 1 --2- 172.21.15.155:0/3434255377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5583f6283ec0 tx=0x5583f55ab980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.591+0000 7ff8113b9700 1 -- 172.21.15.155:0/3434255377 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f5573600 con 0x5583f54ba800 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.591+0000 7ff8113b9700 1 -- 172.21.15.155:0/3434255377 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583f57e5b00 con 0x5583f54ba800 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.591+0000 7ff816415a80 1 -- 172.21.15.155:0/3434255377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583f54e3860 con 0x5583f54ba800 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.591+0000 7ff8113b9700 1 -- 172.21.15.155:0/3434255377 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f55738c0 con 0x5583f54ba800 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.591+0000 7ff816415a80 1 -- 172.21.15.155:0/3434255377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583f54e36c0 con 0x5583f54ba800 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff8113b9700 1 -- 172.21.15.155:0/3434255377 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5583f625cb00 con 0x5583f54ba800 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff816415a80 1 Processor -- start 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff816415a80 1 -- start start 2024-04-19T23:45:38.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff8113b9700 1 --2- 172.21.15.155:0/3434255377 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f54bb400 0x5583f57a3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff8113b9700 1 -- 172.21.15.155:0/3434255377 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5583f5535180 con 0x5583f54ba800 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff816415a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 0x5583f57a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff816415a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583f54f6640 con 0x5583f54bb800 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff814bc0700 1 --2- 172.21.15.155:0/3434255377 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f54bb400 0x5583f57a3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff8143bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 0x5583f57a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff8143bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 0x5583f57a2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34940/0 (socket says 172.21.15.155:34940) 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff8143bf700 1 -- 172.21.15.155:0/1376770587 learned_addr learned my addr 172.21.15.155:0/1376770587 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff814bc0700 1 --2- 172.21.15.155:0/3434255377 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f54bb400 0x5583f57a3080 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5583f6283fb0 tx=0x5583f5802540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff8143bf700 1 -- 172.21.15.155:0/1376770587 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583f54e2000 con 0x5583f54bb800 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff8143bf700 1 --2- 172.21.15.155:0/1376770587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 0x5583f57a2b00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5583f633af90 tx=0x5583f58024e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4326258bee7734a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.592+0000 7ff80ebb4700 1 -- 172.21.15.155:0/1376770587 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f5573600 con 0x5583f54bb800 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff80ebb4700 1 -- 172.21.15.155:0/1376770587 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583f57e5b00 con 0x5583f54bb800 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff80ebb4700 1 -- 172.21.15.155:0/1376770587 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f55738c0 con 0x5583f54bb800 2024-04-19T23:45:38.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff816415a80 1 -- 172.21.15.155:0/1376770587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 msgr2=0x5583f57a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff816415a80 1 --2- 172.21.15.155:0/1376770587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 0x5583f57a2b00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5583f633af90 tx=0x5583f58024e0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff816415a80 1 -- 172.21.15.155:0/1376770587 shutdown_connections 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff816415a80 1 --2- 172.21.15.155:0/1376770587 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 0x5583f57a2b00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff816415a80 1 -- 172.21.15.155:0/1376770587 >> 172.21.15.155:0/1376770587 conn(0x5583f54bac00 msgr2=0x5583f55a7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff816415a80 1 -- 172.21.15.155:0/1376770587 shutdown_connections 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff816415a80 1 -- 172.21.15.155:0/1376770587 wait complete. 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff816415a80 1 Processor -- start 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff816415a80 1 -- start start 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff816415a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 0x5583f57a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.593+0000 7ff816415a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583f54f68c0 con 0x5583f54bb800 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.594+0000 7ff8143bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 0x5583f57a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.594+0000 7ff8143bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 0x5583f57a2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34946/0 (socket says 172.21.15.155:34946) 2024-04-19T23:45:38.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.594+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 learned_addr learned my addr 172.21.15.155:0/3103431909 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.594+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583f54e2ea0 con 0x5583f54bb800 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.594+0000 7ff8143bf700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 0x5583f57a2b00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5583f633a330 tx=0x5583f5802720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.594+0000 7ff80d3b1700 1 -- 172.21.15.155:0/3103431909 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f5573760 con 0x5583f54bb800 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.594+0000 7ff80d3b1700 1 -- 172.21.15.155:0/3103431909 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583f555be00 con 0x5583f54bb800 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.594+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583f54e2820 con 0x5583f54bb800 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.594+0000 7ff80d3b1700 1 -- 172.21.15.155:0/3103431909 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f55734a0 con 0x5583f54bb800 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.594+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583f54e29c0 con 0x5583f54bb800 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.595+0000 7ff80d3b1700 1 -- 172.21.15.155:0/3103431909 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5583f625cdc0 con 0x5583f54bb800 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.595+0000 7ff80d3b1700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f585ec00 0x5583f57a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.595+0000 7ff80d3b1700 1 -- 172.21.15.155:0/3103431909 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5583f5535340 con 0x5583f54bb800 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.595+0000 7ff813bbe700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f585ec00 0x5583f57a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.595+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.595+0000 7ff816415a80 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5583f54bbc00 0x5583f57a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585f000 con 0x5583f54bbc00 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff813bbe700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f585ec00 0x5583f57a3600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5583f6282030 tx=0x5583f58026c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff814bc0700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5583f54bbc00 0x5583f57a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff814bc0700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5583f54bbc00 0x5583f57a3b80 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff816415a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff816415a80 20 realm 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585f400 con 0x5583f54bbc00 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff816415a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff816415a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.596+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585f800 con 0x5583f54bbc00 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff816415a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585fc00 con 0x5583f54bbc00 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff816415a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585f000 con 0x5583f54bbc00 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff816415a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff816415a80 20 searching for the correct realm 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff816415a80 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5583f585f400 0x5583f57a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585f800 con 0x5583f585f400 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.597+0000 7ff8143bf700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5583f585f400 0x5583f57a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.598+0000 7ff8143bf700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5583f585f400 0x5583f57a4100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.598+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.598+0000 7ff8143bf700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5583f585f800 0x5583f57a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.598+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585e400 con 0x5583f585f800 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.598+0000 7ff813bbe700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5583f585f800 0x5583f57a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.599+0000 7ff813bbe700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5583f585f800 0x5583f57a4c00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.599+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.599+0000 7ff813bbe700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5583f585e400 0x5583f57a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.599+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585e400 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.599+0000 7ff814bc0700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5583f585e400 0x5583f57a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.599+0000 7ff814bc0700 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5583f585e400 0x5583f57a5180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.600+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.600+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f54bbc00 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.600+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.600+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f54bbc00 2024-04-19T23:45:38.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.600+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.600+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585e400 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.600+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.600+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585e400 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.601+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.601+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f800 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.601+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.601+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f400 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.601+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.601+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f54bbc00 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.601+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.601+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585e400 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.602+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.602+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f54bbc00 2024-04-19T23:45:38.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.602+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.602+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f800 2024-04-19T23:45:38.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.602+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.602+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f400 2024-04-19T23:45:38.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.602+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.602+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f400 2024-04-19T23:45:38.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.602+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.602+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585e400 2024-04-19T23:45:38.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.603+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.603+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f400 2024-04-19T23:45:38.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.603+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.603+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f400 2024-04-19T23:45:38.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.603+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.603+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f54bbc00 2024-04-19T23:45:38.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.603+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.604+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f54bbc00 2024-04-19T23:45:38.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.604+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.604+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585e400 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.604+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.604+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f400 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.604+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.604+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f800 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.605+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.605+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f54bbc00 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.605+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.605+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585e400 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.605+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.605+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f400 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.605+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.605+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585e400 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.606+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.606+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f800 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.606+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.606+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f400 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.606+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.606+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585e400 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.607+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.607+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f54bbc00 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.607+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.607+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f800 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:38.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585fc00 con 0x5583f54bbc00 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585f000 con 0x5583f54bbc00 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de400 con 0x5583f585f800 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:38.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 zone default found 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 4 Realm: () 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 zonegroup default 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.608+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de800 con 0x5583f585e400 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff816415a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58dec00 con 0x5583f585f400 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff816415a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58df000 con 0x5583f585f400 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff816415a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff816415a80 20 started sync module instance, tier type = 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff816415a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.609+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58df400 con 0x5583f585f800 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.610+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.610+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94025247464192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58df800 con 0x5583f585f800 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.610+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58dfc00 con 0x5583f54bbc00 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.611+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94025247464192] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.612+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.612+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94025247465344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de800 con 0x5583f54bbc00 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.612+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58dfc00 con 0x5583f585f400 2024-04-19T23:45:38.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.614+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.614+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94025247466496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585f400 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.614+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de400 con 0x5583f585f800 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.615+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94025247465344] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.615+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.615+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94025247467648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58df400 con 0x5583f585f800 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.615+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585fc00 con 0x5583f54bbc00 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.616+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94025247466496] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.617+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.617+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94025247468800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585f000 con 0x5583f54bbc00 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.617+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58dec00 con 0x5583f585e400 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.618+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94025247467648] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.618+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.618+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94025247469952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58df000 con 0x5583f585e400 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.618+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58dfc00 con 0x5583f585e400 2024-04-19T23:45:38.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.619+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94025247468800] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.619+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.619+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94025247469952] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.619+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94025247471104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585e400 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.619+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de800 con 0x5583f585e400 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.620+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94025247471104] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.621+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.621+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94025247472256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58dec00 con 0x5583f585e400 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.621+0000 7ff816415a80 20 add_watcher() i=0 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.621+0000 7ff816415a80 20 add_watcher() i=1 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.621+0000 7ff816415a80 20 add_watcher() i=2 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.621+0000 7ff816415a80 20 add_watcher() i=3 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.621+0000 7ff816415a80 20 add_watcher() i=4 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.621+0000 7ff816415a80 20 add_watcher() i=5 2024-04-19T23:45:38.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.621+0000 7ff816415a80 20 add_watcher() i=6 2024-04-19T23:45:38.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.622+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94025247472256] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.622+0000 7ff816415a80 20 add_watcher() i=7 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.622+0000 7ff816415a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.622+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58df000 con 0x5583f54bbc00 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.622+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.622+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94025248833536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f585fc00 con 0x5583f54bbc00 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.623+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94025248833536] v30'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.623+0000 7ff7fb38d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.623+0000 7ff816415a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.623+0000 7ff816415a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.624+0000 7ff816415a80 1 Processor -- start 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.624+0000 7ff816415a80 1 -- start start 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.624+0000 7ff816415a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.624+0000 7ff816415a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583f555c3c0 con 0x5583f585fc00 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.624+0000 7ff813bbe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.624+0000 7ff813bbe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34952/0 (socket says 172.21.15.155:34952) 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.624+0000 7ff813bbe700 1 -- 172.21.15.155:0/2525896491 learned_addr learned my addr 172.21.15.155:0/2525896491 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.624+0000 7ff813bbe700 1 -- 172.21.15.155:0/2525896491 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583f54e2b60 con 0x5583f585fc00 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.625+0000 7ff813bbe700 1 --2- 172.21.15.155:0/2525896491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5583f58f40c0 tx=0x5583f5803500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e52fa779a28e3fb server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.625+0000 7ff7fab8c700 1 -- 172.21.15.155:0/2525896491 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f58e6160 con 0x5583f585fc00 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.625+0000 7ff7fab8c700 1 -- 172.21.15.155:0/2525896491 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583f58fa180 con 0x5583f585fc00 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.625+0000 7ff7fab8c700 1 -- 172.21.15.155:0/2525896491 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f58e62c0 con 0x5583f585fc00 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.625+0000 7ff816415a80 1 -- 172.21.15.155:0/2525896491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 msgr2=0x5583f57a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.625+0000 7ff816415a80 1 --2- 172.21.15.155:0/2525896491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5583f58f40c0 tx=0x5583f5803500 comp rx=0 tx=0).stop 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.625+0000 7ff816415a80 1 -- 172.21.15.155:0/2525896491 shutdown_connections 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.625+0000 7ff816415a80 1 --2- 172.21.15.155:0/2525896491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.625+0000 7ff816415a80 1 -- 172.21.15.155:0/2525896491 >> 172.21.15.155:0/2525896491 conn(0x5583f585f000 msgr2=0x5583f55a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.625+0000 7ff816415a80 1 -- 172.21.15.155:0/2525896491 shutdown_connections 2024-04-19T23:45:38.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.625+0000 7ff816415a80 1 -- 172.21.15.155:0/2525896491 wait complete. 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.626+0000 7ff816415a80 1 Processor -- start 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.626+0000 7ff816415a80 1 -- start start 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.626+0000 7ff816415a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.626+0000 7ff816415a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583f555c500 con 0x5583f585fc00 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.626+0000 7ff813bbe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.626+0000 7ff813bbe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34962/0 (socket says 172.21.15.155:34962) 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.626+0000 7ff813bbe700 1 -- 172.21.15.155:0/719158639 learned_addr learned my addr 172.21.15.155:0/719158639 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.626+0000 7ff813bbe700 1 -- 172.21.15.155:0/719158639 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583f54e2d00 con 0x5583f585fc00 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.626+0000 7ff813bbe700 1 --2- 172.21.15.155:0/719158639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5583f58f42d0 tx=0x5583f5803620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.627+0000 7ff7f9389700 1 -- 172.21.15.155:0/719158639 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f58e6420 con 0x5583f585fc00 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.627+0000 7ff7f9389700 1 -- 172.21.15.155:0/719158639 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583f58fa300 con 0x5583f585fc00 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.627+0000 7ff816415a80 1 -- 172.21.15.155:0/719158639 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583f54e2340 con 0x5583f585fc00 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.627+0000 7ff7f9389700 1 -- 172.21.15.155:0/719158639 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5583f58e6160 con 0x5583f585fc00 2024-04-19T23:45:38.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.627+0000 7ff816415a80 1 -- 172.21.15.155:0/719158639 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583f54e2b60 con 0x5583f585fc00 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.627+0000 7ff7f9389700 1 -- 172.21.15.155:0/719158639 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5583f625db80 con 0x5583f585fc00 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.627+0000 7ff7f9389700 1 --2- 172.21.15.155:0/719158639 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f5988000 0x5583f57a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.628+0000 7ff7f9389700 1 -- 172.21.15.155:0/719158639 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5583f55356c0 con 0x5583f585fc00 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.628+0000 7ff816415a80 5 note: GC not initialized 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.628+0000 7ff814bc0700 1 --2- 172.21.15.155:0/719158639 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f5988000 0x5583f57a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.628+0000 7ff814bc0700 1 --2- 172.21.15.155:0/719158639 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f5988000 0x5583f57a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5583f58f5e30 tx=0x5583f5803380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.628+0000 7ff7f6b84700 20 reqs_thread_entry: start 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff816415a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff816415a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff7f4b80700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:09 2024 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff7f435e700 20 reqs_thread_entry: start 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff816415a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:38.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff816415a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f54bbc00 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff816415a80 20 rados_obj.operate() r=0 bl.length=621 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff816415a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff816415a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff816415a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.629+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~539 in=539b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58dec00 con 0x5583f54bbc00 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.630+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~539] v30'9 uv9 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff816415a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff816415a80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff816415a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94025248835840 in=727b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58df000 con 0x5583f54bbc00 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94025247468800 notify 128849018888 ret 0) v3 ==== 757+0+0 (crc 0 0 0) 0x5583f59ee000 con 0x5583f54bbc00 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff80ebb4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94025247468800 notifier 4421 bl.length()=715 2024-04-19T23:45:38.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff80ebb4700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff80ebb4700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff80ebb4700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f5988400 con 0x5583f54bbc00 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(64 notify.4 [notify cookie 94025248835840 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 94025248835840 notify 128849018888 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5583f59ee1a0 con 0x5583f54bbc00 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.631+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f5988c00 con 0x5583f54bbc00 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.632+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(66 foo:foo1 [delete] v30'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.632+0000 7ff816415a80 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.632+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94025248835840 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f5989000 con 0x5583f585f800 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.632+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== watch-notify(notify (1) cookie 94025247464192 notify 128849018884 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x5583f6351860 con 0x5583f585f800 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.632+0000 7ff80e3b3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94025247464192 notifier 4421 bl.length()=159 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.632+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.0 [notify cookie 94025248835840 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.632+0000 7ff80e3b3700 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f59f8000 con 0x5583f585f800 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.633+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.633+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== watch-notify(notify_complete (2) cookie 94025248835840 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5583f6351a00 con 0x5583f585f800 2024-04-19T23:45:38.642 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:38.642 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:38.642 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:38.642 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:38.642 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:38.642 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:38.642 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [ 2024-04-19T23:45:38.642 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.642 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "foo:foo1", 2024-04-19T23:45:38.642 INFO:teuthology.orchestra.run.smithi155.stdout: "permissions": "full-control" 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "foo:foo2", 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: "permissions": "" 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.643 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [ 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo:foo2", 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.633+0000 7ff7fb38d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.633+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94025248833536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f5989800 con 0x5583f54bbc00 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.634+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94025248833536] v30'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.634+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94025247464192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f5989c00 con 0x5583f585f800 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.635+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94025247464192] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.635+0000 7ff816415a80 20 remove_watcher() i=0 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.635+0000 7ff816415a80 2 removed watcher, disabling cache 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.635+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94025247465344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f5988400 con 0x5583f54bbc00 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.636+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94025247465344] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.636+0000 7ff816415a80 20 remove_watcher() i=1 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.636+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94025247466496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f5988c00 con 0x5583f585f400 2024-04-19T23:45:38.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.638+0000 7ff8143bf700 1 -- 172.21.15.155:0/3103431909 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94025247466496] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58cf200 con 0x5583f585f400 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.638+0000 7ff816415a80 20 remove_watcher() i=2 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.638+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94025247467648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f5989800 con 0x5583f585f800 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.639+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94025247467648] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58cf440 con 0x5583f585f800 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.639+0000 7ff816415a80 20 remove_watcher() i=3 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.639+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94025247468800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f5989400 con 0x5583f54bbc00 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.640+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94025247468800] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f54bbc00 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.640+0000 7ff816415a80 20 remove_watcher() i=4 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.640+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94025247469952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f5989000 con 0x5583f585e400 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.641+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94025247469952] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.641+0000 7ff816415a80 20 remove_watcher() i=5 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.641+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94025247471104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58de000 con 0x5583f585e400 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.642+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94025247471104] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.642+0000 7ff816415a80 20 remove_watcher() i=6 2024-04-19T23:45:38.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.642+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94025247472256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5583f58dec00 con 0x5583f585e400 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.642+0000 7ff814bc0700 1 -- 172.21.15.155:0/3103431909 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94025247472256] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5583f58ceb40 con 0x5583f585e400 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.642+0000 7ff816415a80 20 remove_watcher() i=7 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5583f585e400 msgr2=0x5583f57a5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5583f585e400 0x5583f57a5180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5583f54bbc00 msgr2=0x5583f57a3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5583f54bbc00 0x5583f57a3b80 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5583f585f800 msgr2=0x5583f57a4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5583f585f800 0x5583f57a4c00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5583f585f400 msgr2=0x5583f57a4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5583f585f400 0x5583f57a4100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f585ec00 msgr2=0x5583f57a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f585ec00 0x5583f57a3600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5583f6282030 tx=0x5583f58026c0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 msgr2=0x5583f57a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 --2- 172.21.15.155:0/3103431909 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54bb800 0x5583f57a2b00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5583f633a330 tx=0x5583f5802720 comp rx=0 tx=0).stop 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 reap_dead start 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 shutdown_connections 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff813bbe700 1 -- 172.21.15.155:0/3103431909 reap_dead start 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 >> 172.21.15.155:0/3103431909 conn(0x5583f54bac00 msgr2=0x5583f55a7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 shutdown_connections 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/3103431909 wait complete. 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/719158639 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f5988000 msgr2=0x5583f57a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 --2- 172.21.15.155:0/719158639 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f5988000 0x5583f57a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5583f58f5e30 tx=0x5583f5803380 comp rx=0 tx=0).stop 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/719158639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 msgr2=0x5583f57a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 --2- 172.21.15.155:0/719158639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5583f58f42d0 tx=0x5583f5803620 comp rx=0 tx=0).stop 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/719158639 shutdown_connections 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 --2- 172.21.15.155:0/719158639 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f5988000 0x5583f57a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 --2- 172.21.15.155:0/719158639 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f585fc00 0x5583f57a4680 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/719158639 >> 172.21.15.155:0/719158639 conn(0x5583f585f000 msgr2=0x5583f55a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/719158639 shutdown_connections 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.643+0000 7ff816415a80 1 -- 172.21.15.155:0/719158639 wait complete. 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.644+0000 7ff816415a80 1 -- 172.21.15.155:0/3434255377 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f54bb400 msgr2=0x5583f57a3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.644+0000 7ff816415a80 1 --2- 172.21.15.155:0/3434255377 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f54bb400 0x5583f57a3080 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5583f6283fb0 tx=0x5583f5802540 comp rx=0 tx=0).stop 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.644+0000 7ff816415a80 1 -- 172.21.15.155:0/3434255377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 msgr2=0x5583f57a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.644+0000 7ff816415a80 1 --2- 172.21.15.155:0/3434255377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5583f6283ec0 tx=0x5583f55ab980 comp rx=0 tx=0).stop 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.644+0000 7ff816415a80 1 -- 172.21.15.155:0/3434255377 shutdown_connections 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.644+0000 7ff816415a80 1 --2- 172.21.15.155:0/3434255377 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5583f54bb400 0x5583f57a3080 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.644+0000 7ff816415a80 1 --2- 172.21.15.155:0/3434255377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5583f54ba800 0x5583f57a2580 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.644+0000 7ff816415a80 1 -- 172.21.15.155:0/3434255377 >> 172.21.15.155:0/3434255377 conn(0x5583f54ba400 msgr2=0x5583f55a7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.644+0000 7ff816415a80 1 -- 172.21.15.155:0/3434255377 shutdown_connections 2024-04-19T23:45:38.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.644+0000 7ff816415a80 1 -- 172.21.15.155:0/3434255377 wait complete. 2024-04-19T23:45:38.655 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:38.656 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-19T23:45:38.656 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-19T23:45:38.656 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-04-19T23:45:38.701 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:38.701 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:38.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.702+0000 7ffbde1eda80 1 Processor -- start 2024-04-19T23:45:38.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.702+0000 7ffbde1eda80 1 -- start start 2024-04-19T23:45:38.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.702+0000 7ffbde1eda80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x558e5fc36c00 0x558e5ff1e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.702+0000 7ffbde1eda80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558e5ff61500 con 0x558e5fc36800 2024-04-19T23:45:38.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.702+0000 7ffbde1eda80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x558e5fcd8a00 con 0x558e5fc36c00 2024-04-19T23:45:38.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.703+0000 7ffbdb996700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x558e5fc36c00 0x558e5ff1e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.703+0000 7ffbdc197700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x558e5fc36800 0x558e5fd22800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46626/0 (socket says 172.21.15.155:46626) 2024-04-19T23:45:38.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.703+0000 7ffbdc197700 1 -- 172.21.15.155:0/741188032 learned_addr learned my addr 172.21.15.155:0/741188032 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:38.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.703+0000 7ffbdb996700 1 -- 172.21.15.155:0/741188032 >> v1:172.21.15.76:6789/0 conn(0x558e5fc36800 legacy=0x558e5fd22800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.703+0000 7ffbdb996700 1 -- 172.21.15.155:0/741188032 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e5fc5fd40 con 0x558e5fc36c00 2024-04-19T23:45:38.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.703+0000 7ffbdb195700 1 -- 172.21.15.155:0/741188032 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842880006 0 0) 0x558e60a04000 con 0x558e5fc36800 2024-04-19T23:45:38.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.703+0000 7ffbdb996700 1 --2- 172.21.15.155:0/741188032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36c00 0x558e5ff1e580 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x558e5ff19890 tx=0x558e5fd27920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2c2bcbeb2fd288 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.703+0000 7ffbdb195700 1 -- 172.21.15.155:0/741188032 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e5fcef4a0 con 0x558e5fc36c00 2024-04-19T23:45:38.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.703+0000 7ffbdb195700 1 -- 172.21.15.155:0/741188032 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e5ff61800 con 0x558e5fc36c00 2024-04-19T23:45:38.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.703+0000 7ffbdb195700 1 -- 172.21.15.155:0/741188032 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e5fcef600 con 0x558e5fc36c00 2024-04-19T23:45:38.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.704+0000 7ffbde1eda80 1 -- 172.21.15.155:0/741188032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36c00 msgr2=0x558e5ff1e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.704+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/741188032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36c00 0x558e5ff1e580 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x558e5ff19890 tx=0x558e5fd27920 comp rx=0 tx=0).stop 2024-04-19T23:45:38.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.704+0000 7ffbde1eda80 1 -- 172.21.15.155:0/741188032 shutdown_connections 2024-04-19T23:45:38.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.704+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/741188032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36c00 0x558e5ff1e580 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.704+0000 7ffbde1eda80 1 -- 172.21.15.155:0/741188032 >> 172.21.15.155:0/741188032 conn(0x558e5fc36400 msgr2=0x558e5fd22000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.704+0000 7ffbde1eda80 1 -- 172.21.15.155:0/741188032 shutdown_connections 2024-04-19T23:45:38.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.704+0000 7ffbde1eda80 1 -- 172.21.15.155:0/741188032 wait complete. 2024-04-19T23:45:38.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.704+0000 7ffbde1eda80 1 Processor -- start 2024-04-19T23:45:38.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.704+0000 7ffbde1eda80 1 -- start start 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.705+0000 7ffbde1eda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.705+0000 7ffbde1eda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5fcd8500 con 0x558e5fc36800 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.705+0000 7ffbdc197700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.705+0000 7ffbdc197700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34988/0 (socket says 172.21.15.155:34988) 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.705+0000 7ffbdc197700 1 -- 172.21.15.155:0/317802002 learned_addr learned my addr 172.21.15.155:0/317802002 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.705+0000 7ffbdc197700 1 -- 172.21.15.155:0/317802002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e5fc5fba0 con 0x558e5fc36800 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.705+0000 7ffbdc197700 1 --2- 172.21.15.155:0/317802002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x558e60a07770 tx=0x558e5fd27b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359737cadf43bbf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.705+0000 7ffbda994700 1 -- 172.21.15.155:0/317802002 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e5fcef4a0 con 0x558e5fc36800 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.705+0000 7ffbda994700 1 -- 172.21.15.155:0/317802002 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e5ff61b00 con 0x558e5fc36800 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.705+0000 7ffbda994700 1 -- 172.21.15.155:0/317802002 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e5fcef600 con 0x558e5fc36800 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbde1eda80 1 -- 172.21.15.155:0/317802002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 msgr2=0x558e5ff1e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/317802002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x558e60a07770 tx=0x558e5fd27b60 comp rx=0 tx=0).stop 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbde1eda80 1 -- 172.21.15.155:0/317802002 shutdown_connections 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/317802002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbde1eda80 1 -- 172.21.15.155:0/317802002 >> 172.21.15.155:0/317802002 conn(0x558e5fc36400 msgr2=0x558e5fd23000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbde1eda80 1 -- 172.21.15.155:0/317802002 shutdown_connections 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbde1eda80 1 -- 172.21.15.155:0/317802002 wait complete. 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbde1eda80 1 Processor -- start 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbde1eda80 1 -- start start 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbde1eda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbde1eda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5fcd83c0 con 0x558e5fc36800 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbdc197700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbdc197700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35000/0 (socket says 172.21.15.155:35000) 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.706+0000 7ffbdc197700 1 -- 172.21.15.155:0/724582435 learned_addr learned my addr 172.21.15.155:0/724582435 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.707+0000 7ffbdc197700 1 -- 172.21.15.155:0/724582435 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e5fc5fa00 con 0x558e5fc36800 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.707+0000 7ffbdc197700 1 --2- 172.21.15.155:0/724582435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x558e60a07e30 tx=0x558e5fd27a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.707+0000 7ffbd9191700 1 -- 172.21.15.155:0/724582435 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e5fcef8c0 con 0x558e5fc36800 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.707+0000 7ffbd9191700 1 -- 172.21.15.155:0/724582435 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e5fcd7c80 con 0x558e5fc36800 2024-04-19T23:45:38.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.707+0000 7ffbde1eda80 1 -- 172.21.15.155:0/724582435 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e5fc5f860 con 0x558e5fc36800 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.707+0000 7ffbd9191700 1 -- 172.21.15.155:0/724582435 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e5fcef4a0 con 0x558e5fc36800 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.707+0000 7ffbde1eda80 1 -- 172.21.15.155:0/724582435 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e5fc5f6c0 con 0x558e5fc36800 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.707+0000 7ffbde1eda80 1 Processor -- start 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbde1eda80 1 -- start start 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbde1eda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbde1eda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5fc72640 con 0x558e5fc37400 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbd9191700 1 -- 172.21.15.155:0/724582435 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558e609d8b00 con 0x558e5fc36800 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbdc998700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbdc998700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35008/0 (socket says 172.21.15.155:35008) 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbdc998700 1 -- 172.21.15.155:0/1532425759 learned_addr learned my addr 172.21.15.155:0/1532425759 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbd9191700 1 --2- 172.21.15.155:0/724582435 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e5ffc0000 0x558e5ff1f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbd9191700 1 -- 172.21.15.155:0/724582435 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558e5fcb1180 con 0x558e5fc36800 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbdc197700 1 --2- 172.21.15.155:0/724582435 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e5ffc0000 0x558e5ff1f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbdc998700 1 -- 172.21.15.155:0/1532425759 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e5fc5e000 con 0x558e5fc37400 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbdc197700 1 --2- 172.21.15.155:0/724582435 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e5ffc0000 0x558e5ff1f080 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x558e60ac8f30 tx=0x558e5ff88240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbdc998700 1 --2- 172.21.15.155:0/1532425759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x558e60ac9b60 tx=0x558e5ff88120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54309bf13614b83 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbd698c700 1 -- 172.21.15.155:0/1532425759 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e5fcef8c0 con 0x558e5fc37400 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.708+0000 7ffbd698c700 1 -- 172.21.15.155:0/1532425759 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e5ff60300 con 0x558e5fc37400 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbd698c700 1 -- 172.21.15.155:0/1532425759 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e5fcef4a0 con 0x558e5fc37400 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbde1eda80 1 -- 172.21.15.155:0/1532425759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 msgr2=0x558e5ff1eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/1532425759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x558e60ac9b60 tx=0x558e5ff88120 comp rx=0 tx=0).stop 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbde1eda80 1 -- 172.21.15.155:0/1532425759 shutdown_connections 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/1532425759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbde1eda80 1 -- 172.21.15.155:0/1532425759 >> 172.21.15.155:0/1532425759 conn(0x558e5fc36c00 msgr2=0x558e5fd23800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbde1eda80 1 -- 172.21.15.155:0/1532425759 shutdown_connections 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbde1eda80 1 -- 172.21.15.155:0/1532425759 wait complete. 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbde1eda80 1 Processor -- start 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbde1eda80 1 -- start start 2024-04-19T23:45:38.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbde1eda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbde1eda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5fc728c0 con 0x558e5fc37400 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.709+0000 7ffbdc998700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.710+0000 7ffbdc998700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35014/0 (socket says 172.21.15.155:35014) 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.710+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 learned_addr learned my addr 172.21.15.155:0/171639971 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.710+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e5fc5eea0 con 0x558e5fc37400 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.710+0000 7ffbdc998700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x558e60a07f50 tx=0x558e5ff888a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.710+0000 7ffbd5189700 1 -- 172.21.15.155:0/171639971 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e5fcefb80 con 0x558e5fc37400 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.710+0000 7ffbd5189700 1 -- 172.21.15.155:0/171639971 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e5fcd7c80 con 0x558e5fc37400 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.710+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e5fc5e820 con 0x558e5fc37400 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.710+0000 7ffbd5189700 1 -- 172.21.15.155:0/171639971 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e5fcef8c0 con 0x558e5fc37400 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.710+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e5fc5e9c0 con 0x558e5fc37400 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.711+0000 7ffbd5189700 1 -- 172.21.15.155:0/171639971 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558e609d8dc0 con 0x558e5fc37400 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.711+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.711+0000 7ffbd5189700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e5ffc0c00 0x558e5ff1f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.711+0000 7ffbd5189700 1 -- 172.21.15.155:0/171639971 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558e5fcb1340 con 0x558e5fc37400 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.711+0000 7ffbdb996700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e5ffc0c00 0x558e5ff1f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.711+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558e5fc37800 0x558e5ff1fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.711+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5fc37c00 con 0x558e5fc37800 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.711+0000 7ffbdc998700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558e5fc37800 0x558e5ff1fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.711+0000 7ffbdb996700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e5ffc0c00 0x558e5ff1f600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x558e5ff19890 tx=0x558e5fd27800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbdc998700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558e5fc37800 0x558e5ff1fb80 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbde1eda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbde1eda80 20 realm 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5ffc1000 con 0x558e5fc37800 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbde1eda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbde1eda80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5ffc1400 con 0x558e5fc37800 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbde1eda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.712+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5ffc1800 con 0x558e5fc37800 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.713+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.713+0000 7ffbde1eda80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.713+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.713+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5ffc1c00 con 0x558e5fc37800 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.713+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.713+0000 7ffbde1eda80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.713+0000 7ffbde1eda80 20 searching for the correct realm 2024-04-19T23:45:38.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.713+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558e5ffc1000 0x558e5ff20100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.713+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5ffc1400 con 0x558e5ffc1000 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.713+0000 7ffbdc197700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558e5ffc1000 0x558e5ff20100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.713+0000 7ffbdc197700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558e5ffc1000 0x558e5ff20100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.714+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.714+0000 7ffbdc197700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558e5ffc1400 0x558e5ff20c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.714+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e000 con 0x558e5ffc1400 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.714+0000 7ffbdb996700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558e5ffc1400 0x558e5ff20c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.714+0000 7ffbdb996700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558e5ffc1400 0x558e5ff20c00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.714+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.714+0000 7ffbdb996700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558e6007e000 0x558e5ff21180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.714+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e6007e000 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.715+0000 7ffbdc998700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558e6007e000 0x558e5ff21180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.715+0000 7ffbdc998700 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558e6007e000 0x558e5ff21180 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.715+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.715+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5fc37800 2024-04-19T23:45:38.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.715+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.715+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5fc37800 2024-04-19T23:45:38.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.716+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.716+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e6007e000 2024-04-19T23:45:38.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.716+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.716+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e6007e000 2024-04-19T23:45:38.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.716+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.716+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1400 2024-04-19T23:45:38.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.716+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.716+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1000 2024-04-19T23:45:38.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.717+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.717+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5fc37800 2024-04-19T23:45:38.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.717+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.717+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e6007e000 2024-04-19T23:45:38.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.717+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.717+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5fc37800 2024-04-19T23:45:38.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.717+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.717+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1400 2024-04-19T23:45:38.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.717+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.718+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1000 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.718+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.718+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1000 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.718+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.718+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e6007e000 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.718+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.718+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1000 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.719+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.719+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1000 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.719+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.719+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5fc37800 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.719+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.719+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5fc37800 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.719+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.719+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e6007e000 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.720+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.720+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1000 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.720+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.720+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1400 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.720+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.720+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5fc37800 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.720+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.720+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e6007e000 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.721+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.721+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1000 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.721+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.721+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e6007e000 2024-04-19T23:45:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.721+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.721+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1400 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.722+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.722+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1000 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.722+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.722+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e6007e000 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.722+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.722+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5fc37800 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1400 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5fc37c00 con 0x558e5fc37800 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007ec00 con 0x558e5fc37800 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.723+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007f000 con 0x558e5ffc1400 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 20 zone default found 2024-04-19T23:45:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 4 Realm: () 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 20 zonegroup default 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007f400 con 0x558e6007e000 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007f800 con 0x558e5ffc1000 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.724+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007fc00 con 0x558e5ffc1000 2024-04-19T23:45:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.725+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.725+0000 7ffbde1eda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.725+0000 7ffbde1eda80 20 started sync module instance, tier type = 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.725+0000 7ffbde1eda80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.725+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007ec00 con 0x558e5ffc1400 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.726+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.726+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069983369984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5fc37c00 con 0x558e5ffc1400 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.726+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5ffc1800 con 0x558e5fc37800 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.727+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94069983369984] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.727+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.727+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94069983371136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5ffc1c00 con 0x558e5fc37800 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.727+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e5ffc1000 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.728+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94069983371136] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.729+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.729+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94069983372288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007f000 con 0x558e5ffc1000 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.729+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007ec00 con 0x558e5ffc1400 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.730+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94069983372288] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.730+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.730+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94069983373440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e400 con 0x558e5ffc1400 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.730+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007f800 con 0x558e5fc37800 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.731+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.731+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069983374592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007fc00 con 0x558e5fc37800 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.731+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007e800 con 0x558e6007e000 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.731+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94069983373440] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.732+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.732+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069983375744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007f400 con 0x558e6007e000 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.732+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007f800 con 0x558e6007e000 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.732+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94069983374592] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.733+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94069983375744] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.733+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.733+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94069983376896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007fc00 con 0x558e6007e000 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.733+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5ffc1800 con 0x558e6007e000 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.734+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94069983376896] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.734+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.734+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069983378048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5ffc1c00 con 0x558e6007e000 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.734+0000 7ffbde1eda80 20 add_watcher() i=0 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.734+0000 7ffbde1eda80 20 add_watcher() i=1 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.734+0000 7ffbde1eda80 20 add_watcher() i=2 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.734+0000 7ffbde1eda80 20 add_watcher() i=3 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.734+0000 7ffbde1eda80 20 add_watcher() i=4 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.734+0000 7ffbde1eda80 20 add_watcher() i=5 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.734+0000 7ffbde1eda80 20 add_watcher() i=6 2024-04-19T23:45:38.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.735+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94069983378048] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.735+0000 7ffbde1eda80 20 add_watcher() i=7 2024-04-19T23:45:38.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.735+0000 7ffbde1eda80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:38.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.735+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5ffc1800 con 0x558e5fc37800 2024-04-19T23:45:38.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.735+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.735+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94069984911360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e5ffc1c00 con 0x558e5fc37800 2024-04-19T23:45:38.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.736+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94069984911360] v30'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.736+0000 7ffbc3165700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.737+0000 7ffbde1eda80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.737+0000 7ffbde1eda80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.737+0000 7ffbde1eda80 1 Processor -- start 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.737+0000 7ffbde1eda80 1 -- start start 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.737+0000 7ffbde1eda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.737+0000 7ffbde1eda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5fcd83c0 con 0x558e6007f400 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.737+0000 7ffbdb996700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.737+0000 7ffbdb996700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35020/0 (socket says 172.21.15.155:35020) 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.737+0000 7ffbdb996700 1 -- 172.21.15.155:0/3792739534 learned_addr learned my addr 172.21.15.155:0/3792739534 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.737+0000 7ffbdb996700 1 -- 172.21.15.155:0/3792739534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e5fc5eb60 con 0x558e6007f400 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.738+0000 7ffbdb996700 1 --2- 172.21.15.155:0/3792739534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x558e5ffc6d50 tx=0x558e5ff896e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876746c8fd15a789 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.738+0000 7ffbc2964700 1 -- 172.21.15.155:0/3792739534 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e5fcef760 con 0x558e6007f400 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.738+0000 7ffbc2964700 1 -- 172.21.15.155:0/3792739534 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e600a6000 con 0x558e6007f400 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.738+0000 7ffbc2964700 1 -- 172.21.15.155:0/3792739534 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e600a8000 con 0x558e6007f400 2024-04-19T23:45:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.738+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3792739534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 msgr2=0x558e5ff20680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.738+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/3792739534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x558e5ffc6d50 tx=0x558e5ff896e0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.738+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3792739534 shutdown_connections 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.738+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/3792739534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.738+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3792739534 >> 172.21.15.155:0/3792739534 conn(0x558e6007e800 msgr2=0x558e5fd24000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.738+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3792739534 shutdown_connections 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.738+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3792739534 wait complete. 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.739+0000 7ffbde1eda80 1 Processor -- start 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.739+0000 7ffbde1eda80 1 -- start start 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.739+0000 7ffbde1eda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.739+0000 7ffbde1eda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5fcd8500 con 0x558e6007f400 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.739+0000 7ffbdb996700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.739+0000 7ffbdb996700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35026/0 (socket says 172.21.15.155:35026) 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.739+0000 7ffbdb996700 1 -- 172.21.15.155:0/3318007423 learned_addr learned my addr 172.21.15.155:0/3318007423 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.739+0000 7ffbdb996700 1 -- 172.21.15.155:0/3318007423 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e5fc5ed00 con 0x558e6007f400 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.739+0000 7ffbdb996700 1 --2- 172.21.15.155:0/3318007423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x558e60093200 tx=0x558e5ff89800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.739+0000 7ffbc1161700 1 -- 172.21.15.155:0/3318007423 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e600a8160 con 0x558e6007f400 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.740+0000 7ffbc1161700 1 -- 172.21.15.155:0/3318007423 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e600a6180 con 0x558e6007f400 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.740+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3318007423 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e5fc5e340 con 0x558e6007f400 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.740+0000 7ffbc1161700 1 -- 172.21.15.155:0/3318007423 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558e600a82c0 con 0x558e6007f400 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.740+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3318007423 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e5fc5fd40 con 0x558e6007f400 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.740+0000 7ffbc1161700 1 -- 172.21.15.155:0/3318007423 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558e609d9b80 con 0x558e6007f400 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.740+0000 7ffbc1161700 1 --2- 172.21.15.155:0/3318007423 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e60122000 0x558e5ff21700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.740+0000 7ffbc1161700 1 -- 172.21.15.155:0/3318007423 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558e5fcb1500 con 0x558e6007f400 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.740+0000 7ffbde1eda80 5 note: GC not initialized 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.740+0000 7ffbdc998700 1 --2- 172.21.15.155:0/3318007423 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e60122000 0x558e5ff21700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.741+0000 7ffbdc998700 1 --2- 172.21.15.155:0/3318007423 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e60122000 0x558e5ff21700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x558e5ffc7470 tx=0x558e5ff880c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.741+0000 7ffbbe95c700 20 reqs_thread_entry: start 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.741+0000 7ffbde1eda80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:38.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbde1eda80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbbc958700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:09 2024 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbbc136700 20 reqs_thread_entry: start 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbde1eda80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbde1eda80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e6007fc00 con 0x558e5fc37800 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~539 out=539b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+662 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbde1eda80 20 rados_obj.operate() r=0 bl.length=539 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbde1eda80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbde1eda80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbde1eda80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.742+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60122800 con 0x558e5fc37800 2024-04-19T23:45:38.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.743+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v30'10 uv10 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.743+0000 7ffbde1eda80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.743+0000 7ffbde1eda80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.743+0000 7ffbde1eda80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.743+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94069984913664 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60122c00 con 0x558e5fc37800 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.744+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94069983374592 notify 128849018889 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x558e6001dd40 con 0x558e5fc37800 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.744+0000 7ffbd698c700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94069983374592 notifier 4429 bl.length()=689 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.744+0000 7ffbd698c700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.744+0000 7ffbd698c700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.744+0000 7ffbd698c700 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60194000 con 0x558e5fc37800 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.744+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(64 notify.4 [notify cookie 94069984913664 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.744+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.744+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 94069984913664 notify 128849018889 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558e600e7ba0 con 0x558e5fc37800 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [ 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "foo:foo2", 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: "permissions": "" 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.756 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [ 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo:foo2", 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:38.757 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.758 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.759 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.759 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:38.759 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:38.759 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:38.759 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:38.759 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.745+0000 7ffbc3165700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.745+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94069984911360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60123000 con 0x558e5fc37800 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.746+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94069984911360] v30'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.746+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94069983369984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60123400 con 0x558e5ffc1400 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.747+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94069983369984] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.747+0000 7ffbde1eda80 20 remove_watcher() i=0 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.747+0000 7ffbde1eda80 2 removed watcher, disabling cache 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.747+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94069983371136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60123800 con 0x558e5fc37800 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.748+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94069983371136] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.748+0000 7ffbde1eda80 20 remove_watcher() i=1 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.748+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94069983372288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60123c00 con 0x558e5ffc1000 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.749+0000 7ffbdc197700 1 -- 172.21.15.155:0/171639971 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94069983372288] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006b200 con 0x558e5ffc1000 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.749+0000 7ffbde1eda80 20 remove_watcher() i=2 2024-04-19T23:45:38.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.749+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94069983373440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60194000 con 0x558e5ffc1400 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.750+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94069983373440] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006b440 con 0x558e5ffc1400 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.750+0000 7ffbde1eda80 20 remove_watcher() i=3 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.750+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94069983374592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60194800 con 0x558e5fc37800 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.751+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94069983374592] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e5fc37800 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.751+0000 7ffbde1eda80 20 remove_watcher() i=4 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.751+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94069983375744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60194c00 con 0x558e6007e000 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.752+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94069983375744] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.752+0000 7ffbde1eda80 20 remove_watcher() i=5 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.752+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94069983376896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60195000 con 0x558e6007e000 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.753+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94069983376896] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.753+0000 7ffbde1eda80 20 remove_watcher() i=6 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.753+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94069983378048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e60195400 con 0x558e6007e000 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbdc998700 1 -- 172.21.15.155:0/171639971 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94069983378048] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558e6006ab40 con 0x558e6007e000 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 20 remove_watcher() i=7 2024-04-19T23:45:38.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558e6007e000 msgr2=0x558e5ff21180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558e6007e000 0x558e5ff21180 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558e5fc37800 msgr2=0x558e5ff1fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558e5fc37800 0x558e5ff1fb80 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558e5ffc1400 msgr2=0x558e5ff20c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558e5ffc1400 0x558e5ff20c00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558e5ffc1000 msgr2=0x558e5ff20100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558e5ffc1000 0x558e5ff20100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e5ffc0c00 msgr2=0x558e5ff1f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e5ffc0c00 0x558e5ff1f600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x558e5ff19890 tx=0x558e5fd27800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 msgr2=0x558e5ff1eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x558e60a07f50 tx=0x558e5ff888a0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbdb996700 1 -- 172.21.15.155:0/171639971 reap_dead start 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 shutdown_connections 2024-04-19T23:45:38.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/171639971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc37400 0x558e5ff1eb00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 >> 172.21.15.155:0/171639971 conn(0x558e5fc36c00 msgr2=0x558e5fd23800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 shutdown_connections 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.754+0000 7ffbde1eda80 1 -- 172.21.15.155:0/171639971 wait complete. 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3318007423 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e60122000 msgr2=0x558e5ff21700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/3318007423 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e60122000 0x558e5ff21700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x558e5ffc7470 tx=0x558e5ff880c0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3318007423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 msgr2=0x558e5ff20680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/3318007423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x558e60093200 tx=0x558e5ff89800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3318007423 shutdown_connections 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/3318007423 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e60122000 0x558e5ff21700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/3318007423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e6007f400 0x558e5ff20680 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3318007423 >> 172.21.15.155:0/3318007423 conn(0x558e6007e800 msgr2=0x558e5fd24000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3318007423 shutdown_connections 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/3318007423 wait complete. 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/724582435 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e5ffc0000 msgr2=0x558e5ff1f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/724582435 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e5ffc0000 0x558e5ff1f080 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x558e60ac8f30 tx=0x558e5ff88240 comp rx=0 tx=0).stop 2024-04-19T23:45:38.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/724582435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 msgr2=0x558e5ff1e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/724582435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x558e60a07e30 tx=0x558e5fd27a40 comp rx=0 tx=0).stop 2024-04-19T23:45:38.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/724582435 shutdown_connections 2024-04-19T23:45:38.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/724582435 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558e5ffc0000 0x558e5ff1f080 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 --2- 172.21.15.155:0/724582435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558e5fc36800 0x558e5ff1e580 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/724582435 >> 172.21.15.155:0/724582435 conn(0x558e5fc36400 msgr2=0x558e5fd23000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/724582435 shutdown_connections 2024-04-19T23:45:38.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.755+0000 7ffbde1eda80 1 -- 172.21.15.155:0/724582435 wait complete. 2024-04-19T23:45:38.769 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:38.769 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-19T23:45:38.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-19T23:45:38.770 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-04-19T23:45:38.818 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:38.818 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:38.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.819+0000 7f3674828a80 1 Processor -- start 2024-04-19T23:45:38.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.819+0000 7f3674828a80 1 -- start start 2024-04-19T23:45:38.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.819+0000 7f3674828a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x557bce526800 0x557bce80e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.819+0000 7f3674828a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557bce851500 con 0x557bce526c00 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.819+0000 7f3674828a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x557bce5c8a00 con 0x557bce526800 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.819+0000 7f36727d2700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x557bce526800 0x557bce80e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.819+0000 7f3671fd1700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x557bce526c00 0x557bce612800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46632/0 (socket says 172.21.15.155:46632) 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.819+0000 7f3671fd1700 1 -- 172.21.15.155:0/1684216334 learned_addr learned my addr 172.21.15.155:0/1684216334 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.819+0000 7f36727d2700 1 -- 172.21.15.155:0/1684216334 >> v1:172.21.15.76:6789/0 conn(0x557bce526c00 legacy=0x557bce612800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.819+0000 7f36727d2700 1 -- 172.21.15.155:0/1684216334 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bce54fd40 con 0x557bce526800 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.819+0000 7f36727d2700 1 --2- 172.21.15.155:0/1684216334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x557bce8099e0 tx=0x557bce617920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4d5413fe62e851 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.820+0000 7f36717d0700 1 -- 172.21.15.155:0/1684216334 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce5df4a0 con 0x557bce526800 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.820+0000 7f36717d0700 1 -- 172.21.15.155:0/1684216334 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bce851800 con 0x557bce526800 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.820+0000 7f36717d0700 1 -- 172.21.15.155:0/1684216334 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce5df600 con 0x557bce526800 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.820+0000 7f3674828a80 1 -- 172.21.15.155:0/1684216334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 msgr2=0x557bce80e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.820+0000 7f3674828a80 1 --2- 172.21.15.155:0/1684216334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x557bce8099e0 tx=0x557bce617920 comp rx=0 tx=0).stop 2024-04-19T23:45:38.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.820+0000 7f3674828a80 1 -- 172.21.15.155:0/1684216334 shutdown_connections 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.820+0000 7f3674828a80 1 --2- 172.21.15.155:0/1684216334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.820+0000 7f3674828a80 1 -- 172.21.15.155:0/1684216334 >> 172.21.15.155:0/1684216334 conn(0x557bce526400 msgr2=0x557bce612000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.820+0000 7f3674828a80 1 -- 172.21.15.155:0/1684216334 shutdown_connections 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.820+0000 7f3674828a80 1 -- 172.21.15.155:0/1684216334 wait complete. 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.821+0000 7f3674828a80 1 Processor -- start 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.821+0000 7f3674828a80 1 -- start start 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.821+0000 7f3674828a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.821+0000 7f3674828a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce5c8500 con 0x557bce526800 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.821+0000 7f36727d2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.821+0000 7f36727d2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35042/0 (socket says 172.21.15.155:35042) 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.821+0000 7f36727d2700 1 -- 172.21.15.155:0/2011900239 learned_addr learned my addr 172.21.15.155:0/2011900239 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.821+0000 7f36727d2700 1 -- 172.21.15.155:0/2011900239 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bce54fba0 con 0x557bce526800 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.821+0000 7f36727d2700 1 --2- 172.21.15.155:0/2011900239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x557bcf2ed740 tx=0x557bce617800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f34c492c617a38 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.821+0000 7f3670fcf700 1 -- 172.21.15.155:0/2011900239 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce5df760 con 0x557bce526800 2024-04-19T23:45:38.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.821+0000 7f3670fcf700 1 -- 172.21.15.155:0/2011900239 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bce851b00 con 0x557bce526800 2024-04-19T23:45:38.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3670fcf700 1 -- 172.21.15.155:0/2011900239 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce5df1e0 con 0x557bce526800 2024-04-19T23:45:38.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3674828a80 1 -- 172.21.15.155:0/2011900239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 msgr2=0x557bce80e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3674828a80 1 --2- 172.21.15.155:0/2011900239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x557bcf2ed740 tx=0x557bce617800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3674828a80 1 -- 172.21.15.155:0/2011900239 shutdown_connections 2024-04-19T23:45:38.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3674828a80 1 --2- 172.21.15.155:0/2011900239 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3674828a80 1 -- 172.21.15.155:0/2011900239 >> 172.21.15.155:0/2011900239 conn(0x557bce526400 msgr2=0x557bce613000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3674828a80 1 -- 172.21.15.155:0/2011900239 shutdown_connections 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3674828a80 1 -- 172.21.15.155:0/2011900239 wait complete. 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3674828a80 1 Processor -- start 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3674828a80 1 -- start start 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3674828a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.822+0000 7f3674828a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce5c83c0 con 0x557bce526800 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.823+0000 7f36727d2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.823+0000 7f36727d2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35050/0 (socket says 172.21.15.155:35050) 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.823+0000 7f36727d2700 1 -- 172.21.15.155:0/101024907 learned_addr learned my addr 172.21.15.155:0/101024907 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.823+0000 7f36727d2700 1 -- 172.21.15.155:0/101024907 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bce54fa00 con 0x557bce526800 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.823+0000 7f36727d2700 1 --2- 172.21.15.155:0/101024907 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x557bcf2ed5f0 tx=0x557bce617920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.823+0000 7f366f7cc700 1 -- 172.21.15.155:0/101024907 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce5df4a0 con 0x557bce526800 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.823+0000 7f366f7cc700 1 -- 172.21.15.155:0/101024907 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bce851c80 con 0x557bce526800 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.823+0000 7f3674828a80 1 -- 172.21.15.155:0/101024907 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557bce54f860 con 0x557bce526800 2024-04-19T23:45:38.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.823+0000 7f366f7cc700 1 -- 172.21.15.155:0/101024907 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce5df600 con 0x557bce526800 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.823+0000 7f3674828a80 1 -- 172.21.15.155:0/101024907 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557bce54f6c0 con 0x557bce526800 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f3674828a80 1 Processor -- start 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f3674828a80 1 -- start start 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f366f7cc700 1 -- 172.21.15.155:0/101024907 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557bcf2c8b00 con 0x557bce526800 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f3674828a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f3674828a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce562640 con 0x557bce527400 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f366f7cc700 1 --2- 172.21.15.155:0/101024907 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bce8a4000 0x557bce80f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f3672fd3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f366f7cc700 1 -- 172.21.15.155:0/101024907 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x557bce5a1180 con 0x557bce526800 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f3672fd3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35052/0 (socket says 172.21.15.155:35052) 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f3672fd3700 1 -- 172.21.15.155:0/1391253620 learned_addr learned my addr 172.21.15.155:0/1391253620 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f36727d2700 1 --2- 172.21.15.155:0/101024907 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bce8a4000 0x557bce80f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f3672fd3700 1 -- 172.21.15.155:0/1391253620 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bce54e000 con 0x557bce527400 2024-04-19T23:45:38.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f36727d2700 1 --2- 172.21.15.155:0/101024907 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bce8a4000 0x557bce80f080 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x557bcf3b2ed0 tx=0x557bce86c4e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.824+0000 7f3672fd3700 1 --2- 172.21.15.155:0/1391253620 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x557bcf2edf80 tx=0x557bce86c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd39475502375d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f366cfc7700 1 -- 172.21.15.155:0/1391253620 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce5df4a0 con 0x557bce527400 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f366cfc7700 1 -- 172.21.15.155:0/1391253620 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bce5c7c80 con 0x557bce527400 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f366cfc7700 1 -- 172.21.15.155:0/1391253620 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce5df600 con 0x557bce527400 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f3674828a80 1 -- 172.21.15.155:0/1391253620 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 msgr2=0x557bce80eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f3674828a80 1 --2- 172.21.15.155:0/1391253620 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x557bcf2edf80 tx=0x557bce86c540 comp rx=0 tx=0).stop 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f3674828a80 1 -- 172.21.15.155:0/1391253620 shutdown_connections 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f3674828a80 1 --2- 172.21.15.155:0/1391253620 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f3674828a80 1 -- 172.21.15.155:0/1391253620 >> 172.21.15.155:0/1391253620 conn(0x557bce526c00 msgr2=0x557bce613800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f3674828a80 1 -- 172.21.15.155:0/1391253620 shutdown_connections 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f3674828a80 1 -- 172.21.15.155:0/1391253620 wait complete. 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f3674828a80 1 Processor -- start 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f3674828a80 1 -- start start 2024-04-19T23:45:38.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f3674828a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.825+0000 7f3674828a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce5628c0 con 0x557bce527400 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.826+0000 7f3672fd3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.826+0000 7f3672fd3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35066/0 (socket says 172.21.15.155:35066) 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.826+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 learned_addr learned my addr 172.21.15.155:0/465213284 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.826+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bce54eea0 con 0x557bce527400 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.826+0000 7f3672fd3700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x557bcf2edef0 tx=0x557bce617ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.826+0000 7f366b7c4700 1 -- 172.21.15.155:0/465213284 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce5df760 con 0x557bce527400 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.826+0000 7f366b7c4700 1 -- 172.21.15.155:0/465213284 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bce5c7b00 con 0x557bce527400 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.826+0000 7f366b7c4700 1 -- 172.21.15.155:0/465213284 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce5df4a0 con 0x557bce527400 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.826+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557bce54e820 con 0x557bce527400 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.826+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557bce54e9c0 con 0x557bce527400 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.827+0000 7f366b7c4700 1 -- 172.21.15.155:0/465213284 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557bcf2c8dc0 con 0x557bce527400 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.827+0000 7f366b7c4700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bce8a4c00 0x557bce80f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.827+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.827+0000 7f366b7c4700 1 -- 172.21.15.155:0/465213284 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x557bce5a1340 con 0x557bce527400 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.827+0000 7f3671fd1700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bce8a4c00 0x557bce80f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.827+0000 7f3674828a80 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557bce527800 0x557bce80fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.827+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce527c00 con 0x557bce527800 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.827+0000 7f3672fd3700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557bce527800 0x557bce80fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3671fd1700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bce8a4c00 0x557bce80f600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x557bce8c7d70 tx=0x557bce86d380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3672fd3700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557bce527800 0x557bce80fb80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3674828a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3674828a80 20 realm 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce8a5000 con 0x557bce527800 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3674828a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3674828a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce8a5400 con 0x557bce527800 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.828+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3674828a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce8a5800 con 0x557bce527800 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3674828a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce8a5c00 con 0x557bce527800 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3674828a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:38.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3674828a80 20 searching for the correct realm 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3674828a80 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557bce8a5000 0x557bce810100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce8a5400 con 0x557bce8a5000 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.829+0000 7f36727d2700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557bce8a5000 0x557bce810100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.830+0000 7f36727d2700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557bce8a5000 0x557bce810100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.830+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.830+0000 7f36727d2700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557bce8a5400 0x557bce810c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.830+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4000 con 0x557bce8a5400 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.830+0000 7f3671fd1700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557bce8a5400 0x557bce810c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.830+0000 7f3671fd1700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557bce8a5400 0x557bce810c00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.831+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.831+0000 7f3671fd1700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557bcf3c4000 0x557bce811180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.831+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bcf3c4000 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.831+0000 7f3672fd3700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557bcf3c4000 0x557bce811180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.831+0000 7f3672fd3700 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557bcf3c4000 0x557bce811180 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.831+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.831+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce527800 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.832+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.832+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce527800 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.832+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.832+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bcf3c4000 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.832+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.832+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bcf3c4000 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.832+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.832+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5400 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.832+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.832+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5000 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.833+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.833+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce527800 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.833+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.833+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bcf3c4000 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.833+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.833+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce527800 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.833+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.833+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5400 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.834+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.834+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5000 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.834+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.834+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5000 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.834+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.834+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bcf3c4000 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.834+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.834+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5000 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.835+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.835+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5000 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.835+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.835+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce527800 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.835+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.835+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce527800 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.835+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.835+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bcf3c4000 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.835+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.835+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5000 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.836+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.836+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5400 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.836+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.836+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce527800 2024-04-19T23:45:38.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.836+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.836+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bcf3c4000 2024-04-19T23:45:38.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.836+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.836+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5000 2024-04-19T23:45:38.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.837+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.837+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bcf3c4000 2024-04-19T23:45:38.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.837+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.837+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5400 2024-04-19T23:45:38.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.837+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.837+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5000 2024-04-19T23:45:38.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.837+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.837+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bcf3c4000 2024-04-19T23:45:38.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.838+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.838+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce527800 2024-04-19T23:45:38.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.838+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.838+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5400 2024-04-19T23:45:38.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.838+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.838+0000 7f3674828a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:38.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.838+0000 7f3674828a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:38.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.838+0000 7f3674828a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:38.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.838+0000 7f3674828a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:38.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.838+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce527c00 con 0x557bce527800 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4c00 con 0x557bce527800 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c5000 con 0x557bce8a5400 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 20 zone default found 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 4 Realm: () 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:38.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 20 zonegroup default 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c5400 con 0x557bcf3c4000 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.839+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f3674828a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c5800 con 0x557bce8a5000 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f3674828a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c5c00 con 0x557bce8a5000 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f3674828a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f3674828a80 20 started sync module instance, tier type = 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f3674828a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:38.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.840+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4c00 con 0x557bce8a5400 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.841+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.841+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93990233856768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce527c00 con 0x557bce8a5400 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.841+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce8a5800 con 0x557bce527800 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.842+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93990233856768] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.842+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.842+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93990233857920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce8a5c00 con 0x557bce527800 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.842+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bce8a5000 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.843+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.843+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93990233859072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c5000 con 0x557bce8a5000 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.843+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4c00 con 0x557bce8a5400 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.843+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93990233857920] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.844+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.844+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93990233859072] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.844+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93990233860224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4400 con 0x557bce8a5400 2024-04-19T23:45:38.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.844+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c5800 con 0x557bce527800 2024-04-19T23:45:38.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.845+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.845+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93990233861376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c5c00 con 0x557bce527800 2024-04-19T23:45:38.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.845+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c4800 con 0x557bcf3c4000 2024-04-19T23:45:38.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.845+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93990233860224] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.848+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.849+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93990233862528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c5400 con 0x557bcf3c4000 2024-04-19T23:45:38.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.849+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c5800 con 0x557bcf3c4000 2024-04-19T23:45:38.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.851+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93990233861376] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.856+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93990233862528] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.856+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.857+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93990233863680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c5c00 con 0x557bcf3c4000 2024-04-19T23:45:38.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.857+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce8a5800 con 0x557bcf3c4000 2024-04-19T23:45:38.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93990233863680] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93990233864832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce8a5c00 con 0x557bcf3c4000 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3674828a80 20 add_watcher() i=0 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3674828a80 20 add_watcher() i=1 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3674828a80 20 add_watcher() i=2 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3674828a80 20 add_watcher() i=3 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3674828a80 20 add_watcher() i=4 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3674828a80 20 add_watcher() i=5 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3674828a80 20 add_watcher() i=6 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93990233864832] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3674828a80 20 add_watcher() i=7 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3674828a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.858+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce8a5800 con 0x557bce527800 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.859+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.859+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93990235389952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce8a5c00 con 0x557bce527800 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.860+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93990235389952] v30'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.860+0000 7f36597a0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.860+0000 7f3674828a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.860+0000 7f3674828a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.860+0000 7f3674828a80 1 Processor -- start 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.860+0000 7f3674828a80 1 -- start start 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.860+0000 7f3674828a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.860+0000 7f3674828a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce5c83c0 con 0x557bcf3c5400 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.861+0000 7f3671fd1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.861+0000 7f3671fd1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35082/0 (socket says 172.21.15.155:35082) 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.861+0000 7f3671fd1700 1 -- 172.21.15.155:0/3319540711 learned_addr learned my addr 172.21.15.155:0/3319540711 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.861+0000 7f3671fd1700 1 -- 172.21.15.155:0/3319540711 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bce54eb60 con 0x557bcf3c5400 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.861+0000 7f3671fd1700 1 --2- 172.21.15.155:0/3319540711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x557bce9840c0 tx=0x557bce86d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9c5af0c5bd5765 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.861+0000 7f3658f9f700 1 -- 172.21.15.155:0/3319540711 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce994000 con 0x557bcf3c5400 2024-04-19T23:45:38.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.861+0000 7f3658f9f700 1 -- 172.21.15.155:0/3319540711 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bce99c000 con 0x557bcf3c5400 2024-04-19T23:45:38.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.861+0000 7f3658f9f700 1 -- 172.21.15.155:0/3319540711 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce994160 con 0x557bcf3c5400 2024-04-19T23:45:38.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.862+0000 7f3674828a80 1 -- 172.21.15.155:0/3319540711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 msgr2=0x557bce810680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.862+0000 7f3674828a80 1 --2- 172.21.15.155:0/3319540711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x557bce9840c0 tx=0x557bce86d680 comp rx=0 tx=0).stop 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.862+0000 7f3674828a80 1 -- 172.21.15.155:0/3319540711 shutdown_connections 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.862+0000 7f3674828a80 1 --2- 172.21.15.155:0/3319540711 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.862+0000 7f3674828a80 1 -- 172.21.15.155:0/3319540711 >> 172.21.15.155:0/3319540711 conn(0x557bcf3c4800 msgr2=0x557bce614000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.862+0000 7f3674828a80 1 -- 172.21.15.155:0/3319540711 shutdown_connections 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.862+0000 7f3674828a80 1 -- 172.21.15.155:0/3319540711 wait complete. 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.862+0000 7f3674828a80 1 Processor -- start 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.863+0000 7f3674828a80 1 -- start start 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.863+0000 7f3674828a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.863+0000 7f3674828a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce5c8500 con 0x557bcf3c5400 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.863+0000 7f3671fd1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.863+0000 7f3671fd1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35096/0 (socket says 172.21.15.155:35096) 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.863+0000 7f3671fd1700 1 -- 172.21.15.155:0/2497579610 learned_addr learned my addr 172.21.15.155:0/2497579610 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.863+0000 7f3671fd1700 1 -- 172.21.15.155:0/2497579610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bce54ed00 con 0x557bcf3c5400 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.863+0000 7f3671fd1700 1 --2- 172.21.15.155:0/2497579610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x557bce985380 tx=0x557bce86d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.863+0000 7f365779c700 1 -- 172.21.15.155:0/2497579610 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce9942c0 con 0x557bcf3c5400 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.863+0000 7f365779c700 1 -- 172.21.15.155:0/2497579610 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bce99c180 con 0x557bcf3c5400 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.863+0000 7f3674828a80 1 -- 172.21.15.155:0/2497579610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557bce54e340 con 0x557bcf3c5400 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.864+0000 7f365779c700 1 -- 172.21.15.155:0/2497579610 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557bce994000 con 0x557bcf3c5400 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.864+0000 7f3674828a80 1 -- 172.21.15.155:0/2497579610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557bce54eb60 con 0x557bcf3c5400 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.864+0000 7f365779c700 1 -- 172.21.15.155:0/2497579610 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557bcf2c9b80 con 0x557bcf3c5400 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.864+0000 7f365779c700 1 --2- 172.21.15.155:0/2497579610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bcea18000 0x557bce811700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.864+0000 7f365779c700 1 -- 172.21.15.155:0/2497579610 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x557bce5a1500 con 0x557bcf3c5400 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.865+0000 7f3672fd3700 1 --2- 172.21.15.155:0/2497579610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bcea18000 0x557bce811700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.865+0000 7f3674828a80 5 note: GC not initialized 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.865+0000 7f3672fd3700 1 --2- 172.21.15.155:0/2497579610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bcea18000 0x557bce811700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x557bce90fd10 tx=0x557bce86d4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.865+0000 7f3654f97700 20 reqs_thread_entry: start 2024-04-19T23:45:38.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.866+0000 7f3674828a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.866+0000 7f3674828a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.866+0000 7f3652f93700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:09 2024 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.866+0000 7f3652771700 20 reqs_thread_entry: start 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.866+0000 7f3674828a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.866+0000 7f3674828a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.866+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcf3c5c00 con 0x557bce527800 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.866+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.867+0000 7f3674828a80 20 rados_obj.operate() r=0 bl.length=513 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.867+0000 7f3674828a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.867+0000 7f3674828a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.867+0000 7f3674828a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.867+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea18800 con 0x557bce527800 2024-04-19T23:45:38.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v30'11 uv11 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f3674828a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f3674828a80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f3674828a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93990235392256 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea18c00 con 0x557bce527800 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 93990233861376 notify 128849018890 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x557bce911d40 con 0x557bce527800 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f366cfc7700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 93990233861376 notifier 4437 bl.length()=533 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f366cfc7700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f366cfc7700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f366cfc7700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea8c000 con 0x557bce527800 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(64 notify.4 [notify cookie 93990235392256 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.868+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.869+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 93990235392256 notify 128849018890 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557bce9e1d40 con 0x557bce527800 2024-04-19T23:45:38.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.869+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea19000 con 0x557bce8a5400 2024-04-19T23:45:38.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.870+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(66 foo:foo2 [delete] v30'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.870+0000 7f3674828a80 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-19T23:45:38.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.870+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93990235392256 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea19400 con 0x557bce8a5400 2024-04-19T23:45:38.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.870+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== watch-notify(notify (1) cookie 93990233856768 notify 128849018885 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x557bce911ba0 con 0x557bce8a5400 2024-04-19T23:45:38.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.870+0000 7f366c7c6700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 93990233856768 notifier 4437 bl.length()=159 2024-04-19T23:45:38.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.870+0000 7f366c7c6700 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bce527c00 con 0x557bce8a5400 2024-04-19T23:45:38.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.870+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(67 notify.0 [notify cookie 93990235392256 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.870+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.870+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== watch-notify(notify_complete (2) cookie 93990235392256 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557bce9101a0 con 0x557bce8a5400 2024-04-19T23:45:38.874 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:38.874 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:38.875 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:38.876 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:38.877 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:38.877 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:38.877 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:38.877 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:38.877 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:38.877 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:38.877 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.871+0000 7f36597a0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.871+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93990235389952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea19800 con 0x557bce527800 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.872+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93990235389952] v30'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.872+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93990233856768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea19c00 con 0x557bce8a5400 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.873+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93990233856768] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.873+0000 7f3674828a80 20 remove_watcher() i=0 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.873+0000 7f3674828a80 2 removed watcher, disabling cache 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.873+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93990233857920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea8c000 con 0x557bce527800 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.874+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93990233857920] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.874+0000 7f3674828a80 20 remove_watcher() i=1 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.874+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93990233859072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea8c800 con 0x557bce8a5000 2024-04-19T23:45:38.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.875+0000 7f36727d2700 1 -- 172.21.15.155:0/465213284 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93990233859072] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce963200 con 0x557bce8a5000 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.875+0000 7f3674828a80 20 remove_watcher() i=2 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.875+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93990233860224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea8cc00 con 0x557bce8a5400 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.876+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93990233860224] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce963440 con 0x557bce8a5400 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.876+0000 7f3674828a80 20 remove_watcher() i=3 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.876+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93990233861376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea8d000 con 0x557bce527800 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.877+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93990233861376] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bce527800 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.877+0000 7f3674828a80 20 remove_watcher() i=4 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.878+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93990233862528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea19000 con 0x557bcf3c4000 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.878+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93990233862528] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.878+0000 7f3674828a80 20 remove_watcher() i=5 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.878+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93990233863680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea19400 con 0x557bcf3c4000 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.879+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93990233863680] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.879+0000 7f3674828a80 20 remove_watcher() i=6 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.879+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93990233864832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557bcea18800 con 0x557bcf3c4000 2024-04-19T23:45:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.880+0000 7f3672fd3700 1 -- 172.21.15.155:0/465213284 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93990233864832] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557bce962b40 con 0x557bcf3c4000 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.880+0000 7f3674828a80 20 remove_watcher() i=7 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.880+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557bcf3c4000 msgr2=0x557bce811180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.880+0000 7f3674828a80 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557bcf3c4000 0x557bce811180 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.880+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557bce527800 msgr2=0x557bce80fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.880+0000 7f3674828a80 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557bce527800 0x557bce80fb80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.880+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557bce8a5400 msgr2=0x557bce810c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.880+0000 7f3674828a80 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557bce8a5400 0x557bce810c00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.880+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557bce8a5000 msgr2=0x557bce810100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.880+0000 7f3674828a80 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557bce8a5000 0x557bce810100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bce8a4c00 msgr2=0x557bce80f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bce8a4c00 0x557bce80f600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x557bce8c7d70 tx=0x557bce86d380 comp rx=0 tx=0).stop 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 msgr2=0x557bce80eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x557bcf2edef0 tx=0x557bce617ce0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3671fd1700 1 -- 172.21.15.155:0/465213284 reap_dead start 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 shutdown_connections 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 --2- 172.21.15.155:0/465213284 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce527400 0x557bce80eb00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 >> 172.21.15.155:0/465213284 conn(0x557bce526c00 msgr2=0x557bce613800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 shutdown_connections 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/465213284 wait complete. 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/2497579610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bcea18000 msgr2=0x557bce811700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 --2- 172.21.15.155:0/2497579610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bcea18000 0x557bce811700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x557bce90fd10 tx=0x557bce86d4a0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/2497579610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 msgr2=0x557bce810680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 --2- 172.21.15.155:0/2497579610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x557bce985380 tx=0x557bce86d7a0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/2497579610 shutdown_connections 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 --2- 172.21.15.155:0/2497579610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bcea18000 0x557bce811700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 --2- 172.21.15.155:0/2497579610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bcf3c5400 0x557bce810680 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/2497579610 >> 172.21.15.155:0/2497579610 conn(0x557bcf3c4800 msgr2=0x557bce614000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/2497579610 shutdown_connections 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/2497579610 wait complete. 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/101024907 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bce8a4000 msgr2=0x557bce80f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 --2- 172.21.15.155:0/101024907 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bce8a4000 0x557bce80f080 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x557bcf3b2ed0 tx=0x557bce86c4e0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 -- 172.21.15.155:0/101024907 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 msgr2=0x557bce80e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.881+0000 7f3674828a80 1 --2- 172.21.15.155:0/101024907 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x557bcf2ed5f0 tx=0x557bce617920 comp rx=0 tx=0).stop 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.882+0000 7f3674828a80 1 -- 172.21.15.155:0/101024907 shutdown_connections 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.882+0000 7f3674828a80 1 --2- 172.21.15.155:0/101024907 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557bce8a4000 0x557bce80f080 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.882+0000 7f3674828a80 1 --2- 172.21.15.155:0/101024907 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557bce526800 0x557bce80e580 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.882+0000 7f3674828a80 1 -- 172.21.15.155:0/101024907 >> 172.21.15.155:0/101024907 conn(0x557bce526400 msgr2=0x557bce613000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.882+0000 7f3674828a80 1 -- 172.21.15.155:0/101024907 shutdown_connections 2024-04-19T23:45:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.882+0000 7f3674828a80 1 -- 172.21.15.155:0/101024907 wait complete. 2024-04-19T23:45:38.888 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:38.888 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-19T23:45:38.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-19T23:45:38.889 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-19T23:45:38.934 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:38.934 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:38.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd45af6a80 1 Processor -- start 2024-04-19T23:45:38.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd45af6a80 1 -- start start 2024-04-19T23:45:38.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd45af6a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55958bf7ec00 0x55958c266580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd45af6a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55958c2a9500 con 0x55958bf7e800 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd45af6a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55958c020a00 con 0x55958bf7ec00 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd4329f700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55958bf7ec00 0x55958c266580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd4329f700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55958bf7ec00 0x55958c266580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35106/0 (socket says 172.21.15.155:35106) 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd4329f700 1 -- 172.21.15.155:0/1821272314 learned_addr learned my addr 172.21.15.155:0/1821272314 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd43aa0700 1 --1- 172.21.15.155:0/1821272314 >> v1:172.21.15.76:6789/0 conn(0x55958bf7e800 0x55958c06a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46638/0 (socket says 172.21.15.155:46638) 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd4329f700 1 -- 172.21.15.155:0/1821272314 >> v1:172.21.15.76:6789/0 conn(0x55958bf7e800 legacy=0x55958c06a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd4329f700 1 -- 172.21.15.155:0/1821272314 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55958bfa7d40 con 0x55958bf7ec00 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.935+0000 7fdd4329f700 1 --2- 172.21.15.155:0/1821272314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7ec00 0x55958c266580 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55958c261890 tx=0x55958c06f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79e2d6ae4faa1a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.936+0000 7fdd42a9e700 1 -- 172.21.15.155:0/1821272314 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c0374a0 con 0x55958bf7ec00 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.936+0000 7fdd42a9e700 1 -- 172.21.15.155:0/1821272314 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55958c2a9800 con 0x55958bf7ec00 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.936+0000 7fdd42a9e700 1 -- 172.21.15.155:0/1821272314 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c037600 con 0x55958bf7ec00 2024-04-19T23:45:38.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.936+0000 7fdd45af6a80 1 -- 172.21.15.155:0/1821272314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7ec00 msgr2=0x55958c266580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.936+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/1821272314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7ec00 0x55958c266580 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55958c261890 tx=0x55958c06f920 comp rx=0 tx=0).stop 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.936+0000 7fdd45af6a80 1 -- 172.21.15.155:0/1821272314 shutdown_connections 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.936+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/1821272314 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7ec00 0x55958c266580 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.936+0000 7fdd45af6a80 1 -- 172.21.15.155:0/1821272314 >> 172.21.15.155:0/1821272314 conn(0x55958bf7e400 msgr2=0x55958c06a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.936+0000 7fdd45af6a80 1 -- 172.21.15.155:0/1821272314 shutdown_connections 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.936+0000 7fdd45af6a80 1 -- 172.21.15.155:0/1821272314 wait complete. 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.937+0000 7fdd45af6a80 1 Processor -- start 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.937+0000 7fdd45af6a80 1 -- start start 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.937+0000 7fdd45af6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.937+0000 7fdd45af6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958c020500 con 0x55958bf7e800 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.937+0000 7fdd43aa0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.937+0000 7fdd43aa0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35122/0 (socket says 172.21.15.155:35122) 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.937+0000 7fdd43aa0700 1 -- 172.21.15.155:0/2954023622 learned_addr learned my addr 172.21.15.155:0/2954023622 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.937+0000 7fdd43aa0700 1 -- 172.21.15.155:0/2954023622 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55958bfa7ba0 con 0x55958bf7e800 2024-04-19T23:45:38.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd43aa0700 1 --2- 172.21.15.155:0/2954023622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55958cd49890 tx=0x55958c06fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80e8995249e0fb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd4229d700 1 -- 172.21.15.155:0/2954023622 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c0374a0 con 0x55958bf7e800 2024-04-19T23:45:38.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd4229d700 1 -- 172.21.15.155:0/2954023622 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55958c2a9b00 con 0x55958bf7e800 2024-04-19T23:45:38.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd4229d700 1 -- 172.21.15.155:0/2954023622 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c037600 con 0x55958bf7e800 2024-04-19T23:45:38.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd45af6a80 1 -- 172.21.15.155:0/2954023622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 msgr2=0x55958c266580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/2954023622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55958cd49890 tx=0x55958c06fb60 comp rx=0 tx=0).stop 2024-04-19T23:45:38.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd45af6a80 1 -- 172.21.15.155:0/2954023622 shutdown_connections 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/2954023622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd45af6a80 1 -- 172.21.15.155:0/2954023622 >> 172.21.15.155:0/2954023622 conn(0x55958bf7e400 msgr2=0x55958c06b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd45af6a80 1 -- 172.21.15.155:0/2954023622 shutdown_connections 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd45af6a80 1 -- 172.21.15.155:0/2954023622 wait complete. 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.938+0000 7fdd45af6a80 1 Processor -- start 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd45af6a80 1 -- start start 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd45af6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd45af6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958c0203c0 con 0x55958bf7e800 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd43aa0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd43aa0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35138/0 (socket says 172.21.15.155:35138) 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd43aa0700 1 -- 172.21.15.155:0/824229554 learned_addr learned my addr 172.21.15.155:0/824229554 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd43aa0700 1 -- 172.21.15.155:0/824229554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55958bfa7a00 con 0x55958bf7e800 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd43aa0700 1 --2- 172.21.15.155:0/824229554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55958cd496b0 tx=0x55958c06fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd40a9a700 1 -- 172.21.15.155:0/824229554 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c0378c0 con 0x55958bf7e800 2024-04-19T23:45:38.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd40a9a700 1 -- 172.21.15.155:0/824229554 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55958c01fc80 con 0x55958bf7e800 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd45af6a80 1 -- 172.21.15.155:0/824229554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55958bfa7860 con 0x55958bf7e800 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd40a9a700 1 -- 172.21.15.155:0/824229554 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c0374a0 con 0x55958bf7e800 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.939+0000 7fdd45af6a80 1 -- 172.21.15.155:0/824229554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55958bfa76c0 con 0x55958bf7e800 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.940+0000 7fdd45af6a80 1 Processor -- start 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.940+0000 7fdd45af6a80 1 -- start start 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.940+0000 7fdd40a9a700 1 -- 172.21.15.155:0/824229554 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55958cd20b00 con 0x55958bf7e800 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.940+0000 7fdd45af6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 0x55958c266b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.940+0000 7fdd45af6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958c020000 con 0x55958bf7f400 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.940+0000 7fdd40a9a700 1 --2- 172.21.15.155:0/824229554 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c308000 0x55958c267080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.940+0000 7fdd40a9a700 1 -- 172.21.15.155:0/824229554 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55958bff9180 con 0x55958bf7e800 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.940+0000 7fdd442a1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 0x55958c266b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.940+0000 7fdd442a1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 0x55958c266b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35152/0 (socket says 172.21.15.155:35152) 2024-04-19T23:45:38.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.940+0000 7fdd442a1700 1 -- 172.21.15.155:0/288544556 learned_addr learned my addr 172.21.15.155:0/288544556 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.940+0000 7fdd43aa0700 1 --2- 172.21.15.155:0/824229554 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c308000 0x55958c267080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd442a1700 1 -- 172.21.15.155:0/288544556 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55958bfa6000 con 0x55958bf7f400 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd43aa0700 1 --2- 172.21.15.155:0/824229554 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c308000 0x55958c267080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55958cdfd020 tx=0x55958c2ca240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd442a1700 1 --2- 172.21.15.155:0/288544556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 0x55958c266b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55958cdfc8d0 tx=0x55958c2ca060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236a760bb72ea973 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd3e295700 1 -- 172.21.15.155:0/288544556 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c0378c0 con 0x55958bf7f400 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd3e295700 1 -- 172.21.15.155:0/288544556 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55958c2a8300 con 0x55958bf7f400 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd3e295700 1 -- 172.21.15.155:0/288544556 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c0374a0 con 0x55958bf7f400 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd45af6a80 1 -- 172.21.15.155:0/288544556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 msgr2=0x55958c266b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/288544556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 0x55958c266b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55958cdfc8d0 tx=0x55958c2ca060 comp rx=0 tx=0).stop 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd45af6a80 1 -- 172.21.15.155:0/288544556 shutdown_connections 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/288544556 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 0x55958c266b00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd45af6a80 1 -- 172.21.15.155:0/288544556 >> 172.21.15.155:0/288544556 conn(0x55958bf7ec00 msgr2=0x55958c06b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd45af6a80 1 -- 172.21.15.155:0/288544556 shutdown_connections 2024-04-19T23:45:38.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.941+0000 7fdd45af6a80 1 -- 172.21.15.155:0/288544556 wait complete. 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.942+0000 7fdd45af6a80 1 Processor -- start 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.942+0000 7fdd45af6a80 1 -- start start 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.942+0000 7fdd45af6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 0x55958c266b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.942+0000 7fdd45af6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958bfba640 con 0x55958bf7f400 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.942+0000 7fdd442a1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 0x55958c266b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.942+0000 7fdd442a1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 0x55958c266b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35162/0 (socket says 172.21.15.155:35162) 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.942+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 learned_addr learned my addr 172.21.15.155:0/3062260567 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.942+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55958bfa6ea0 con 0x55958bf7f400 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.942+0000 7fdd442a1700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 0x55958c266b00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55958cdfc750 tx=0x55958c2ca120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.943+0000 7fdd3ca92700 1 -- 172.21.15.155:0/3062260567 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c037b80 con 0x55958bf7f400 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.943+0000 7fdd3ca92700 1 -- 172.21.15.155:0/3062260567 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55958c01fc80 con 0x55958bf7f400 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.943+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55958bfa6820 con 0x55958bf7f400 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.943+0000 7fdd3ca92700 1 -- 172.21.15.155:0/3062260567 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c0378c0 con 0x55958bf7f400 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.943+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55958bfa69c0 con 0x55958bf7f400 2024-04-19T23:45:38.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.943+0000 7fdd3ca92700 1 -- 172.21.15.155:0/3062260567 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55958cd20dc0 con 0x55958bf7f400 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.943+0000 7fdd3ca92700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c308c00 0x55958c267600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.943+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.943+0000 7fdd3ca92700 1 -- 172.21.15.155:0/3062260567 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55958bff9340 con 0x55958bf7f400 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd4329f700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c308c00 0x55958c267600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55958bf7f800 0x55958c267b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958bf7fc00 con 0x55958bf7f800 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd442a1700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55958bf7f800 0x55958c267b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd4329f700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c308c00 0x55958c267600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55958c261890 tx=0x55958c06f800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd442a1700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55958bf7f800 0x55958c267b80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd45af6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd45af6a80 20 realm 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c309000 con 0x55958bf7f800 2024-04-19T23:45:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd45af6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.944+0000 7fdd45af6a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c309400 con 0x55958bf7f800 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c309800 con 0x55958bf7f800 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c309c00 con 0x55958bf7f800 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 20 searching for the correct realm 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55958c309000 0x55958c268100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c309400 con 0x55958c309000 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.945+0000 7fdd43aa0700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55958c309000 0x55958c268100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.946+0000 7fdd43aa0700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55958c309000 0x55958c268100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.946+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.946+0000 7fdd43aa0700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55958c309400 0x55958c268c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.946+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6000 con 0x55958c309400 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.946+0000 7fdd4329f700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55958c309400 0x55958c268c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.946+0000 7fdd4329f700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55958c309400 0x55958c268c00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.947+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.947+0000 7fdd4329f700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55958c3c6000 0x55958c269180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.947+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c3c6000 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.947+0000 7fdd442a1700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55958c3c6000 0x55958c269180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.947+0000 7fdd442a1700 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55958c3c6000 0x55958c269180 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.948+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.948+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958bf7f800 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.948+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.948+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958bf7f800 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.948+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.948+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c3c6000 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.948+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.948+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c3c6000 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.948+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.948+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309400 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.949+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.949+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309000 2024-04-19T23:45:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.949+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.949+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958bf7f800 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.949+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.949+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c3c6000 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.949+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.949+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958bf7f800 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.949+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.949+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309400 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.950+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.950+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309000 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.950+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.950+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309000 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.950+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.950+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c3c6000 2024-04-19T23:45:38.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.950+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.950+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309000 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.950+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.951+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309000 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.951+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.951+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958bf7f800 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.951+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.951+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958bf7f800 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.951+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.951+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c3c6000 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.951+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.951+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309000 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.952+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.952+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309400 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.952+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.952+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958bf7f800 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.952+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.952+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c3c6000 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.952+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.952+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309000 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.952+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.952+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c3c6000 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.953+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.953+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309400 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.953+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.953+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309000 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.953+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.953+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c3c6000 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.953+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.953+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958bf7f800 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309400 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958bf7fc00 con 0x55958bf7f800 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6c00 con 0x55958bf7f800 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.954+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c7000 con 0x55958c309400 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 20 zone default found 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 4 Realm: () 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 20 zonegroup default 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c7400 con 0x55958c3c6000 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.955+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c7800 con 0x55958c309000 2024-04-19T23:45:38.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.956+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.956+0000 7fdd45af6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.956+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.956+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c7c00 con 0x55958c309000 2024-04-19T23:45:38.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.956+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.956+0000 7fdd45af6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:38.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.956+0000 7fdd45af6a80 20 started sync module instance, tier type = 2024-04-19T23:45:38.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.956+0000 7fdd45af6a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:38.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.956+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6c00 con 0x55958c309400 2024-04-19T23:45:38.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.957+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.957+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94100789779200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958bf7fc00 con 0x55958c309400 2024-04-19T23:45:38.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.957+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c309800 con 0x55958bf7f800 2024-04-19T23:45:38.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.958+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94100789779200] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.958+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.958+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94100789780352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c309c00 con 0x55958bf7f800 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.959+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c309000 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.960+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94100789780352] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.960+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.960+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94100789781504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c7000 con 0x55958c309000 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.960+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6c00 con 0x55958c309400 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.961+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94100789781504] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.961+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.961+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94100789782656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6400 con 0x55958c309400 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.961+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c7800 con 0x55958bf7f800 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.962+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.962+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94100789783808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c7c00 con 0x55958bf7f800 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.962+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6800 con 0x55958c3c6000 2024-04-19T23:45:38.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.962+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94100789782656] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.963+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.963+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94100789784960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c7400 con 0x55958c3c6000 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.963+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c7800 con 0x55958c3c6000 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.963+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94100789783808] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.964+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.964+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94100789786112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c7c00 con 0x55958c3c6000 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.964+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c309800 con 0x55958c3c6000 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.964+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94100789784960] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.967+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.967+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94100789787264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c309c00 con 0x55958c3c6000 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.967+0000 7fdd45af6a80 20 add_watcher() i=0 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.967+0000 7fdd45af6a80 20 add_watcher() i=1 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.967+0000 7fdd45af6a80 20 add_watcher() i=2 2024-04-19T23:45:38.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.967+0000 7fdd45af6a80 20 add_watcher() i=3 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.967+0000 7fdd45af6a80 20 add_watcher() i=4 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.967+0000 7fdd45af6a80 20 add_watcher() i=5 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.967+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94100789786112] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.967+0000 7fdd45af6a80 20 add_watcher() i=6 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.970+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94100789787264] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.970+0000 7fdd45af6a80 20 add_watcher() i=7 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.970+0000 7fdd45af6a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.970+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c309800 con 0x55958bf7f800 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.971+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.971+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94100791328768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c309c00 con 0x55958bf7f800 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.972+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94100791328768] v30'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.972+0000 7fdd2aa6e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.972+0000 7fdd45af6a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.972+0000 7fdd45af6a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:38.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.972+0000 7fdd45af6a80 1 Processor -- start 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.972+0000 7fdd45af6a80 1 -- start start 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.972+0000 7fdd45af6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.972+0000 7fdd45af6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958bfba780 con 0x55958c3c7400 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.972+0000 7fdd4329f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.973+0000 7fdd4329f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35172/0 (socket says 172.21.15.155:35172) 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.973+0000 7fdd4329f700 1 -- 172.21.15.155:0/228415326 learned_addr learned my addr 172.21.15.155:0/228415326 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.973+0000 7fdd4329f700 1 -- 172.21.15.155:0/228415326 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55958bfa6b60 con 0x55958c3c7400 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.973+0000 7fdd4329f700 1 --2- 172.21.15.155:0/228415326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55958cdfd200 tx=0x55958c2cb6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379f4e21190834e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.973+0000 7fdd2a26d700 1 -- 172.21.15.155:0/228415326 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c037760 con 0x55958c3c7400 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.973+0000 7fdd2a26d700 1 -- 172.21.15.155:0/228415326 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55958c3f0000 con 0x55958c3c7400 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.973+0000 7fdd2a26d700 1 -- 172.21.15.155:0/228415326 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c3f2000 con 0x55958c3c7400 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd45af6a80 1 -- 172.21.15.155:0/228415326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 msgr2=0x55958c268680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/228415326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55958cdfd200 tx=0x55958c2cb6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd45af6a80 1 -- 172.21.15.155:0/228415326 shutdown_connections 2024-04-19T23:45:38.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/228415326 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd45af6a80 1 -- 172.21.15.155:0/228415326 >> 172.21.15.155:0/228415326 conn(0x55958c3c6800 msgr2=0x55958c06c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd45af6a80 1 -- 172.21.15.155:0/228415326 shutdown_connections 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd45af6a80 1 -- 172.21.15.155:0/228415326 wait complete. 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd45af6a80 1 Processor -- start 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd45af6a80 1 -- start start 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd45af6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd45af6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958c020000 con 0x55958c3c7400 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd4329f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd4329f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35188/0 (socket says 172.21.15.155:35188) 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.974+0000 7fdd4329f700 1 -- 172.21.15.155:0/897732002 learned_addr learned my addr 172.21.15.155:0/897732002 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.975+0000 7fdd4329f700 1 -- 172.21.15.155:0/897732002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55958bfa6d00 con 0x55958c3c7400 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.975+0000 7fdd4329f700 1 --2- 172.21.15.155:0/897732002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55958c3e8210 tx=0x55958c2cb800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.975+0000 7fdd28a6a700 1 -- 172.21.15.155:0/897732002 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c3f2160 con 0x55958c3c7400 2024-04-19T23:45:38.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.975+0000 7fdd28a6a700 1 -- 172.21.15.155:0/897732002 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55958c3f0180 con 0x55958c3c7400 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.975+0000 7fdd45af6a80 1 -- 172.21.15.155:0/897732002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55958bfa6340 con 0x55958c3c7400 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.975+0000 7fdd28a6a700 1 -- 172.21.15.155:0/897732002 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55958c3f22c0 con 0x55958c3c7400 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.975+0000 7fdd45af6a80 1 -- 172.21.15.155:0/897732002 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55958bfa7d40 con 0x55958c3c7400 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.976+0000 7fdd28a6a700 1 -- 172.21.15.155:0/897732002 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55958cd21b80 con 0x55958c3c7400 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.976+0000 7fdd28a6a700 1 --2- 172.21.15.155:0/897732002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c46a000 0x55958c269700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.976+0000 7fdd28a6a700 1 -- 172.21.15.155:0/897732002 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55958bff9500 con 0x55958c3c7400 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.976+0000 7fdd442a1700 1 --2- 172.21.15.155:0/897732002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c46a000 0x55958c269700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.976+0000 7fdd45af6a80 5 note: GC not initialized 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.976+0000 7fdd442a1700 1 --2- 172.21.15.155:0/897732002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c46a000 0x55958c269700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55958c363f80 tx=0x55958c2ca000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.977+0000 7fdd26265700 20 reqs_thread_entry: start 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.977+0000 7fdd45af6a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.977+0000 7fdd45af6a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:38.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.977+0000 7fdd24261700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:09 2024 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.977+0000 7fdd23a3f700 20 reqs_thread_entry: start 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.977+0000 7fdd45af6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.977+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c7c00 con 0x55958bf7f800 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.978+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.978+0000 7fdd45af6a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.978+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c46a400 con 0x55958c309400 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.978+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.978+0000 7fdd2aa6e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.978+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94100791328768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c46a800 con 0x55958bf7f800 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.980+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94100791328768] v30'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.980+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94100789779200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c46b400 con 0x55958c309400 2024-04-19T23:45:38.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.981+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94100789779200] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.981+0000 7fdd45af6a80 20 remove_watcher() i=0 2024-04-19T23:45:38.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.981+0000 7fdd45af6a80 2 removed watcher, disabling cache 2024-04-19T23:45:38.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.981+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94100789780352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c46b800 con 0x55958bf7f800 2024-04-19T23:45:38.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.982+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94100789780352] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.982+0000 7fdd45af6a80 20 remove_watcher() i=1 2024-04-19T23:45:38.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.982+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94100789781504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c46bc00 con 0x55958c309000 2024-04-19T23:45:38.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.985+0000 7fdd43aa0700 1 -- 172.21.15.155:0/3062260567 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94100789781504] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3bf200 con 0x55958c309000 2024-04-19T23:45:38.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.985+0000 7fdd45af6a80 20 remove_watcher() i=2 2024-04-19T23:45:38.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.985+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94100789782656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c46a400 con 0x55958c309400 2024-04-19T23:45:38.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.986+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94100789782656] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3bf440 con 0x55958c309400 2024-04-19T23:45:38.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.986+0000 7fdd45af6a80 20 remove_watcher() i=3 2024-04-19T23:45:38.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.986+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94100789783808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c46b400 con 0x55958bf7f800 2024-04-19T23:45:38.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.987+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94100789783808] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958bf7f800 2024-04-19T23:45:38.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.987+0000 7fdd45af6a80 20 remove_watcher() i=4 2024-04-19T23:45:38.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.987+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94100789784960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c46b000 con 0x55958c3c6000 2024-04-19T23:45:38.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.990+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94100789784960] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.990+0000 7fdd45af6a80 20 remove_watcher() i=5 2024-04-19T23:45:38.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.990+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94100789786112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c46ac00 con 0x55958c3c6000 2024-04-19T23:45:38.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.993+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94100789786112] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.993+0000 7fdd45af6a80 20 remove_watcher() i=6 2024-04-19T23:45:38.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.993+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94100789787264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55958c3c6c00 con 0x55958c3c6000 2024-04-19T23:45:38.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.995+0000 7fdd442a1700 1 -- 172.21.15.155:0/3062260567 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94100789787264] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55958c3beb40 con 0x55958c3c6000 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 20 remove_watcher() i=7 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55958c3c6000 msgr2=0x55958c269180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55958c3c6000 0x55958c269180 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55958bf7f800 msgr2=0x55958c267b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55958bf7f800 0x55958c267b80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55958c309400 msgr2=0x55958c268c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55958c309400 0x55958c268c00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55958c309000 msgr2=0x55958c268100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55958c309000 0x55958c268100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c308c00 msgr2=0x55958c267600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c308c00 0x55958c267600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55958c261890 tx=0x55958c06f800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 msgr2=0x55958c266b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/3062260567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7f400 0x55958c266b00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55958cdfc750 tx=0x55958c2ca120 comp rx=0 tx=0).stop 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 reap_dead start 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd4329f700 1 -- 172.21.15.155:0/3062260567 reap_dead start 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 shutdown_connections 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 >> 172.21.15.155:0/3062260567 conn(0x55958bf7ec00 msgr2=0x55958c06b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 shutdown_connections 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/3062260567 wait complete. 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/897732002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c46a000 msgr2=0x55958c269700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/897732002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c46a000 0x55958c269700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55958c363f80 tx=0x55958c2ca000 comp rx=0 tx=0).stop 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/897732002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 msgr2=0x55958c268680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/897732002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55958c3e8210 tx=0x55958c2cb800 comp rx=0 tx=0).stop 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/897732002 shutdown_connections 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/897732002 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c46a000 0x55958c269700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/897732002 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958c3c7400 0x55958c268680 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/897732002 >> 172.21.15.155:0/897732002 conn(0x55958c3c6800 msgr2=0x55958c06c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:38.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/897732002 shutdown_connections 2024-04-19T23:45:39.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.996+0000 7fdd45af6a80 1 -- 172.21.15.155:0/897732002 wait complete. 2024-04-19T23:45:39.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.997+0000 7fdd45af6a80 1 -- 172.21.15.155:0/824229554 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c308000 msgr2=0x55958c267080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.997+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/824229554 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c308000 0x55958c267080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55958cdfd020 tx=0x55958c2ca240 comp rx=0 tx=0).stop 2024-04-19T23:45:39.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.997+0000 7fdd45af6a80 1 -- 172.21.15.155:0/824229554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 msgr2=0x55958c266580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.997+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/824229554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55958cd496b0 tx=0x55958c06fa40 comp rx=0 tx=0).stop 2024-04-19T23:45:39.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.997+0000 7fdd45af6a80 1 -- 172.21.15.155:0/824229554 shutdown_connections 2024-04-19T23:45:39.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.997+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/824229554 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55958c308000 0x55958c267080 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.997+0000 7fdd45af6a80 1 --2- 172.21.15.155:0/824229554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55958bf7e800 0x55958c266580 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.997+0000 7fdd45af6a80 1 -- 172.21.15.155:0/824229554 >> 172.21.15.155:0/824229554 conn(0x55958bf7e400 msgr2=0x55958c06b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.997+0000 7fdd45af6a80 1 -- 172.21.15.155:0/824229554 shutdown_connections 2024-04-19T23:45:39.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:38.997+0000 7fdd45af6a80 1 -- 172.21.15.155:0/824229554 wait complete. 2024-04-19T23:45:39.001 INFO:teuthology.orchestra.run.smithi155.stdout:[] 2024-04-19T23:45:39.001 DEBUG:tasks.util.rgw: json result: [] 2024-04-19T23:45:39.001 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-19T23:45:39.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-19T23:45:39.002 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-19T23:45:39.046 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:39.046 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:39.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.047+0000 7f3bcf613a80 1 Processor -- start 2024-04-19T23:45:39.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.047+0000 7f3bcf613a80 1 -- start start 2024-04-19T23:45:39.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.047+0000 7f3bcf613a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56149bd36c00 0x56149c01e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.047+0000 7f3bcf613a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56149c061500 con 0x56149bd36800 2024-04-19T23:45:39.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.047+0000 7f3bcf613a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x56149bdd8a00 con 0x56149bd36c00 2024-04-19T23:45:39.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.047+0000 7f3bccdbc700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56149bd36c00 0x56149c01e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.047+0000 7f3bccdbc700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56149bd36c00 0x56149c01e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35192/0 (socket says 172.21.15.155:35192) 2024-04-19T23:45:39.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.047+0000 7f3bcd5bd700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x56149bd36800 0x56149be22800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46642/0 (socket says 172.21.15.155:46642) 2024-04-19T23:45:39.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.047+0000 7f3bccdbc700 1 -- 172.21.15.155:0/705611581 learned_addr learned my addr 172.21.15.155:0/705611581 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.048+0000 7f3bccdbc700 1 -- 172.21.15.155:0/705611581 >> v1:172.21.15.76:6789/0 conn(0x56149bd36800 legacy=0x56149be22800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.048+0000 7f3bccdbc700 1 -- 172.21.15.155:0/705611581 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56149bd5fd40 con 0x56149bd36c00 2024-04-19T23:45:39.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.048+0000 7f3bccdbc700 1 --2- 172.21.15.155:0/705611581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36c00 0x56149c01e580 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x56149c019890 tx=0x56149be27920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436fb1cda646d9ac server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.048+0000 7f3bcc5bb700 1 -- 172.21.15.155:0/705611581 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149bdef4a0 con 0x56149bd36c00 2024-04-19T23:45:39.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.048+0000 7f3bcc5bb700 1 -- 172.21.15.155:0/705611581 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56149c061800 con 0x56149bd36c00 2024-04-19T23:45:39.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.048+0000 7f3bcc5bb700 1 -- 172.21.15.155:0/705611581 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149bdef600 con 0x56149bd36c00 2024-04-19T23:45:39.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.048+0000 7f3bcf613a80 1 -- 172.21.15.155:0/705611581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36c00 msgr2=0x56149c01e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.048+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/705611581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36c00 0x56149c01e580 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x56149c019890 tx=0x56149be27920 comp rx=0 tx=0).stop 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.049+0000 7f3bcf613a80 1 -- 172.21.15.155:0/705611581 shutdown_connections 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.049+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/705611581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36c00 0x56149c01e580 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.049+0000 7f3bcf613a80 1 -- 172.21.15.155:0/705611581 >> 172.21.15.155:0/705611581 conn(0x56149bd36400 msgr2=0x56149be22000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.049+0000 7f3bcf613a80 1 -- 172.21.15.155:0/705611581 shutdown_connections 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.049+0000 7f3bcf613a80 1 -- 172.21.15.155:0/705611581 wait complete. 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.049+0000 7f3bcf613a80 1 Processor -- start 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.049+0000 7f3bcf613a80 1 -- start start 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.049+0000 7f3bcf613a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.049+0000 7f3bcf613a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149bdd8500 con 0x56149bd36800 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcd5bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcd5bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35194/0 (socket says 172.21.15.155:35194) 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/1491198145 learned_addr learned my addr 172.21.15.155:0/1491198145 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/1491198145 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56149bd5fba0 con 0x56149bd36800 2024-04-19T23:45:39.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcd5bd700 1 --2- 172.21.15.155:0/1491198145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x56149cafd890 tx=0x56149be27b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f109a8239f12f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcbdba700 1 -- 172.21.15.155:0/1491198145 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149bdef4a0 con 0x56149bd36800 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcbdba700 1 -- 172.21.15.155:0/1491198145 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56149c061b00 con 0x56149bd36800 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcbdba700 1 -- 172.21.15.155:0/1491198145 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149bdef600 con 0x56149bd36800 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcf613a80 1 -- 172.21.15.155:0/1491198145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 msgr2=0x56149c01e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/1491198145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x56149cafd890 tx=0x56149be27b60 comp rx=0 tx=0).stop 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcf613a80 1 -- 172.21.15.155:0/1491198145 shutdown_connections 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/1491198145 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcf613a80 1 -- 172.21.15.155:0/1491198145 >> 172.21.15.155:0/1491198145 conn(0x56149bd36400 msgr2=0x56149be23000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.050+0000 7f3bcf613a80 1 -- 172.21.15.155:0/1491198145 shutdown_connections 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.051+0000 7f3bcf613a80 1 -- 172.21.15.155:0/1491198145 wait complete. 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.051+0000 7f3bcf613a80 1 Processor -- start 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.051+0000 7f3bcf613a80 1 -- start start 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.051+0000 7f3bcf613a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.051+0000 7f3bcf613a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149bdd83c0 con 0x56149bd36800 2024-04-19T23:45:39.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.051+0000 7f3bcd5bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.051+0000 7f3bcd5bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35204/0 (socket says 172.21.15.155:35204) 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.051+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/2643308349 learned_addr learned my addr 172.21.15.155:0/2643308349 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.051+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/2643308349 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56149bd5fa00 con 0x56149bd36800 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.051+0000 7f3bcd5bd700 1 --2- 172.21.15.155:0/2643308349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x56149cafd6b0 tx=0x56149be27a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bca5b7700 1 -- 172.21.15.155:0/2643308349 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149bdef8c0 con 0x56149bd36800 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bca5b7700 1 -- 172.21.15.155:0/2643308349 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56149bdd7c80 con 0x56149bd36800 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2643308349 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56149bd5f860 con 0x56149bd36800 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bca5b7700 1 -- 172.21.15.155:0/2643308349 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149bdef4a0 con 0x56149bd36800 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2643308349 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56149bd5f6c0 con 0x56149bd36800 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bcf613a80 1 Processor -- start 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bcf613a80 1 -- start start 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bca5b7700 1 -- 172.21.15.155:0/2643308349 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56149cad8b00 con 0x56149bd36800 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bcf613a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bcf613a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149bdd8000 con 0x56149bd37400 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bca5b7700 1 --2- 172.21.15.155:0/2643308349 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c0be000 0x56149c01f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bca5b7700 1 -- 172.21.15.155:0/2643308349 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56149bdb1180 con 0x56149bd36800 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.052+0000 7f3bcddbe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcddbe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35206/0 (socket says 172.21.15.155:35206) 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcddbe700 1 -- 172.21.15.155:0/3044550027 learned_addr learned my addr 172.21.15.155:0/3044550027 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcd5bd700 1 --2- 172.21.15.155:0/2643308349 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c0be000 0x56149c01f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcddbe700 1 -- 172.21.15.155:0/3044550027 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56149bd5e000 con 0x56149bd37400 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcd5bd700 1 --2- 172.21.15.155:0/2643308349 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c0be000 0x56149c01f080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x56149cbb5020 tx=0x56149c084240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcddbe700 1 --2- 172.21.15.155:0/3044550027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x56149cbb4bd0 tx=0x56149c084060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9195a2d22794e794 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bc7db2700 1 -- 172.21.15.155:0/3044550027 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149bdef8c0 con 0x56149bd37400 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bc7db2700 1 -- 172.21.15.155:0/3044550027 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56149c060300 con 0x56149bd37400 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bc7db2700 1 -- 172.21.15.155:0/3044550027 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149bdef4a0 con 0x56149bd37400 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3044550027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 msgr2=0x56149c01eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/3044550027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x56149cbb4bd0 tx=0x56149c084060 comp rx=0 tx=0).stop 2024-04-19T23:45:39.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3044550027 shutdown_connections 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/3044550027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3044550027 >> 172.21.15.155:0/3044550027 conn(0x56149bd36c00 msgr2=0x56149be23800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.053+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3044550027 shutdown_connections 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.054+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3044550027 wait complete. 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.054+0000 7f3bcf613a80 1 Processor -- start 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.054+0000 7f3bcf613a80 1 -- start start 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.054+0000 7f3bcf613a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.054+0000 7f3bcf613a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149bd72640 con 0x56149bd37400 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.054+0000 7f3bcddbe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.054+0000 7f3bcddbe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35212/0 (socket says 172.21.15.155:35212) 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.054+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 learned_addr learned my addr 172.21.15.155:0/402643735 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.054+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56149bd5eea0 con 0x56149bd37400 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.054+0000 7f3bcddbe700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x56149cbb4750 tx=0x56149be27f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.055+0000 7f3bc65af700 1 -- 172.21.15.155:0/402643735 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149bdefb80 con 0x56149bd37400 2024-04-19T23:45:39.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.055+0000 7f3bc65af700 1 -- 172.21.15.155:0/402643735 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56149bdd7c80 con 0x56149bd37400 2024-04-19T23:45:39.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.055+0000 7f3bc65af700 1 -- 172.21.15.155:0/402643735 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149bdef8c0 con 0x56149bd37400 2024-04-19T23:45:39.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.055+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56149bd5e820 con 0x56149bd37400 2024-04-19T23:45:39.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.055+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56149bd5e9c0 con 0x56149bd37400 2024-04-19T23:45:39.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.055+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.056+0000 7f3bc65af700 1 -- 172.21.15.155:0/402643735 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56149cad8dc0 con 0x56149bd37400 2024-04-19T23:45:39.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.056+0000 7f3bc65af700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c0bec00 0x56149c01f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.056+0000 7f3bc65af700 1 -- 172.21.15.155:0/402643735 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56149bdb1340 con 0x56149bd37400 2024-04-19T23:45:39.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.056+0000 7f3bccdbc700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c0bec00 0x56149c01f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.056+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56149bd37800 0x56149c01fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.056+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149bd37c00 con 0x56149bd37800 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.056+0000 7f3bcddbe700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56149bd37800 0x56149c01fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.056+0000 7f3bccdbc700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c0bec00 0x56149c01f600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x56149c019890 tx=0x56149be27800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.056+0000 7f3bcddbe700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56149bd37800 0x56149c01fb80 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 20 realm 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c0bf000 con 0x56149bd37800 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c0bf400 con 0x56149bd37800 2024-04-19T23:45:39.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c0bf800 con 0x56149bd37800 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c0bfc00 con 0x56149bd37800 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 20 searching for the correct realm 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.057+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56149c0bf000 0x56149c020100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.058+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c0bf400 con 0x56149c0bf000 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.058+0000 7f3bcd5bd700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56149c0bf000 0x56149c020100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.058+0000 7f3bcd5bd700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56149c0bf000 0x56149c020100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.058+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.058+0000 7f3bcd5bd700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56149c0bf400 0x56149c020c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.058+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182000 con 0x56149c0bf400 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.058+0000 7f3bccdbc700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56149c0bf400 0x56149c020c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.059+0000 7f3bccdbc700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56149c0bf400 0x56149c020c00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.059+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.059+0000 7f3bccdbc700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56149c182000 0x56149c021180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.059+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c182000 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.059+0000 7f3bcddbe700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56149c182000 0x56149c021180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.060+0000 7f3bcddbe700 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56149c182000 0x56149c021180 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.060+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.060+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149bd37800 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.060+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.060+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149bd37800 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.060+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.060+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c182000 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.061+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.061+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c182000 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.061+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.061+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf400 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.061+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.061+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf000 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.061+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.061+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149bd37800 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.061+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.061+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c182000 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.062+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.062+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149bd37800 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.062+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.062+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf400 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.062+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.062+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf000 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.062+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.062+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf000 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.063+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.063+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c182000 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.063+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.063+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf000 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.063+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.063+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf000 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.063+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.063+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149bd37800 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.064+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.064+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149bd37800 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.064+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.064+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c182000 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.064+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.064+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf000 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.064+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.064+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf400 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.064+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.064+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149bd37800 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.065+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.065+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c182000 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.065+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.065+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf000 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.065+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.065+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c182000 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.065+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.065+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf400 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.066+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.066+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf000 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.066+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.066+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c182000 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.066+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.066+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149bd37800 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.066+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.066+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf400 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149bd37c00 con 0x56149bd37800 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182c00 con 0x56149bd37800 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c183000 con 0x56149c0bf400 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 zone default found 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 4 Realm: () 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 zonegroup default 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.067+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c183400 con 0x56149c182000 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcf613a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c183800 con 0x56149c0bf000 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcf613a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c183c00 con 0x56149c0bf000 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcf613a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcf613a80 20 started sync module instance, tier type = 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcf613a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.068+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182c00 con 0x56149c0bf400 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.069+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.069+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94646516669184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149bd37c00 con 0x56149c0bf400 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.069+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c0bf800 con 0x56149bd37800 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.072+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.072+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94646516670336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c0bfc00 con 0x56149bd37800 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.072+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c0bf000 2024-04-19T23:45:39.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.072+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94646516669184] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.074+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94646516670336] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.077+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.077+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94646516671488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c183000 con 0x56149c0bf000 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.077+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182c00 con 0x56149c0bf400 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.078+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.078+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94646516672640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182400 con 0x56149c0bf400 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.078+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c183800 con 0x56149bd37800 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.079+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94646516672640] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.079+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94646516671488] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.082+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.082+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94646516673792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c183c00 con 0x56149bd37800 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.082+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182800 con 0x56149c182000 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.085+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.085+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94646516674944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c183400 con 0x56149c182000 2024-04-19T23:45:39.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.085+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c183800 con 0x56149c182000 2024-04-19T23:45:39.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.087+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94646516673792] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.090+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94646516674944] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.090+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.090+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94646516676096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c183c00 con 0x56149c182000 2024-04-19T23:45:39.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.090+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c0bf800 con 0x56149c182000 2024-04-19T23:45:39.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.093+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.093+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94646516676096] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.093+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94646516677248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c0bfc00 con 0x56149c182000 2024-04-19T23:45:39.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.093+0000 7f3bcf613a80 20 add_watcher() i=0 2024-04-19T23:45:39.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.093+0000 7f3bcf613a80 20 add_watcher() i=1 2024-04-19T23:45:39.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.093+0000 7f3bcf613a80 20 add_watcher() i=2 2024-04-19T23:45:39.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.093+0000 7f3bcf613a80 20 add_watcher() i=3 2024-04-19T23:45:39.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.093+0000 7f3bcf613a80 20 add_watcher() i=4 2024-04-19T23:45:39.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.093+0000 7f3bcf613a80 20 add_watcher() i=5 2024-04-19T23:45:39.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.093+0000 7f3bcf613a80 20 add_watcher() i=6 2024-04-19T23:45:39.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.095+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94646516677248] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.095+0000 7f3bcf613a80 20 add_watcher() i=7 2024-04-19T23:45:39.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.095+0000 7f3bcf613a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:39.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.095+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c0bf800 con 0x56149bd37800 2024-04-19T23:45:39.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.095+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.096+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94646518235136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c0bfc00 con 0x56149bd37800 2024-04-19T23:45:39.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.096+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94646518235136] v30'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.096+0000 7f3bb458b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.097+0000 7f3bcf613a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:39.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.097+0000 7f3bcf613a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:39.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.097+0000 7f3bcf613a80 1 Processor -- start 2024-04-19T23:45:39.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.097+0000 7f3bcf613a80 1 -- start start 2024-04-19T23:45:39.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.097+0000 7f3bcf613a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.097+0000 7f3bcf613a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149bd72780 con 0x56149c183400 2024-04-19T23:45:39.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.097+0000 7f3bccdbc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.097+0000 7f3bccdbc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35216/0 (socket says 172.21.15.155:35216) 2024-04-19T23:45:39.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.097+0000 7f3bccdbc700 1 -- 172.21.15.155:0/2773975657 learned_addr learned my addr 172.21.15.155:0/2773975657 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.097+0000 7f3bccdbc700 1 -- 172.21.15.155:0/2773975657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56149bd5eb60 con 0x56149c183400 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.098+0000 7f3bccdbc700 1 --2- 172.21.15.155:0/2773975657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x56149cbb5200 tx=0x56149c0856e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84ea87c06f6f216 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.098+0000 7f3bb3d8a700 1 -- 172.21.15.155:0/2773975657 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149bdef760 con 0x56149c183400 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.098+0000 7f3bb3d8a700 1 -- 172.21.15.155:0/2773975657 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56149c1a6000 con 0x56149c183400 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.098+0000 7f3bb3d8a700 1 -- 172.21.15.155:0/2773975657 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149c1ae000 con 0x56149c183400 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.098+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2773975657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 msgr2=0x56149c020680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.098+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/2773975657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x56149cbb5200 tx=0x56149c0856e0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.098+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2773975657 shutdown_connections 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.098+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/2773975657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.098+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2773975657 >> 172.21.15.155:0/2773975657 conn(0x56149c182800 msgr2=0x56149be24000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.098+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2773975657 shutdown_connections 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.098+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2773975657 wait complete. 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.099+0000 7f3bcf613a80 1 Processor -- start 2024-04-19T23:45:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.099+0000 7f3bcf613a80 1 -- start start 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.099+0000 7f3bcf613a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.099+0000 7f3bcf613a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149bdd8000 con 0x56149c183400 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.099+0000 7f3bccdbc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.099+0000 7f3bccdbc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35218/0 (socket says 172.21.15.155:35218) 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.099+0000 7f3bccdbc700 1 -- 172.21.15.155:0/3869439155 learned_addr learned my addr 172.21.15.155:0/3869439155 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.099+0000 7f3bccdbc700 1 -- 172.21.15.155:0/3869439155 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56149bd5ed00 con 0x56149c183400 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.100+0000 7f3bccdbc700 1 --2- 172.21.15.155:0/3869439155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x56149c1a4210 tx=0x56149c085800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.100+0000 7f3bb2587700 1 -- 172.21.15.155:0/3869439155 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149c1ae160 con 0x56149c183400 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.100+0000 7f3bb2587700 1 -- 172.21.15.155:0/3869439155 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56149c1a6180 con 0x56149c183400 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.100+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3869439155 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56149bd5e340 con 0x56149c183400 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.100+0000 7f3bb2587700 1 -- 172.21.15.155:0/3869439155 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56149c1ae2c0 con 0x56149c183400 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.100+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3869439155 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56149bd5fd40 con 0x56149c183400 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.100+0000 7f3bb2587700 1 -- 172.21.15.155:0/3869439155 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56149cad9b80 con 0x56149c183400 2024-04-19T23:45:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.100+0000 7f3bb2587700 1 --2- 172.21.15.155:0/3869439155 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c222000 0x56149c021700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.101+0000 7f3bb2587700 1 -- 172.21.15.155:0/3869439155 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56149bdb1500 con 0x56149c183400 2024-04-19T23:45:39.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.101+0000 7f3bcddbe700 1 --2- 172.21.15.155:0/3869439155 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c222000 0x56149c021700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.101+0000 7f3bcf613a80 5 note: GC not initialized 2024-04-19T23:45:39.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.101+0000 7f3bcddbe700 1 --2- 172.21.15.155:0/3869439155 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c222000 0x56149c021700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x56149c11bf80 tx=0x56149c0855c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.101+0000 7f3bafd82700 20 reqs_thread_entry: start 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.102+0000 7f3bcf613a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.102+0000 7f3bcf613a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.102+0000 7f3badd7e700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:09 2024 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.102+0000 7f3bad55c700 20 reqs_thread_entry: start 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.102+0000 7f3bcf613a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.102+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c183c00 con 0x56149bd37800 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.102+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.102+0000 7f3bcf613a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.102+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c222400 con 0x56149c0bf400 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.102+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.103+0000 7f3bb458b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.103+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94646518235136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c222800 con 0x56149bd37800 2024-04-19T23:45:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.104+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94646518235136] v30'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.104+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94646516669184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c223400 con 0x56149c0bf400 2024-04-19T23:45:39.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.105+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94646516669184] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.105+0000 7f3bcf613a80 20 remove_watcher() i=0 2024-04-19T23:45:39.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.105+0000 7f3bcf613a80 2 removed watcher, disabling cache 2024-04-19T23:45:39.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.105+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94646516670336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c223800 con 0x56149bd37800 2024-04-19T23:45:39.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.106+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94646516670336] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.106+0000 7f3bcf613a80 20 remove_watcher() i=1 2024-04-19T23:45:39.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.106+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94646516671488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c223c00 con 0x56149c0bf000 2024-04-19T23:45:39.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.108+0000 7f3bcd5bd700 1 -- 172.21.15.155:0/402643735 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94646516671488] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15f200 con 0x56149c0bf000 2024-04-19T23:45:39.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.108+0000 7f3bcf613a80 20 remove_watcher() i=2 2024-04-19T23:45:39.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.108+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94646516672640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c222400 con 0x56149c0bf400 2024-04-19T23:45:39.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.109+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94646516672640] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15f440 con 0x56149c0bf400 2024-04-19T23:45:39.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.109+0000 7f3bcf613a80 20 remove_watcher() i=3 2024-04-19T23:45:39.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.109+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94646516673792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c223400 con 0x56149bd37800 2024-04-19T23:45:39.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.110+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94646516673792] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149bd37800 2024-04-19T23:45:39.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.110+0000 7f3bcf613a80 20 remove_watcher() i=4 2024-04-19T23:45:39.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.110+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94646516674944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c223000 con 0x56149c182000 2024-04-19T23:45:39.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.111+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94646516674944] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.111+0000 7f3bcf613a80 20 remove_watcher() i=5 2024-04-19T23:45:39.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.111+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94646516676096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c222c00 con 0x56149c182000 2024-04-19T23:45:39.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.112+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94646516676096] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.112+0000 7f3bcf613a80 20 remove_watcher() i=6 2024-04-19T23:45:39.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.112+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94646516677248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56149c182c00 con 0x56149c182000 2024-04-19T23:45:39.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcddbe700 1 -- 172.21.15.155:0/402643735 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94646516677248] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56149c15eb40 con 0x56149c182000 2024-04-19T23:45:39.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 20 remove_watcher() i=7 2024-04-19T23:45:39.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56149c182000 msgr2=0x56149c021180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56149c182000 0x56149c021180 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56149bd37800 msgr2=0x56149c01fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56149bd37800 0x56149c01fb80 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56149c0bf400 msgr2=0x56149c020c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56149c0bf400 0x56149c020c00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56149c0bf000 msgr2=0x56149c020100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56149c0bf000 0x56149c020100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c0bec00 msgr2=0x56149c01f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c0bec00 0x56149c01f600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x56149c019890 tx=0x56149be27800 comp rx=0 tx=0).stop 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 msgr2=0x56149c01eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bccdbc700 1 -- 172.21.15.155:0/402643735 reap_dead start 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x56149cbb4750 tx=0x56149be27f20 comp rx=0 tx=0).stop 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 shutdown_connections 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/402643735 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd37400 0x56149c01eb00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 >> 172.21.15.155:0/402643735 conn(0x56149bd36c00 msgr2=0x56149be23800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 shutdown_connections 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/402643735 wait complete. 2024-04-19T23:45:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3869439155 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c222000 msgr2=0x56149c021700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/3869439155 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c222000 0x56149c021700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x56149c11bf80 tx=0x56149c0855c0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3869439155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 msgr2=0x56149c020680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/3869439155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x56149c1a4210 tx=0x56149c085800 comp rx=0 tx=0).stop 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3869439155 shutdown_connections 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/3869439155 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c222000 0x56149c021700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/3869439155 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149c183400 0x56149c020680 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3869439155 >> 172.21.15.155:0/3869439155 conn(0x56149c182800 msgr2=0x56149be24000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3869439155 shutdown_connections 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.113+0000 7f3bcf613a80 1 -- 172.21.15.155:0/3869439155 wait complete. 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.114+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2643308349 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c0be000 msgr2=0x56149c01f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.114+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/2643308349 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c0be000 0x56149c01f080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x56149cbb5020 tx=0x56149c084240 comp rx=0 tx=0).stop 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.114+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2643308349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 msgr2=0x56149c01e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.114+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/2643308349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x56149cafd6b0 tx=0x56149be27a40 comp rx=0 tx=0).stop 2024-04-19T23:45:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.114+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2643308349 shutdown_connections 2024-04-19T23:45:39.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.114+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/2643308349 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56149c0be000 0x56149c01f080 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.114+0000 7f3bcf613a80 1 --2- 172.21.15.155:0/2643308349 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56149bd36800 0x56149c01e580 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.114+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2643308349 >> 172.21.15.155:0/2643308349 conn(0x56149bd36400 msgr2=0x56149be23000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.114+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2643308349 shutdown_connections 2024-04-19T23:45:39.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.114+0000 7f3bcf613a80 1 -- 172.21.15.155:0/2643308349 wait complete. 2024-04-19T23:45:39.119 INFO:teuthology.orchestra.run.smithi155.stdout:[] 2024-04-19T23:45:39.119 DEBUG:tasks.util.rgw: json result: [] 2024-04-19T23:45:39.173 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:39.173 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-19T23:45:39.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-19T23:45:39.174 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-19T23:45:39.219 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:39.219 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.220+0000 7f32e30a7a80 1 Processor -- start 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.220+0000 7f32e30a7a80 1 -- start start 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.220+0000 7f32e30a7a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.220+0000 7f32e30a7a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b396257500 con 0x55b395f2cc00 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.220+0000 7f32e30a7a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b395fcea00 con 0x55b395f2c800 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.220+0000 7f32e1051700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.220+0000 7f32e0850700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55b395f2cc00 0x55b396018800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46654/0 (socket says 172.21.15.155:46654) 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.220+0000 7f32e1051700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35220/0 (socket says 172.21.15.155:35220) 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.220+0000 7f32e0850700 1 -- 172.21.15.155:0/2314935255 learned_addr learned my addr 172.21.15.155:0/2314935255 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.220+0000 7f32e1051700 1 -- 172.21.15.155:0/2314935255 >> v1:172.21.15.76:6789/0 conn(0x55b395f2cc00 legacy=0x55b396018800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.220+0000 7f32e1051700 1 -- 172.21.15.155:0/2314935255 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b395f55d40 con 0x55b395f2c800 2024-04-19T23:45:39.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.221+0000 7f32e1051700 1 --2- 172.21.15.155:0/2314935255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55b39620f9e0 tx=0x55b39601d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c96b5212242483a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.221+0000 7f32e004f700 1 -- 172.21.15.155:0/2314935255 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b395fe54a0 con 0x55b395f2c800 2024-04-19T23:45:39.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.221+0000 7f32e004f700 1 -- 172.21.15.155:0/2314935255 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b396257800 con 0x55b395f2c800 2024-04-19T23:45:39.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.221+0000 7f32e004f700 1 -- 172.21.15.155:0/2314935255 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b395fe5600 con 0x55b395f2c800 2024-04-19T23:45:39.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.221+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2314935255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 msgr2=0x55b396214580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.221+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/2314935255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55b39620f9e0 tx=0x55b39601d920 comp rx=0 tx=0).stop 2024-04-19T23:45:39.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.221+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2314935255 shutdown_connections 2024-04-19T23:45:39.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.221+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/2314935255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.221+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2314935255 >> 172.21.15.155:0/2314935255 conn(0x55b395f2c400 msgr2=0x55b396018000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.221+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2314935255 shutdown_connections 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.221+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2314935255 wait complete. 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.222+0000 7f32e30a7a80 1 Processor -- start 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.222+0000 7f32e30a7a80 1 -- start start 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.222+0000 7f32e30a7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.222+0000 7f32e30a7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395fce500 con 0x55b395f2c800 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.223+0000 7f32e1051700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.223+0000 7f32e1051700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35228/0 (socket says 172.21.15.155:35228) 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.223+0000 7f32e1051700 1 -- 172.21.15.155:0/1414897922 learned_addr learned my addr 172.21.15.155:0/1414897922 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.223+0000 7f32e1051700 1 -- 172.21.15.155:0/1414897922 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b395f55ba0 con 0x55b395f2c800 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.223+0000 7f32e1051700 1 --2- 172.21.15.155:0/1414897922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x55b39620eb70 tx=0x55b39601d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fae2ec1ca49396a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.223+0000 7f32df84e700 1 -- 172.21.15.155:0/1414897922 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b395fe5760 con 0x55b395f2c800 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.223+0000 7f32df84e700 1 -- 172.21.15.155:0/1414897922 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b396257b00 con 0x55b395f2c800 2024-04-19T23:45:39.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.223+0000 7f32df84e700 1 -- 172.21.15.155:0/1414897922 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b395fe51e0 con 0x55b395f2c800 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.224+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1414897922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 msgr2=0x55b396214580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.224+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/1414897922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x55b39620eb70 tx=0x55b39601d800 comp rx=0 tx=0).stop 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.224+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1414897922 shutdown_connections 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.224+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/1414897922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.224+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1414897922 >> 172.21.15.155:0/1414897922 conn(0x55b395f2c400 msgr2=0x55b396019000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.224+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1414897922 shutdown_connections 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.224+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1414897922 wait complete. 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.224+0000 7f32e30a7a80 1 Processor -- start 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.224+0000 7f32e30a7a80 1 -- start start 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.224+0000 7f32e30a7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.224+0000 7f32e30a7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395fce3c0 con 0x55b395f2c800 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.225+0000 7f32e1051700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.225+0000 7f32e1051700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35244/0 (socket says 172.21.15.155:35244) 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.225+0000 7f32e1051700 1 -- 172.21.15.155:0/1390320608 learned_addr learned my addr 172.21.15.155:0/1390320608 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.225+0000 7f32e1051700 1 -- 172.21.15.155:0/1390320608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b395f55a00 con 0x55b395f2c800 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.225+0000 7f32e1051700 1 --2- 172.21.15.155:0/1390320608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55b396d079e0 tx=0x55b39601d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.225+0000 7f32de04b700 1 -- 172.21.15.155:0/1390320608 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b395fe54a0 con 0x55b395f2c800 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.225+0000 7f32de04b700 1 -- 172.21.15.155:0/1390320608 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b396257c80 con 0x55b395f2c800 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.225+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1390320608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b395f55860 con 0x55b395f2c800 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.225+0000 7f32de04b700 1 -- 172.21.15.155:0/1390320608 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b395fe5600 con 0x55b395f2c800 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.225+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1390320608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b395f556c0 con 0x55b395f2c800 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32e30a7a80 1 Processor -- start 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32e30a7a80 1 -- start start 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32de04b700 1 -- 172.21.15.155:0/1390320608 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55b396cceb00 con 0x55b395f2c800 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32e30a7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 0x55b396214b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32e30a7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395fce000 con 0x55b395f2d400 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32de04b700 1 --2- 172.21.15.155:0/1390320608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b3962b6000 0x55b396215080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32de04b700 1 -- 172.21.15.155:0/1390320608 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55b395fa7180 con 0x55b395f2c800 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32e1852700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 0x55b396214b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32e1051700 1 --2- 172.21.15.155:0/1390320608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b3962b6000 0x55b396215080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32e1852700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 0x55b396214b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35254/0 (socket says 172.21.15.155:35254) 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32e1852700 1 -- 172.21.15.155:0/1445250564 learned_addr learned my addr 172.21.15.155:0/1445250564 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32e1852700 1 -- 172.21.15.155:0/1445250564 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b395f54000 con 0x55b395f2d400 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32e1051700 1 --2- 172.21.15.155:0/1390320608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b3962b6000 0x55b396215080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55b396daf050 tx=0x55b39627a540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32e1852700 1 --2- 172.21.15.155:0/1445250564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 0x55b396214b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55b396dae3f0 tx=0x55b39627a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b1327c6a10bee3 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.226+0000 7f32db846700 1 -- 172.21.15.155:0/1445250564 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b395fe54a0 con 0x55b395f2d400 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32db846700 1 -- 172.21.15.155:0/1445250564 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b395fcdc80 con 0x55b395f2d400 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32db846700 1 -- 172.21.15.155:0/1445250564 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b395fe5600 con 0x55b395f2d400 2024-04-19T23:45:39.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1445250564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 msgr2=0x55b396214b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/1445250564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 0x55b396214b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55b396dae3f0 tx=0x55b39627a720 comp rx=0 tx=0).stop 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1445250564 shutdown_connections 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/1445250564 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 0x55b396214b00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1445250564 >> 172.21.15.155:0/1445250564 conn(0x55b395f2cc00 msgr2=0x55b396019800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1445250564 shutdown_connections 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1445250564 wait complete. 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32e30a7a80 1 Processor -- start 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32e30a7a80 1 -- start start 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32e30a7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 0x55b396214b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.227+0000 7f32e30a7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395f68640 con 0x55b395f2d400 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.228+0000 7f32e1852700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 0x55b396214b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.228+0000 7f32e1852700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 0x55b396214b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35262/0 (socket says 172.21.15.155:35262) 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.228+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 learned_addr learned my addr 172.21.15.155:0/3285953986 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.228+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b395f54ea0 con 0x55b395f2d400 2024-04-19T23:45:39.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.228+0000 7f32e1852700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 0x55b396214b00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x55b396dae240 tx=0x55b39601d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.228+0000 7f32da043700 1 -- 172.21.15.155:0/3285953986 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b395fe5760 con 0x55b395f2d400 2024-04-19T23:45:39.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.228+0000 7f32da043700 1 -- 172.21.15.155:0/3285953986 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b395fcdb00 con 0x55b395f2d400 2024-04-19T23:45:39.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.228+0000 7f32da043700 1 -- 172.21.15.155:0/3285953986 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b395fe54a0 con 0x55b395f2d400 2024-04-19T23:45:39.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.228+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b395f54820 con 0x55b395f2d400 2024-04-19T23:45:39.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.228+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b395f549c0 con 0x55b395f2d400 2024-04-19T23:45:39.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.229+0000 7f32da043700 1 -- 172.21.15.155:0/3285953986 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55b396ccedc0 con 0x55b395f2d400 2024-04-19T23:45:39.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.229+0000 7f32da043700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b3962b6c00 0x55b396215600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.229+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.229+0000 7f32da043700 1 -- 172.21.15.155:0/3285953986 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55b395fa7340 con 0x55b395f2d400 2024-04-19T23:45:39.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.229+0000 7f32e0850700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b3962b6c00 0x55b396215600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.229+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55b395f2d800 0x55b396215b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.229+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b395f2dc00 con 0x55b395f2d800 2024-04-19T23:45:39.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.229+0000 7f32e1852700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55b395f2d800 0x55b396215b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e0850700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b3962b6c00 0x55b396215600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55b396d06030 tx=0x55b39627b320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e1852700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55b395f2d800 0x55b396215b80 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e30a7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e30a7a80 20 realm 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3962b7000 con 0x55b395f2d800 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e30a7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e30a7a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.230+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3962b7400 con 0x55b395f2d800 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e30a7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3962b7800 con 0x55b395f2d800 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e30a7a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3962b7c00 con 0x55b395f2d800 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e30a7a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e30a7a80 20 searching for the correct realm 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55b3962b7000 0x55b396216100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3962b7400 con 0x55b3962b7000 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.231+0000 7f32e1051700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55b3962b7000 0x55b396216100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.232+0000 7f32e1051700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55b3962b7000 0x55b396216100 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.232+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.232+0000 7f32e1051700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55b3962b7400 0x55b396216c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.232+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0000 con 0x55b3962b7400 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.232+0000 7f32e0850700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55b3962b7400 0x55b396216c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.232+0000 7f32e0850700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55b3962b7400 0x55b396216c00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.232+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.233+0000 7f32e0850700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55b396dd0000 0x55b396217180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.233+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b396dd0000 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.233+0000 7f32e1852700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55b396dd0000 0x55b396217180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.233+0000 7f32e1852700 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55b396dd0000 0x55b396217180 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.233+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.233+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b395f2d800 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.234+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.234+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b395f2d800 2024-04-19T23:45:39.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.234+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.234+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b396dd0000 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.234+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.234+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b396dd0000 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.234+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.234+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7400 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.234+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.234+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7000 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.235+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.235+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b395f2d800 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.235+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.235+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b396dd0000 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.235+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.235+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b395f2d800 2024-04-19T23:45:39.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.235+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.235+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7400 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.235+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.236+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7000 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.236+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.236+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7000 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.236+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.236+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b396dd0000 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.236+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.236+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7000 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.236+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.236+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7000 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.236+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.237+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b395f2d800 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.237+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.237+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b395f2d800 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.237+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.237+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b396dd0000 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.237+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.237+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7000 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.238+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.238+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7400 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.238+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.238+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b395f2d800 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.238+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.238+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b396dd0000 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.238+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.238+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7000 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.239+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.239+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b396dd0000 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.239+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.239+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7400 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.239+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.239+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7000 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b396dd0000 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b395f2d800 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7400 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e30a7a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e30a7a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e30a7a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e30a7a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.240+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b395f2dc00 con 0x55b395f2d800 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0c00 con 0x55b395f2d800 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd1000 con 0x55b3962b7400 2024-04-19T23:45:39.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 20 zone default found 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 4 Realm: () 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 20 zonegroup default 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd1400 con 0x55b396dd0000 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.241+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd1800 con 0x55b3962b7000 2024-04-19T23:45:39.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.242+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.242+0000 7f32e30a7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.242+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.242+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd1c00 con 0x55b3962b7000 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.242+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.242+0000 7f32e30a7a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.242+0000 7f32e30a7a80 20 started sync module instance, tier type = 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.242+0000 7f32e30a7a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.242+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0c00 con 0x55b3962b7400 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.243+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.243+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94229806234368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b395f2dc00 con 0x55b3962b7400 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.243+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3962b7800 con 0x55b395f2d800 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.244+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94229806234368] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.244+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.244+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94229806235520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3962b7c00 con 0x55b395f2d800 2024-04-19T23:45:39.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.244+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b3962b7000 2024-04-19T23:45:39.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.245+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94229806235520] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.246+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.246+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94229806236672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd1000 con 0x55b3962b7000 2024-04-19T23:45:39.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.246+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0c00 con 0x55b3962b7400 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.247+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.247+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94229806237824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0400 con 0x55b3962b7400 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.247+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd1800 con 0x55b395f2d800 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.247+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94229806236672] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.248+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.248+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94229806238976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd1c00 con 0x55b395f2d800 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.248+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0800 con 0x55b396dd0000 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.248+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94229806237824] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.249+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.249+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94229806240128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd1400 con 0x55b396dd0000 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.249+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd1800 con 0x55b396dd0000 2024-04-19T23:45:39.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.249+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94229806238976] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.250+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.250+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94229806241280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd1c00 con 0x55b396dd0000 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.250+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3962b7800 con 0x55b396dd0000 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.250+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94229806240128] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.251+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94229806241280] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.251+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.251+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94229806242432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3962b7c00 con 0x55b396dd0000 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.251+0000 7f32e30a7a80 20 add_watcher() i=0 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.251+0000 7f32e30a7a80 20 add_watcher() i=1 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.251+0000 7f32e30a7a80 20 add_watcher() i=2 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.251+0000 7f32e30a7a80 20 add_watcher() i=3 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.251+0000 7f32e30a7a80 20 add_watcher() i=4 2024-04-19T23:45:39.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.251+0000 7f32e30a7a80 20 add_watcher() i=5 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.251+0000 7f32e30a7a80 20 add_watcher() i=6 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.252+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94229806242432] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.252+0000 7f32e30a7a80 20 add_watcher() i=7 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.252+0000 7f32e30a7a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.252+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3962b7800 con 0x55b395f2d800 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.252+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.252+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94229807800320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b3962b7c00 con 0x55b395f2d800 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.253+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94229807800320] v30'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.253+0000 7f32c801f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.253+0000 7f32e30a7a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.253+0000 7f32e30a7a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.253+0000 7f32e30a7a80 1 Processor -- start 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.253+0000 7f32e30a7a80 1 -- start start 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.254+0000 7f32e30a7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.254+0000 7f32e30a7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395f68780 con 0x55b396dd1400 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.254+0000 7f32e0850700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.254+0000 7f32e0850700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35264/0 (socket says 172.21.15.155:35264) 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.254+0000 7f32e0850700 1 -- 172.21.15.155:0/3995285916 learned_addr learned my addr 172.21.15.155:0/3995285916 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.254+0000 7f32e0850700 1 -- 172.21.15.155:0/3995285916 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b395f54b60 con 0x55b396dd1400 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.254+0000 7f32e0850700 1 --2- 172.21.15.155:0/3995285916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55b3963920c0 tx=0x55b39627b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa3089cb28c5aae server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.255+0000 7f32c781e700 1 -- 172.21.15.155:0/3995285916 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b3963a2000 con 0x55b396dd1400 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.255+0000 7f32c781e700 1 -- 172.21.15.155:0/3995285916 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b3963a4000 con 0x55b396dd1400 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.255+0000 7f32c781e700 1 -- 172.21.15.155:0/3995285916 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b3963a2160 con 0x55b396dd1400 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.255+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3995285916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 msgr2=0x55b396216680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.255+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/3995285916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55b3963920c0 tx=0x55b39627b680 comp rx=0 tx=0).stop 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.255+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3995285916 shutdown_connections 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.255+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/3995285916 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.255+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3995285916 >> 172.21.15.155:0/3995285916 conn(0x55b396dd0800 msgr2=0x55b39601a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.255+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3995285916 shutdown_connections 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.255+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3995285916 wait complete. 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.256+0000 7f32e30a7a80 1 Processor -- start 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.256+0000 7f32e30a7a80 1 -- start start 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.256+0000 7f32e30a7a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.256+0000 7f32e30a7a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b395fce000 con 0x55b396dd1400 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.256+0000 7f32e0850700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.256+0000 7f32e0850700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35276/0 (socket says 172.21.15.155:35276) 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.256+0000 7f32e0850700 1 -- 172.21.15.155:0/2464365076 learned_addr learned my addr 172.21.15.155:0/2464365076 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.256+0000 7f32e0850700 1 -- 172.21.15.155:0/2464365076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b395f54d00 con 0x55b396dd1400 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.257+0000 7f32e0850700 1 --2- 172.21.15.155:0/2464365076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55b3963922d0 tx=0x55b39627b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.257+0000 7f32c601b700 1 -- 172.21.15.155:0/2464365076 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b3963a22c0 con 0x55b396dd1400 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.257+0000 7f32c601b700 1 -- 172.21.15.155:0/2464365076 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b3963a4180 con 0x55b396dd1400 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.257+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2464365076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b395f54340 con 0x55b396dd1400 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.257+0000 7f32c601b700 1 -- 172.21.15.155:0/2464365076 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b3963a2000 con 0x55b396dd1400 2024-04-19T23:45:39.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.257+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2464365076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b395f54b60 con 0x55b396dd1400 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.257+0000 7f32c601b700 1 -- 172.21.15.155:0/2464365076 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55b396ccfb80 con 0x55b396dd1400 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.258+0000 7f32c601b700 1 --2- 172.21.15.155:0/2464365076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b396424000 0x55b396217700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.258+0000 7f32c601b700 1 -- 172.21.15.155:0/2464365076 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55b395fa7500 con 0x55b396dd1400 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.258+0000 7f32e1852700 1 --2- 172.21.15.155:0/2464365076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b396424000 0x55b396217700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.258+0000 7f32e30a7a80 5 note: GC not initialized 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.258+0000 7f32e1852700 1 --2- 172.21.15.155:0/2464365076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b396424000 0x55b396217700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55b396317ec0 tx=0x55b39627b4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.259+0000 7f32c3816700 20 reqs_thread_entry: start 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.259+0000 7f32e30a7a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.259+0000 7f32e30a7a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.259+0000 7f32c1812700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:09 2024 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.259+0000 7f32c0ff0700 20 reqs_thread_entry: start 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.259+0000 7f32e30a7a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.259+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd1c00 con 0x55b395f2d800 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.259+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.259+0000 7f32e30a7a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.259+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396424400 con 0x55b3962b7400 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.260+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.260+0000 7f32c801f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.260+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94229807800320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396424800 con 0x55b395f2d800 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.261+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94229807800320] v30'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.261+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94229806234368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396424c00 con 0x55b3962b7400 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.262+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94229806234368] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.262+0000 7f32e30a7a80 20 remove_watcher() i=0 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.262+0000 7f32e30a7a80 2 removed watcher, disabling cache 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.263+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94229806235520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396425000 con 0x55b395f2d800 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.264+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94229806235520] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.264+0000 7f32e30a7a80 20 remove_watcher() i=1 2024-04-19T23:45:39.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.264+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94229806236672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396425400 con 0x55b3962b7000 2024-04-19T23:45:39.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.265+0000 7f32e1051700 1 -- 172.21.15.155:0/3285953986 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94229806236672] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396373200 con 0x55b3962b7000 2024-04-19T23:45:39.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.265+0000 7f32e30a7a80 20 remove_watcher() i=2 2024-04-19T23:45:39.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.265+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94229806237824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396425800 con 0x55b3962b7400 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.266+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94229806237824] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396373440 con 0x55b3962b7400 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.266+0000 7f32e30a7a80 20 remove_watcher() i=3 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.266+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94229806238976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396425c00 con 0x55b395f2d800 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.266+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94229806238976] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b395f2d800 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.266+0000 7f32e30a7a80 20 remove_watcher() i=4 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.266+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94229806240128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396424400 con 0x55b396dd0000 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.267+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94229806240128] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.267+0000 7f32e30a7a80 20 remove_watcher() i=5 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.267+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94229806241280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396424c00 con 0x55b396dd0000 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.268+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94229806241280] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.268+0000 7f32e30a7a80 20 remove_watcher() i=6 2024-04-19T23:45:39.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.268+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94229806242432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b396dd0c00 con 0x55b396dd0000 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.269+0000 7f32e1852700 1 -- 172.21.15.155:0/3285953986 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94229806242432] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b396372b40 con 0x55b396dd0000 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.269+0000 7f32e30a7a80 20 remove_watcher() i=7 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.269+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55b396dd0000 msgr2=0x55b396217180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.269+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55b396dd0000 0x55b396217180 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.269+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55b395f2d800 msgr2=0x55b396215b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.269+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55b395f2d800 0x55b396215b80 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.269+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55b3962b7400 msgr2=0x55b396216c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.269+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55b3962b7400 0x55b396216c00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.269+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55b3962b7000 msgr2=0x55b396216100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.269+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55b3962b7000 0x55b396216100 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b3962b6c00 msgr2=0x55b396215600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b3962b6c00 0x55b396215600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55b396d06030 tx=0x55b39627b320 comp rx=0 tx=0).stop 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 msgr2=0x55b396214b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/3285953986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2d400 0x55b396214b00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x55b396dae240 tx=0x55b39601d8c0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 reap_dead start 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e0850700 1 -- 172.21.15.155:0/3285953986 reap_dead start 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 shutdown_connections 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 >> 172.21.15.155:0/3285953986 conn(0x55b395f2cc00 msgr2=0x55b396019800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 shutdown_connections 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/3285953986 wait complete. 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2464365076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b396424000 msgr2=0x55b396217700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/2464365076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b396424000 0x55b396217700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55b396317ec0 tx=0x55b39627b4a0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2464365076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 msgr2=0x55b396216680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/2464365076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55b3963922d0 tx=0x55b39627b7a0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2464365076 shutdown_connections 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/2464365076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b396424000 0x55b396217700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/2464365076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b396dd1400 0x55b396216680 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2464365076 >> 172.21.15.155:0/2464365076 conn(0x55b396dd0800 msgr2=0x55b39601a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2464365076 shutdown_connections 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/2464365076 wait complete. 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1390320608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b3962b6000 msgr2=0x55b396215080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/1390320608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b3962b6000 0x55b396215080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55b396daf050 tx=0x55b39627a540 comp rx=0 tx=0).stop 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1390320608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 msgr2=0x55b396214580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.270+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/1390320608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55b396d079e0 tx=0x55b39601d920 comp rx=0 tx=0).stop 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.271+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1390320608 shutdown_connections 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.271+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/1390320608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b3962b6000 0x55b396215080 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.271+0000 7f32e30a7a80 1 --2- 172.21.15.155:0/1390320608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b395f2c800 0x55b396214580 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.271+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1390320608 >> 172.21.15.155:0/1390320608 conn(0x55b395f2c400 msgr2=0x55b396019000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.271+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1390320608 shutdown_connections 2024-04-19T23:45:39.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.271+0000 7f32e30a7a80 1 -- 172.21.15.155:0/1390320608 wait complete. 2024-04-19T23:45:39.279 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2024-04-19T23:45:39.279 INFO:teuthology.orchestra.run.smithi155.stdout: "myfoo" 2024-04-19T23:45:39.279 INFO:teuthology.orchestra.run.smithi155.stdout:] 2024-04-19T23:45:39.279 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-19T23:45:39.286 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:39.286 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-19T23:45:39.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-19T23:45:39.286 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-19T23:45:39.363 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:39.363 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:39.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.363+0000 7f02d3930a80 1 Processor -- start 2024-04-19T23:45:39.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.364+0000 7f02d3930a80 1 -- start start 2024-04-19T23:45:39.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.364+0000 7f02d3930a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x562ca6c00c00 0x562ca6ee8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.364+0000 7f02d3930a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562ca6f2b500 con 0x562ca6c00800 2024-04-19T23:45:39.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.364+0000 7f02d3930a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x562ca6ca2a00 con 0x562ca6c00c00 2024-04-19T23:45:39.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.364+0000 7f02d10d9700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x562ca6c00c00 0x562ca6ee8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.364+0000 7f02d18da700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x562ca6c00800 0x562ca6cec800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46670/0 (socket says 172.21.15.155:46670) 2024-04-19T23:45:39.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.364+0000 7f02d10d9700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x562ca6c00c00 0x562ca6ee8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35286/0 (socket says 172.21.15.155:35286) 2024-04-19T23:45:39.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.364+0000 7f02d18da700 1 -- 172.21.15.155:0/262161804 learned_addr learned my addr 172.21.15.155:0/262161804 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:39.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.364+0000 7f02d10d9700 1 -- 172.21.15.155:0/262161804 >> v1:172.21.15.76:6789/0 conn(0x562ca6c00800 legacy=0x562ca6cec800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.364+0000 7f02d10d9700 1 -- 172.21.15.155:0/262161804 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ca6c29d40 con 0x562ca6c00c00 2024-04-19T23:45:39.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.364+0000 7f02d08d8700 1 -- 172.21.15.155:0/262161804 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408471094 0 0) 0x562ca79ce000 con 0x562ca6c00800 2024-04-19T23:45:39.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.365+0000 7f02d10d9700 1 --2- 172.21.15.155:0/262161804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00c00 0x562ca6ee8580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x562ca6ee3890 tx=0x562ca6cf1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79aad4fc166049e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.365+0000 7f02d08d8700 1 -- 172.21.15.155:0/262161804 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca6cb94a0 con 0x562ca6c00c00 2024-04-19T23:45:39.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.365+0000 7f02d08d8700 1 -- 172.21.15.155:0/262161804 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ca6f2b800 con 0x562ca6c00c00 2024-04-19T23:45:39.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.365+0000 7f02d08d8700 1 -- 172.21.15.155:0/262161804 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca6cb9600 con 0x562ca6c00c00 2024-04-19T23:45:39.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.365+0000 7f02d3930a80 1 -- 172.21.15.155:0/262161804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00c00 msgr2=0x562ca6ee8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.365+0000 7f02d3930a80 1 --2- 172.21.15.155:0/262161804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00c00 0x562ca6ee8580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x562ca6ee3890 tx=0x562ca6cf1920 comp rx=0 tx=0).stop 2024-04-19T23:45:39.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.365+0000 7f02d3930a80 1 -- 172.21.15.155:0/262161804 shutdown_connections 2024-04-19T23:45:39.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.365+0000 7f02d3930a80 1 --2- 172.21.15.155:0/262161804 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00c00 0x562ca6ee8580 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.365+0000 7f02d3930a80 1 -- 172.21.15.155:0/262161804 >> 172.21.15.155:0/262161804 conn(0x562ca6c00400 msgr2=0x562ca6cec000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.365+0000 7f02d3930a80 1 -- 172.21.15.155:0/262161804 shutdown_connections 2024-04-19T23:45:39.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.365+0000 7f02d3930a80 1 -- 172.21.15.155:0/262161804 wait complete. 2024-04-19T23:45:39.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.366+0000 7f02d3930a80 1 Processor -- start 2024-04-19T23:45:39.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.366+0000 7f02d3930a80 1 -- start start 2024-04-19T23:45:39.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.366+0000 7f02d3930a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.366+0000 7f02d3930a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ca6ca2500 con 0x562ca6c00800 2024-04-19T23:45:39.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.366+0000 7f02d18da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.366+0000 7f02d18da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35296/0 (socket says 172.21.15.155:35296) 2024-04-19T23:45:39.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.366+0000 7f02d18da700 1 -- 172.21.15.155:0/2883426119 learned_addr learned my addr 172.21.15.155:0/2883426119 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.366+0000 7f02d18da700 1 -- 172.21.15.155:0/2883426119 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ca6c29ba0 con 0x562ca6c00800 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d18da700 1 --2- 172.21.15.155:0/2883426119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x562ca79d1770 tx=0x562ca6cf1b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3424aed7d813cb39 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d00d7700 1 -- 172.21.15.155:0/2883426119 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca6cb94a0 con 0x562ca6c00800 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d00d7700 1 -- 172.21.15.155:0/2883426119 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ca6f2bb00 con 0x562ca6c00800 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d00d7700 1 -- 172.21.15.155:0/2883426119 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca6cb9600 con 0x562ca6c00800 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d3930a80 1 -- 172.21.15.155:0/2883426119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 msgr2=0x562ca6ee8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d3930a80 1 --2- 172.21.15.155:0/2883426119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x562ca79d1770 tx=0x562ca6cf1b60 comp rx=0 tx=0).stop 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d3930a80 1 -- 172.21.15.155:0/2883426119 shutdown_connections 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d3930a80 1 --2- 172.21.15.155:0/2883426119 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d3930a80 1 -- 172.21.15.155:0/2883426119 >> 172.21.15.155:0/2883426119 conn(0x562ca6c00400 msgr2=0x562ca6ced000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d3930a80 1 -- 172.21.15.155:0/2883426119 shutdown_connections 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d3930a80 1 -- 172.21.15.155:0/2883426119 wait complete. 2024-04-19T23:45:39.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.367+0000 7f02d3930a80 1 Processor -- start 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02d3930a80 1 -- start start 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02d3930a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02d3930a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ca6ca23c0 con 0x562ca6c00800 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02d18da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02d18da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35300/0 (socket says 172.21.15.155:35300) 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02d18da700 1 -- 172.21.15.155:0/521798537 learned_addr learned my addr 172.21.15.155:0/521798537 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02d18da700 1 -- 172.21.15.155:0/521798537 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ca6c29a00 con 0x562ca6c00800 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02d18da700 1 --2- 172.21.15.155:0/521798537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x562ca79d1e30 tx=0x562ca6cf1a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02ce8d4700 1 -- 172.21.15.155:0/521798537 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca6cb98c0 con 0x562ca6c00800 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02ce8d4700 1 -- 172.21.15.155:0/521798537 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ca6ca1c80 con 0x562ca6c00800 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02d3930a80 1 -- 172.21.15.155:0/521798537 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562ca6c29860 con 0x562ca6c00800 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02ce8d4700 1 -- 172.21.15.155:0/521798537 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca6cb94a0 con 0x562ca6c00800 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.368+0000 7f02d3930a80 1 -- 172.21.15.155:0/521798537 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562ca6c296c0 con 0x562ca6c00800 2024-04-19T23:45:39.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.369+0000 7f02d3930a80 1 Processor -- start 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.369+0000 7f02d3930a80 1 -- start start 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.369+0000 7f02ce8d4700 1 -- 172.21.15.155:0/521798537 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562ca79a2b00 con 0x562ca6c00800 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.369+0000 7f02d3930a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 0x562ca6ee8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.369+0000 7f02d3930a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ca6ca2000 con 0x562ca6c01400 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.369+0000 7f02ce8d4700 1 --2- 172.21.15.155:0/521798537 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca6f86000 0x562ca6ee9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.369+0000 7f02ce8d4700 1 -- 172.21.15.155:0/521798537 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x562ca6c7b180 con 0x562ca6c00800 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.369+0000 7f02d18da700 1 --2- 172.21.15.155:0/521798537 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca6f86000 0x562ca6ee9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.369+0000 7f02d20db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 0x562ca6ee8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.369+0000 7f02d20db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 0x562ca6ee8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35308/0 (socket says 172.21.15.155:35308) 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.369+0000 7f02d20db700 1 -- 172.21.15.155:0/819361030 learned_addr learned my addr 172.21.15.155:0/819361030 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02d20db700 1 -- 172.21.15.155:0/819361030 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ca6c28000 con 0x562ca6c01400 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02d18da700 1 --2- 172.21.15.155:0/521798537 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca6f86000 0x562ca6ee9080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x562ca7a92f00 tx=0x562ca6f4c240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02d20db700 1 --2- 172.21.15.155:0/819361030 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 0x562ca6ee8b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x562ca7a923c0 tx=0x562ca6f4c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23c8f1c22c009d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02cc0cf700 1 -- 172.21.15.155:0/819361030 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca6cb98c0 con 0x562ca6c01400 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02cc0cf700 1 -- 172.21.15.155:0/819361030 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ca6f2a300 con 0x562ca6c01400 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02cc0cf700 1 -- 172.21.15.155:0/819361030 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca6cb94a0 con 0x562ca6c01400 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02d3930a80 1 -- 172.21.15.155:0/819361030 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 msgr2=0x562ca6ee8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02d3930a80 1 --2- 172.21.15.155:0/819361030 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 0x562ca6ee8b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x562ca7a923c0 tx=0x562ca6f4c9c0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02d3930a80 1 -- 172.21.15.155:0/819361030 shutdown_connections 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02d3930a80 1 --2- 172.21.15.155:0/819361030 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 0x562ca6ee8b00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02d3930a80 1 -- 172.21.15.155:0/819361030 >> 172.21.15.155:0/819361030 conn(0x562ca6c00c00 msgr2=0x562ca6ced800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02d3930a80 1 -- 172.21.15.155:0/819361030 shutdown_connections 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.370+0000 7f02d3930a80 1 -- 172.21.15.155:0/819361030 wait complete. 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.371+0000 7f02d3930a80 1 Processor -- start 2024-04-19T23:45:39.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.371+0000 7f02d3930a80 1 -- start start 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.371+0000 7f02d3930a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 0x562ca6ee8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.371+0000 7f02d3930a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ca6c3c640 con 0x562ca6c01400 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.371+0000 7f02d20db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 0x562ca6ee8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.371+0000 7f02d20db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 0x562ca6ee8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35324/0 (socket says 172.21.15.155:35324) 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.371+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 learned_addr learned my addr 172.21.15.155:0/1193987260 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.371+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ca6c28ea0 con 0x562ca6c01400 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.371+0000 7f02d20db700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 0x562ca6ee8b00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x562ca79d1f50 tx=0x562ca6f4c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.372+0000 7f02ca8cc700 1 -- 172.21.15.155:0/1193987260 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca6cb9b80 con 0x562ca6c01400 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.372+0000 7f02ca8cc700 1 -- 172.21.15.155:0/1193987260 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ca6ca1c80 con 0x562ca6c01400 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.372+0000 7f02ca8cc700 1 -- 172.21.15.155:0/1193987260 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca6cb98c0 con 0x562ca6c01400 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.372+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562ca6c28820 con 0x562ca6c01400 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.372+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562ca6c289c0 con 0x562ca6c01400 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.372+0000 7f02ca8cc700 1 -- 172.21.15.155:0/1193987260 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562ca79a2dc0 con 0x562ca6c01400 2024-04-19T23:45:39.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d3930a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02ca8cc700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca6f86c00 0x562ca6ee9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02ca8cc700 1 -- 172.21.15.155:0/1193987260 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x562ca6c7b340 con 0x562ca6c01400 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d10d9700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca6f86c00 0x562ca6ee9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d3930a80 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562ca6c01800 0x562ca6ee9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6c01c00 con 0x562ca6c01800 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d20db700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562ca6c01800 0x562ca6ee9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d10d9700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca6f86c00 0x562ca6ee9600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x562ca6ee3890 tx=0x562ca6cf1800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d20db700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562ca6c01800 0x562ca6ee9b80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d3930a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d3930a80 20 realm 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d3930a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.373+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6f87000 con 0x562ca6c01800 2024-04-19T23:45:39.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6f87400 con 0x562ca6c01800 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6f87800 con 0x562ca6c01800 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6f87c00 con 0x562ca6c01800 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 20 searching for the correct realm 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562ca6f87000 0x562ca6eea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.374+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6f87400 con 0x562ca6f87000 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.375+0000 7f02d18da700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562ca6f87000 0x562ca6eea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.375+0000 7f02d18da700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562ca6f87000 0x562ca6eea100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.375+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.375+0000 7f02d18da700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562ca6f87400 0x562ca6eeac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.375+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048000 con 0x562ca6f87400 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.375+0000 7f02d10d9700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562ca6f87400 0x562ca6eeac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.376+0000 7f02d10d9700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562ca6f87400 0x562ca6eeac00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.376+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.376+0000 7f02d10d9700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562ca7048000 0x562ca6eeb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.376+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca7048000 2024-04-19T23:45:39.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.376+0000 7f02d20db700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562ca7048000 0x562ca6eeb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.376+0000 7f02d20db700 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562ca7048000 0x562ca6eeb180 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.377+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.377+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6c01800 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.377+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.377+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6c01800 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.377+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.377+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca7048000 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.377+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.377+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca7048000 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.377+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.377+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87400 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.378+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.378+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87000 2024-04-19T23:45:39.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.378+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.378+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6c01800 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.378+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.378+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca7048000 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.378+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.378+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6c01800 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.378+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.378+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87400 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.379+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.379+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87000 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.379+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.379+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87000 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.379+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.379+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca7048000 2024-04-19T23:45:39.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.380+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.380+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87000 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.380+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.380+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87000 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.380+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.380+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6c01800 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.380+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.380+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6c01800 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.380+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.380+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca7048000 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.381+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.381+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87000 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.381+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.381+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87400 2024-04-19T23:45:39.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.381+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.381+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6c01800 2024-04-19T23:45:39.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.382+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.382+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca7048000 2024-04-19T23:45:39.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.382+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.382+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87000 2024-04-19T23:45:39.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.382+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.382+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca7048000 2024-04-19T23:45:39.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.382+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.382+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87400 2024-04-19T23:45:39.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.383+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.383+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87000 2024-04-19T23:45:39.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.383+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.383+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca7048000 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.383+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.383+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6c01800 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.383+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.383+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87400 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6c01c00 con 0x562ca6c01800 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048c00 con 0x562ca6c01800 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.384+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049000 con 0x562ca6f87400 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 20 zone default found 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 4 Realm: () 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 20 zonegroup default 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049400 con 0x562ca7048000 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049800 con 0x562ca6f87000 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87000 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 20 started sync module instance, tier type = 2024-04-19T23:45:39.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.385+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048c00 con 0x562ca6f87400 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.386+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.386+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94749779163904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6c01c00 con 0x562ca6f87400 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.386+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6f87800 con 0x562ca6c01800 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.387+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94749779163904] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.388+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.388+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94749779165056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6f87c00 con 0x562ca6c01800 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.388+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca6f87000 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.389+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94749779165056] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.389+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.389+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94749779166208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049000 con 0x562ca6f87000 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.389+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048c00 con 0x562ca6f87400 2024-04-19T23:45:39.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.390+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.390+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94749779167360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048400 con 0x562ca6f87400 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.390+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049800 con 0x562ca6c01800 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.391+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94749779166208] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.391+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.391+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94749779168512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6c01800 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.392+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048800 con 0x562ca7048000 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.392+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94749779167360] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.392+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.392+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94749779169664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049400 con 0x562ca7048000 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.392+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049800 con 0x562ca7048000 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.393+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94749779168512] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.394+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.394+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94749779169664] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.394+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94749779170816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca7048000 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.394+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6f87800 con 0x562ca7048000 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.395+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.395+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94749779170816] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.395+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94749779171968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6f87c00 con 0x562ca7048000 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.395+0000 7f02d3930a80 20 add_watcher() i=0 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.395+0000 7f02d3930a80 20 add_watcher() i=1 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.395+0000 7f02d3930a80 20 add_watcher() i=2 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.395+0000 7f02d3930a80 20 add_watcher() i=3 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.395+0000 7f02d3930a80 20 add_watcher() i=4 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.395+0000 7f02d3930a80 20 add_watcher() i=5 2024-04-19T23:45:39.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.395+0000 7f02d3930a80 20 add_watcher() i=6 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.396+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94749779171968] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.396+0000 7f02d3930a80 20 add_watcher() i=7 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.396+0000 7f02d3930a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.396+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6f87800 con 0x562ca6c01800 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.396+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.396+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94749780705280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca6f87c00 con 0x562ca6c01800 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.397+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94749780705280] v30'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.397+0000 7f02b88a8700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.397+0000 7f02d3930a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.397+0000 7f02d3930a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.397+0000 7f02d3930a80 1 Processor -- start 2024-04-19T23:45:39.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.397+0000 7f02d3930a80 1 -- start start 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.398+0000 7f02d3930a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.398+0000 7f02d3930a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ca6c3c780 con 0x562ca7049400 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.398+0000 7f02d10d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.398+0000 7f02d10d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35340/0 (socket says 172.21.15.155:35340) 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.398+0000 7f02d10d9700 1 -- 172.21.15.155:0/2147113545 learned_addr learned my addr 172.21.15.155:0/2147113545 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.398+0000 7f02d10d9700 1 -- 172.21.15.155:0/2147113545 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ca6c28b60 con 0x562ca7049400 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.398+0000 7f02d10d9700 1 --2- 172.21.15.155:0/2147113545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x562ca6f8d440 tx=0x562ca6f4d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357202614a2d4ece server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.398+0000 7f02b80a7700 1 -- 172.21.15.155:0/2147113545 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca6cb9760 con 0x562ca7049400 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.398+0000 7f02b80a7700 1 -- 172.21.15.155:0/2147113545 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ca706a000 con 0x562ca7049400 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.398+0000 7f02b80a7700 1 -- 172.21.15.155:0/2147113545 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca706c000 con 0x562ca7049400 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.399+0000 7f02d3930a80 1 -- 172.21.15.155:0/2147113545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 msgr2=0x562ca6eea680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.399+0000 7f02d3930a80 1 --2- 172.21.15.155:0/2147113545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x562ca6f8d440 tx=0x562ca6f4d6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.399+0000 7f02d3930a80 1 -- 172.21.15.155:0/2147113545 shutdown_connections 2024-04-19T23:45:39.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.399+0000 7f02d3930a80 1 --2- 172.21.15.155:0/2147113545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.399+0000 7f02d3930a80 1 -- 172.21.15.155:0/2147113545 >> 172.21.15.155:0/2147113545 conn(0x562ca7048800 msgr2=0x562ca6cee000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.399+0000 7f02d3930a80 1 -- 172.21.15.155:0/2147113545 shutdown_connections 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.399+0000 7f02d3930a80 1 -- 172.21.15.155:0/2147113545 wait complete. 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.399+0000 7f02d3930a80 1 Processor -- start 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.399+0000 7f02d3930a80 1 -- start start 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02d3930a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02d3930a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ca6ca2000 con 0x562ca7049400 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02d10d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02d10d9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35346/0 (socket says 172.21.15.155:35346) 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02d10d9700 1 -- 172.21.15.155:0/865418199 learned_addr learned my addr 172.21.15.155:0/865418199 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02d10d9700 1 -- 172.21.15.155:0/865418199 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ca6c28d00 con 0x562ca7049400 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02d10d9700 1 --2- 172.21.15.155:0/865418199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x562ca705d200 tx=0x562ca6f4d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02b68a4700 1 -- 172.21.15.155:0/865418199 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca706c160 con 0x562ca7049400 2024-04-19T23:45:39.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02b68a4700 1 -- 172.21.15.155:0/865418199 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ca706a180 con 0x562ca7049400 2024-04-19T23:45:39.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02b68a4700 1 -- 172.21.15.155:0/865418199 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562ca706c2c0 con 0x562ca7049400 2024-04-19T23:45:39.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02d3930a80 1 -- 172.21.15.155:0/865418199 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562ca6c28340 con 0x562ca7049400 2024-04-19T23:45:39.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.400+0000 7f02d3930a80 1 -- 172.21.15.155:0/865418199 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562ca6c29d40 con 0x562ca7049400 2024-04-19T23:45:39.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.401+0000 7f02b68a4700 1 -- 172.21.15.155:0/865418199 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562ca79a3b80 con 0x562ca7049400 2024-04-19T23:45:39.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.401+0000 7f02b68a4700 1 --2- 172.21.15.155:0/865418199 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca70ec000 0x562ca6eeb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.401+0000 7f02b68a4700 1 -- 172.21.15.155:0/865418199 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x562ca6c7b500 con 0x562ca7049400 2024-04-19T23:45:39.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.401+0000 7f02d3930a80 5 note: GC not initialized 2024-04-19T23:45:39.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.401+0000 7f02d20db700 1 --2- 172.21.15.155:0/865418199 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca70ec000 0x562ca6eeb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.402+0000 7f02d20db700 1 --2- 172.21.15.155:0/865418199 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca70ec000 0x562ca6eeb700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x562ca6feff50 tx=0x562ca6f4ca20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.402+0000 7f02b409f700 20 reqs_thread_entry: start 2024-04-19T23:45:39.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.402+0000 7f02d3930a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.402+0000 7f02d3930a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.402+0000 7f02b209b700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:09 2024 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.403+0000 7f02b1879700 20 reqs_thread_entry: start 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.403+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87000 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.403+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.403+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87000 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.403+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.403+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6c01800 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.404+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.404+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6c01800 2024-04-19T23:45:39.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.404+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.404+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87400 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.404+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.404+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87000 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.404+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.404+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6c01800 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.405+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.405+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87000 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.405+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.405+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87400 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.405+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.405+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87000 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.405+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.405+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6c01800 2024-04-19T23:45:39.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.405+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(72 [pgnls start_epoch 30 out=127b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.405+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca7048000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.406+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.406+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca7048000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.406+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.406+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.406+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.406+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca7048000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.407+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.407+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca7048000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.407+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.407+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca7048000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.407+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.407+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87000 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.407+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.407+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87400 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.408+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.408+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6c01800 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.408+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.408+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6c01800 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.408+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.408+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87000 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.408+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.408+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87400 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.408+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.408+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca7048000 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.409+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.409+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6c01800 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.409+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.409+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca7048000 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.409+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.409+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87000 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.410+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.410+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87400 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.410+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.410+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca7048000 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.410+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.410+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6c01800 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.411+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.411+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87000 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.411+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.411+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7049c00 con 0x562ca6f87400 2024-04-19T23:45:39.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.411+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.411+0000 7f02d3930a80 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:39.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.411+0000 7f02d3930a80 20 RGWRados::pool_iterate: got myfoo 2024-04-19T23:45:39.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.412+0000 7f02b88a8700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.412+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94749780705280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca70ec400 con 0x562ca6c01800 2024-04-19T23:45:39.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.413+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94749780705280] v30'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.413+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94749779163904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca70ec800 con 0x562ca6f87400 2024-04-19T23:45:39.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.414+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94749779163904] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.414+0000 7f02d3930a80 20 remove_watcher() i=0 2024-04-19T23:45:39.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.414+0000 7f02d3930a80 2 removed watcher, disabling cache 2024-04-19T23:45:39.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.414+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94749779165056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca70ecc00 con 0x562ca6c01800 2024-04-19T23:45:39.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.415+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94749779165056] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.415+0000 7f02d3930a80 20 remove_watcher() i=1 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.415+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94749779166208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca70ed000 con 0x562ca6f87000 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.416+0000 7f02d18da700 1 -- 172.21.15.155:0/1193987260 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94749779166208] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703d200 con 0x562ca6f87000 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.416+0000 7f02d3930a80 20 remove_watcher() i=2 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.417+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94749779167360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca70ed400 con 0x562ca6f87400 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.417+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94749779167360] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703d440 con 0x562ca6f87400 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.417+0000 7f02d3930a80 20 remove_watcher() i=3 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.417+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94749779168512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca70ed800 con 0x562ca6c01800 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.418+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94749779168512] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca6c01800 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.418+0000 7f02d3930a80 20 remove_watcher() i=4 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.418+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94749779169664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca70edc00 con 0x562ca7048000 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.419+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94749779169664] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.419+0000 7f02d3930a80 20 remove_watcher() i=5 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.419+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94749779170816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca70ec800 con 0x562ca7048000 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.420+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94749779170816] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.420+0000 7f02d3930a80 20 remove_watcher() i=6 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.420+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94749779171968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562ca7048c00 con 0x562ca7048000 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d20db700 1 -- 172.21.15.155:0/1193987260 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94749779171968] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562ca703cb40 con 0x562ca7048000 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 20 remove_watcher() i=7 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562ca7048000 msgr2=0x562ca6eeb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562ca7048000 0x562ca6eeb180 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562ca6c01800 msgr2=0x562ca6ee9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562ca6c01800 0x562ca6ee9b80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562ca6f87400 msgr2=0x562ca6eeac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562ca6f87400 0x562ca6eeac00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562ca6f87000 msgr2=0x562ca6eea100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562ca6f87000 0x562ca6eea100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca6f86c00 msgr2=0x562ca6ee9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca6f86c00 0x562ca6ee9600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x562ca6ee3890 tx=0x562ca6cf1800 comp rx=0 tx=0).stop 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 msgr2=0x562ca6ee8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 --2- 172.21.15.155:0/1193987260 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c01400 0x562ca6ee8b00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x562ca79d1f50 tx=0x562ca6f4c120 comp rx=0 tx=0).stop 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 reap_dead start 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d10d9700 1 -- 172.21.15.155:0/1193987260 reap_dead start 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 shutdown_connections 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 >> 172.21.15.155:0/1193987260 conn(0x562ca6c00c00 msgr2=0x562ca6ced800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 shutdown_connections 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.421+0000 7f02d3930a80 1 -- 172.21.15.155:0/1193987260 wait complete. 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/865418199 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca70ec000 msgr2=0x562ca6eeb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 --2- 172.21.15.155:0/865418199 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca70ec000 0x562ca6eeb700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x562ca6feff50 tx=0x562ca6f4ca20 comp rx=0 tx=0).stop 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/865418199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 msgr2=0x562ca6eea680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 --2- 172.21.15.155:0/865418199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x562ca705d200 tx=0x562ca6f4d800 comp rx=0 tx=0).stop 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/865418199 shutdown_connections 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 --2- 172.21.15.155:0/865418199 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca70ec000 0x562ca6eeb700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 --2- 172.21.15.155:0/865418199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca7049400 0x562ca6eea680 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/865418199 >> 172.21.15.155:0/865418199 conn(0x562ca7048800 msgr2=0x562ca6cee000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/865418199 shutdown_connections 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/865418199 wait complete. 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/521798537 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca6f86000 msgr2=0x562ca6ee9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 --2- 172.21.15.155:0/521798537 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca6f86000 0x562ca6ee9080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x562ca7a92f00 tx=0x562ca6f4c240 comp rx=0 tx=0).stop 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/521798537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 msgr2=0x562ca6ee8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 --2- 172.21.15.155:0/521798537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x562ca79d1e30 tx=0x562ca6cf1a40 comp rx=0 tx=0).stop 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/521798537 shutdown_connections 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 --2- 172.21.15.155:0/521798537 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562ca6f86000 0x562ca6ee9080 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 --2- 172.21.15.155:0/521798537 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562ca6c00800 0x562ca6ee8580 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/521798537 >> 172.21.15.155:0/521798537 conn(0x562ca6c00400 msgr2=0x562ca6ced000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/521798537 shutdown_connections 2024-04-19T23:45:39.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.422+0000 7f02d3930a80 1 -- 172.21.15.155:0/521798537 wait complete. 2024-04-19T23:45:39.440 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2024-04-19T23:45:39.441 INFO:teuthology.orchestra.run.smithi155.stdout: "myfoo" 2024-04-19T23:45:39.441 INFO:teuthology.orchestra.run.smithi155.stdout:] 2024-04-19T23:45:39.441 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-19T23:45:39.452 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:39.463 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:39.475 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:39.519 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-04-19T23:45:39.551 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:39.586 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:39.618 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:39.618 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-19T23:45:39.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-19T23:45:39.619 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-19T23:45:39.664 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:39.664 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:39.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.665+0000 7f1ef737da80 1 Processor -- start 2024-04-19T23:45:39.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.665+0000 7f1ef737da80 1 -- start start 2024-04-19T23:45:39.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.665+0000 7f1ef737da80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.665+0000 7f1ef737da80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b0efac5500 con 0x55b0ef79ac00 2024-04-19T23:45:39.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.665+0000 7f1ef737da80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b0ef83ca00 con 0x55b0ef79a800 2024-04-19T23:45:39.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.665+0000 7f1ef5327700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.665+0000 7f1ef4b26700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55b0ef79ac00 0x55b0ef886800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46676/0 (socket says 172.21.15.155:46676) 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.665+0000 7f1ef4b26700 1 -- 172.21.15.155:0/213288925 learned_addr learned my addr 172.21.15.155:0/213288925 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.665+0000 7f1ef5327700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35362/0 (socket says 172.21.15.155:35362) 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef5327700 1 -- 172.21.15.155:0/213288925 >> v1:172.21.15.76:6789/0 conn(0x55b0ef79ac00 legacy=0x55b0ef886800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef5327700 1 -- 172.21.15.155:0/213288925 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0ef7c3d40 con 0x55b0ef79a800 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef5327700 1 --2- 172.21.15.155:0/213288925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55b0efa7d9e0 tx=0x55b0ef88b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c194460cd4c27fc server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef4325700 1 -- 172.21.15.155:0/213288925 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0ef8534a0 con 0x55b0ef79a800 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef4325700 1 -- 172.21.15.155:0/213288925 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0efac5800 con 0x55b0ef79a800 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef4325700 1 -- 172.21.15.155:0/213288925 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0ef853600 con 0x55b0ef79a800 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef737da80 1 -- 172.21.15.155:0/213288925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 msgr2=0x55b0efa82580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef737da80 1 --2- 172.21.15.155:0/213288925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55b0efa7d9e0 tx=0x55b0ef88b920 comp rx=0 tx=0).stop 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef737da80 1 -- 172.21.15.155:0/213288925 shutdown_connections 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef737da80 1 --2- 172.21.15.155:0/213288925 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef737da80 1 -- 172.21.15.155:0/213288925 >> 172.21.15.155:0/213288925 conn(0x55b0ef79a400 msgr2=0x55b0ef886000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.666+0000 7f1ef737da80 1 -- 172.21.15.155:0/213288925 shutdown_connections 2024-04-19T23:45:39.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.667+0000 7f1ef737da80 1 -- 172.21.15.155:0/213288925 wait complete. 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.667+0000 7f1ef737da80 1 Processor -- start 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.667+0000 7f1ef737da80 1 -- start start 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.667+0000 7f1ef737da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.667+0000 7f1ef737da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0ef83c500 con 0x55b0ef79a800 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.668+0000 7f1ef5327700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.668+0000 7f1ef5327700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35376/0 (socket says 172.21.15.155:35376) 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.668+0000 7f1ef5327700 1 -- 172.21.15.155:0/776584516 learned_addr learned my addr 172.21.15.155:0/776584516 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.668+0000 7f1ef5327700 1 -- 172.21.15.155:0/776584516 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0ef7c3ba0 con 0x55b0ef79a800 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.668+0000 7f1ef5327700 1 --2- 172.21.15.155:0/776584516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55b0f060b860 tx=0x55b0ef88b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576d9f6ade453635 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.668+0000 7f1ef3b24700 1 -- 172.21.15.155:0/776584516 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0ef853760 con 0x55b0ef79a800 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.668+0000 7f1ef3b24700 1 -- 172.21.15.155:0/776584516 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0efac5b00 con 0x55b0ef79a800 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.668+0000 7f1ef3b24700 1 -- 172.21.15.155:0/776584516 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0ef8531e0 con 0x55b0ef79a800 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.668+0000 7f1ef737da80 1 -- 172.21.15.155:0/776584516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 msgr2=0x55b0efa82580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.668+0000 7f1ef737da80 1 --2- 172.21.15.155:0/776584516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55b0f060b860 tx=0x55b0ef88b800 comp rx=0 tx=0).stop 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef737da80 1 -- 172.21.15.155:0/776584516 shutdown_connections 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef737da80 1 --2- 172.21.15.155:0/776584516 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef737da80 1 -- 172.21.15.155:0/776584516 >> 172.21.15.155:0/776584516 conn(0x55b0ef79a400 msgr2=0x55b0ef887000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef737da80 1 -- 172.21.15.155:0/776584516 shutdown_connections 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef737da80 1 -- 172.21.15.155:0/776584516 wait complete. 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef737da80 1 Processor -- start 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef737da80 1 -- start start 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef737da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef737da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0ef83c3c0 con 0x55b0ef79a800 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef5327700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef5327700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35388/0 (socket says 172.21.15.155:35388) 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.669+0000 7f1ef5327700 1 -- 172.21.15.155:0/3241145156 learned_addr learned my addr 172.21.15.155:0/3241145156 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.670+0000 7f1ef5327700 1 -- 172.21.15.155:0/3241145156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0ef7c3a00 con 0x55b0ef79a800 2024-04-19T23:45:39.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.670+0000 7f1ef5327700 1 --2- 172.21.15.155:0/3241145156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55b0f060bf20 tx=0x55b0ef88b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.670+0000 7f1ef2321700 1 -- 172.21.15.155:0/3241145156 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0ef8534a0 con 0x55b0ef79a800 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.670+0000 7f1ef2321700 1 -- 172.21.15.155:0/3241145156 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0efac5c80 con 0x55b0ef79a800 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.670+0000 7f1ef2321700 1 -- 172.21.15.155:0/3241145156 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0ef853600 con 0x55b0ef79a800 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.670+0000 7f1ef737da80 1 -- 172.21.15.155:0/3241145156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b0ef7c3860 con 0x55b0ef79a800 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.670+0000 7f1ef737da80 1 -- 172.21.15.155:0/3241145156 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0ef7c36c0 con 0x55b0ef79a800 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.670+0000 7f1ef737da80 1 Processor -- start 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef737da80 1 -- start start 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef737da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 0x55b0efa82b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef737da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0ef83c000 con 0x55b0ef79b400 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef2321700 1 -- 172.21.15.155:0/3241145156 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55b0f053cb00 con 0x55b0ef79a800 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef5b28700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 0x55b0efa82b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef5b28700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 0x55b0efa82b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35398/0 (socket says 172.21.15.155:35398) 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef5b28700 1 -- 172.21.15.155:0/2891842937 learned_addr learned my addr 172.21.15.155:0/2891842937 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef2321700 1 --2- 172.21.15.155:0/3241145156 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efb26000 0x55b0efa83080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef2321700 1 -- 172.21.15.155:0/3241145156 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55b0ef815180 con 0x55b0ef79a800 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef5327700 1 --2- 172.21.15.155:0/3241145156 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efb26000 0x55b0efa83080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef5b28700 1 -- 172.21.15.155:0/2891842937 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0ef7c2000 con 0x55b0ef79b400 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef5b28700 1 --2- 172.21.15.155:0/2891842937 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 0x55b0efa82b00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55b0f0613d70 tx=0x55b0ef88b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58d16de8d7f2ed2 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1ef5327700 1 --2- 172.21.15.155:0/3241145156 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efb26000 0x55b0efa83080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55b0f0613080 tx=0x55b0efae4600 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1eefb1c700 1 -- 172.21.15.155:0/2891842937 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0ef8534a0 con 0x55b0ef79b400 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1eefb1c700 1 -- 172.21.15.155:0/2891842937 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0ef83bc80 con 0x55b0ef79b400 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.671+0000 7f1eefb1c700 1 -- 172.21.15.155:0/2891842937 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0ef853600 con 0x55b0ef79b400 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef737da80 1 -- 172.21.15.155:0/2891842937 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 msgr2=0x55b0efa82b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef737da80 1 --2- 172.21.15.155:0/2891842937 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 0x55b0efa82b00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55b0f0613d70 tx=0x55b0ef88b8c0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef737da80 1 -- 172.21.15.155:0/2891842937 shutdown_connections 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef737da80 1 --2- 172.21.15.155:0/2891842937 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 0x55b0efa82b00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef737da80 1 -- 172.21.15.155:0/2891842937 >> 172.21.15.155:0/2891842937 conn(0x55b0ef79ac00 msgr2=0x55b0ef887800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef737da80 1 -- 172.21.15.155:0/2891842937 shutdown_connections 2024-04-19T23:45:39.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef737da80 1 -- 172.21.15.155:0/2891842937 wait complete. 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef737da80 1 Processor -- start 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef737da80 1 -- start start 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef737da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 0x55b0efa82b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef737da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0ef7d6640 con 0x55b0ef79b400 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.672+0000 7f1ef5b28700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 0x55b0efa82b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.673+0000 7f1ef5b28700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 0x55b0efa82b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35410/0 (socket says 172.21.15.155:35410) 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.673+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 learned_addr learned my addr 172.21.15.155:0/1750706715 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.673+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0ef7c2ea0 con 0x55b0ef79b400 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.673+0000 7f1ef5b28700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 0x55b0efa82b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55b0f0612240 tx=0x55b0ef88b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.673+0000 7f1eee319700 1 -- 172.21.15.155:0/1750706715 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0ef853760 con 0x55b0ef79b400 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.673+0000 7f1eee319700 1 -- 172.21.15.155:0/1750706715 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0ef83bb00 con 0x55b0ef79b400 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.673+0000 7f1eee319700 1 -- 172.21.15.155:0/1750706715 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0ef8534a0 con 0x55b0ef79b400 2024-04-19T23:45:39.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.673+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b0ef7c2820 con 0x55b0ef79b400 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.673+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0ef7c29c0 con 0x55b0ef79b400 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.674+0000 7f1eee319700 1 -- 172.21.15.155:0/1750706715 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55b0f053cdc0 con 0x55b0ef79b400 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.674+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.674+0000 7f1eee319700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efb26c00 0x55b0efa83600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.674+0000 7f1eee319700 1 -- 172.21.15.155:0/1750706715 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55b0ef815340 con 0x55b0ef79b400 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.674+0000 7f1ef4b26700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efb26c00 0x55b0efa83600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.674+0000 7f1ef737da80 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55b0ef79b800 0x55b0efa83b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.674+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0ef79bc00 con 0x55b0ef79b800 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.674+0000 7f1ef5b28700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55b0ef79b800 0x55b0efa83b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef4b26700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efb26c00 0x55b0efa83600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55b0efb21ad0 tx=0x55b0efae5380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef5b28700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55b0ef79b800 0x55b0efa83b80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef737da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef737da80 20 realm 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efb27000 con 0x55b0ef79b800 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef737da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef737da80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efb27400 con 0x55b0ef79b800 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef737da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.675+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efb27800 con 0x55b0ef79b800 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.676+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.676+0000 7f1ef737da80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.676+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.676+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efb27c00 con 0x55b0ef79b800 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.676+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.676+0000 7f1ef737da80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.676+0000 7f1ef737da80 20 searching for the correct realm 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.676+0000 7f1ef737da80 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55b0efb27000 0x55b0efa84100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.676+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efb27400 con 0x55b0efb27000 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.676+0000 7f1ef5327700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55b0efb27000 0x55b0efa84100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.676+0000 7f1ef5327700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55b0efb27000 0x55b0efa84100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.677+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.677+0000 7f1ef5327700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55b0efb27400 0x55b0efa84c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.677+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628000 con 0x55b0efb27400 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.677+0000 7f1ef4b26700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55b0efb27400 0x55b0efa84c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.677+0000 7f1ef4b26700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55b0efb27400 0x55b0efa84c00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.677+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.678+0000 7f1ef4b26700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55b0f0628000 0x55b0efa85180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.678+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0f0628000 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.678+0000 7f1ef5b28700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55b0f0628000 0x55b0efa85180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.678+0000 7f1ef5b28700 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55b0f0628000 0x55b0efa85180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.678+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.678+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0ef79b800 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.679+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.679+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0ef79b800 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.679+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.679+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0f0628000 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.679+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.679+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0f0628000 2024-04-19T23:45:39.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.679+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.679+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27400 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.680+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.680+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27000 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.680+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.680+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0ef79b800 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.680+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.680+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0f0628000 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.680+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.680+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0ef79b800 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.681+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.681+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27400 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.681+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.681+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27000 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.681+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.681+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27000 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.681+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.681+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0f0628000 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.681+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.681+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27000 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.682+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.682+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27000 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.682+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.682+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0ef79b800 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.682+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.682+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0ef79b800 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.682+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.682+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0f0628000 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.683+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.683+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27000 2024-04-19T23:45:39.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.683+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.683+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27400 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.683+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.683+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0ef79b800 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.683+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.683+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0f0628000 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.684+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.684+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27000 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.684+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.684+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0f0628000 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.684+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.684+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27400 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.685+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.685+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27000 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.685+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.685+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0f0628000 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.685+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.685+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0ef79b800 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27400 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0ef79bc00 con 0x55b0ef79b800 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628c00 con 0x55b0ef79b800 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629000 con 0x55b0efb27400 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.686+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 20 zone default found 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 4 Realm: () 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:39.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 20 zonegroup default 2024-04-19T23:45:39.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629400 con 0x55b0f0628000 2024-04-19T23:45:39.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629800 con 0x55b0efb27000 2024-04-19T23:45:39.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629c00 con 0x55b0efb27000 2024-04-19T23:45:39.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 20 started sync module instance, tier type = 2024-04-19T23:45:39.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:39.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.687+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628c00 con 0x55b0efb27400 2024-04-19T23:45:39.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.688+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.688+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94218423343872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0ef79bc00 con 0x55b0efb27400 2024-04-19T23:45:39.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.688+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efb27800 con 0x55b0ef79b800 2024-04-19T23:45:39.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.689+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94218423343872] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.690+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.690+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94218423345024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efb27c00 con 0x55b0ef79b800 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.690+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0efb27000 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.691+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.691+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94218423346176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629000 con 0x55b0efb27000 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.691+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628c00 con 0x55b0efb27400 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.691+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94218423345024] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.692+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.692+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94218423347328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628400 con 0x55b0efb27400 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.692+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94218423346176] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.692+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629800 con 0x55b0ef79b800 2024-04-19T23:45:39.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.693+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94218423347328] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.693+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.693+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94218423348480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629c00 con 0x55b0ef79b800 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.693+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628800 con 0x55b0f0628000 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.694+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.694+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94218423349632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629400 con 0x55b0f0628000 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.694+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629800 con 0x55b0f0628000 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.694+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94218423348480] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.695+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94218423349632] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.695+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.695+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94218423350784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629c00 con 0x55b0f0628000 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.695+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efb27800 con 0x55b0f0628000 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.696+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94218423350784] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.696+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.696+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94218423351936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efb27c00 con 0x55b0f0628000 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.696+0000 7f1ef737da80 20 add_watcher() i=0 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.696+0000 7f1ef737da80 20 add_watcher() i=1 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.696+0000 7f1ef737da80 20 add_watcher() i=2 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.696+0000 7f1ef737da80 20 add_watcher() i=3 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.696+0000 7f1ef737da80 20 add_watcher() i=4 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.696+0000 7f1ef737da80 20 add_watcher() i=5 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.696+0000 7f1ef737da80 20 add_watcher() i=6 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.697+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94218423351936] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.697+0000 7f1ef737da80 20 add_watcher() i=7 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.697+0000 7f1ef737da80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.697+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efb27800 con 0x55b0ef79b800 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.697+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.697+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94218424885248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efb27c00 con 0x55b0ef79b800 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.698+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94218424885248] v30'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.698+0000 7f1edc2f5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.698+0000 7f1ef737da80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.698+0000 7f1ef737da80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.698+0000 7f1ef737da80 1 Processor -- start 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.699+0000 7f1ef737da80 1 -- start start 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.699+0000 7f1ef737da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.699+0000 7f1ef737da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0ef7d6780 con 0x55b0f0629400 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.699+0000 7f1ef4b26700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.699+0000 7f1ef4b26700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35424/0 (socket says 172.21.15.155:35424) 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.699+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1011855996 learned_addr learned my addr 172.21.15.155:0/1011855996 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.699+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1011855996 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0ef7c2b60 con 0x55b0f0629400 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.699+0000 7f1ef4b26700 1 --2- 172.21.15.155:0/1011855996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55b0efbfa0c0 tx=0x55b0efae5680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767c12b73d731153 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.699+0000 7f1edbaf4700 1 -- 172.21.15.155:0/1011855996 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0efc0c000 con 0x55b0f0629400 2024-04-19T23:45:39.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.700+0000 7f1edbaf4700 1 -- 172.21.15.155:0/1011855996 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0efc0e000 con 0x55b0f0629400 2024-04-19T23:45:39.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.700+0000 7f1edbaf4700 1 -- 172.21.15.155:0/1011855996 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0efc0c160 con 0x55b0f0629400 2024-04-19T23:45:39.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.700+0000 7f1ef737da80 1 -- 172.21.15.155:0/1011855996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 msgr2=0x55b0efa84680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.700+0000 7f1ef737da80 1 --2- 172.21.15.155:0/1011855996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55b0efbfa0c0 tx=0x55b0efae5680 comp rx=0 tx=0).stop 2024-04-19T23:45:39.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.700+0000 7f1ef737da80 1 -- 172.21.15.155:0/1011855996 shutdown_connections 2024-04-19T23:45:39.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.700+0000 7f1ef737da80 1 --2- 172.21.15.155:0/1011855996 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.700+0000 7f1ef737da80 1 -- 172.21.15.155:0/1011855996 >> 172.21.15.155:0/1011855996 conn(0x55b0f0628800 msgr2=0x55b0ef888000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.700+0000 7f1ef737da80 1 -- 172.21.15.155:0/1011855996 shutdown_connections 2024-04-19T23:45:39.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.700+0000 7f1ef737da80 1 -- 172.21.15.155:0/1011855996 wait complete. 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.700+0000 7f1ef737da80 1 Processor -- start 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.701+0000 7f1ef737da80 1 -- start start 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.701+0000 7f1ef737da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.701+0000 7f1ef737da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0ef83c000 con 0x55b0f0629400 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.701+0000 7f1ef4b26700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.701+0000 7f1ef4b26700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35440/0 (socket says 172.21.15.155:35440) 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.701+0000 7f1ef4b26700 1 -- 172.21.15.155:0/775983794 learned_addr learned my addr 172.21.15.155:0/775983794 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.701+0000 7f1ef4b26700 1 -- 172.21.15.155:0/775983794 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0ef7c2d00 con 0x55b0f0629400 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.701+0000 7f1ef4b26700 1 --2- 172.21.15.155:0/775983794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55b0efbfb380 tx=0x55b0efae57a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.701+0000 7f1eda2f1700 1 -- 172.21.15.155:0/775983794 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0efc0c2c0 con 0x55b0f0629400 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.702+0000 7f1eda2f1700 1 -- 172.21.15.155:0/775983794 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0efc0e180 con 0x55b0f0629400 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.702+0000 7f1ef737da80 1 -- 172.21.15.155:0/775983794 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b0ef7c2340 con 0x55b0f0629400 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.702+0000 7f1eda2f1700 1 -- 172.21.15.155:0/775983794 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b0efc0c000 con 0x55b0f0629400 2024-04-19T23:45:39.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.702+0000 7f1ef737da80 1 -- 172.21.15.155:0/775983794 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0ef7c2b60 con 0x55b0f0629400 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.702+0000 7f1eda2f1700 1 -- 172.21.15.155:0/775983794 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55b0f053db80 con 0x55b0f0629400 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.702+0000 7f1eda2f1700 1 --2- 172.21.15.155:0/775983794 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efc8c000 0x55b0efa85700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.702+0000 7f1eda2f1700 1 -- 172.21.15.155:0/775983794 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55b0ef815500 con 0x55b0f0629400 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.702+0000 7f1ef5b28700 1 --2- 172.21.15.155:0/775983794 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efc8c000 0x55b0efa85700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.702+0000 7f1ef737da80 5 note: GC not initialized 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.703+0000 7f1ef5b28700 1 --2- 172.21.15.155:0/775983794 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efc8c000 0x55b0efa85700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55b0efb213e0 tx=0x55b0efae54a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.703+0000 7f1ed7aec700 20 reqs_thread_entry: start 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.703+0000 7f1ef737da80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.704+0000 7f1ef737da80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.704+0000 7f1ed5ae8700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:10 2024 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.704+0000 7f1ed52c6700 20 reqs_thread_entry: start 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.704+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.704+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629c00 con 0x55b0efb27400 2024-04-19T23:45:39.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.704+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.704+0000 7f1ef737da80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.704+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.704+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efc8c400 con 0x55b0ef79b800 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.705+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(63 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.705+0000 7f1ef737da80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.705+0000 7f1ef737da80 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.705+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.705+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efc8c800 con 0x55b0efb27400 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.705+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.705+0000 7f1ef737da80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.705+0000 7f1ef737da80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.705+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efc8cc00 con 0x55b0ef79b800 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 4.18 4:18bf188b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efc8d000 con 0x55b0efb27400 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 4.1e 4:78fbacd6:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efc8d400 con 0x55b0f0628000 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 4.3e 4:7f7048b3:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efc8d800 con 0x55b0efb27400 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 4.1b 4:d86c5742:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efc8dc00 con 0x55b0efb27400 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 4.34 4:2c84189a:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efc8c800 con 0x55b0efb27400 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 4.2d 4:b7b7c48d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628c00 con 0x55b0f0628000 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:72 4.30 4:0e2208dd:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0629c00 con 0x55b0efb27000 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 4.10 4:0a1e2427:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0ef79bc00 con 0x55b0efb27000 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:74 4.3a 4:5cb7eb41:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efd0a000 con 0x55b0efb27000 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 4.9 4:9256d036:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efd0a400 con 0x55b0ef79b800 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:76 4.0 4:034cf032:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efd0a800 con 0x55b0efb27000 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(66 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(69 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(70 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(67 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(75 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(72 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(73 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.706+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(74 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.707+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(76 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.707+0000 7f1edc2f5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.707+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94218424885248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efd0ac00 con 0x55b0ef79b800 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.708+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94218424885248] v30'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.708+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94218423343872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efd0b000 con 0x55b0efb27400 2024-04-19T23:45:39.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.709+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94218423343872] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.709+0000 7f1ef737da80 20 remove_watcher() i=0 2024-04-19T23:45:39.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.709+0000 7f1ef737da80 2 removed watcher, disabling cache 2024-04-19T23:45:39.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.709+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94218423345024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efd0b400 con 0x55b0ef79b800 2024-04-19T23:45:39.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.710+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94218423345024] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.711+0000 7f1ef737da80 20 remove_watcher() i=1 2024-04-19T23:45:39.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.711+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94218423346176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efd0b800 con 0x55b0efb27000 2024-04-19T23:45:39.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.712+0000 7f1ef5327700 1 -- 172.21.15.155:0/1750706715 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94218423346176] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbcd200 con 0x55b0efb27000 2024-04-19T23:45:39.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.712+0000 7f1ef737da80 20 remove_watcher() i=2 2024-04-19T23:45:39.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.712+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94218423347328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efd0bc00 con 0x55b0efb27400 2024-04-19T23:45:39.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.713+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94218423347328] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbcd440 con 0x55b0efb27400 2024-04-19T23:45:39.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.713+0000 7f1ef737da80 20 remove_watcher() i=3 2024-04-19T23:45:39.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.713+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94218423348480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efd0b000 con 0x55b0ef79b800 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.714+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94218423348480] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0ef79b800 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.714+0000 7f1ef737da80 20 remove_watcher() i=4 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.714+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94218423349632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0efd0a400 con 0x55b0f0628000 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.715+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94218423349632] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.715+0000 7f1ef737da80 20 remove_watcher() i=5 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.715+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94218423350784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0ef79bc00 con 0x55b0f0628000 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.716+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94218423350784] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.716+0000 7f1ef737da80 20 remove_watcher() i=6 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.716+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94218423351936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b0f0628c00 con 0x55b0f0628000 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.716+0000 7f1ef5b28700 1 -- 172.21.15.155:0/1750706715 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94218423351936] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b0efbccb40 con 0x55b0f0628000 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.716+0000 7f1ef737da80 20 remove_watcher() i=7 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.716+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55b0f0628000 msgr2=0x55b0efa85180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.716+0000 7f1ef737da80 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55b0f0628000 0x55b0efa85180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.716+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55b0ef79b800 msgr2=0x55b0efa83b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.716+0000 7f1ef737da80 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55b0ef79b800 0x55b0efa83b80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.716+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55b0efb27400 msgr2=0x55b0efa84c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.716+0000 7f1ef737da80 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55b0efb27400 0x55b0efa84c00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55b0efb27000 msgr2=0x55b0efa84100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55b0efb27000 0x55b0efa84100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efb26c00 msgr2=0x55b0efa83600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efb26c00 0x55b0efa83600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55b0efb21ad0 tx=0x55b0efae5380 comp rx=0 tx=0).stop 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 msgr2=0x55b0efa82b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 --2- 172.21.15.155:0/1750706715 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79b400 0x55b0efa82b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55b0f0612240 tx=0x55b0ef88b800 comp rx=0 tx=0).stop 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 reap_dead start 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 shutdown_connections 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef4b26700 1 -- 172.21.15.155:0/1750706715 reap_dead start 2024-04-19T23:45:39.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 >> 172.21.15.155:0/1750706715 conn(0x55b0ef79ac00 msgr2=0x55b0ef887800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 shutdown_connections 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/1750706715 wait complete. 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/775983794 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efc8c000 msgr2=0x55b0efa85700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 --2- 172.21.15.155:0/775983794 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efc8c000 0x55b0efa85700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55b0efb213e0 tx=0x55b0efae54a0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/775983794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 msgr2=0x55b0efa84680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 --2- 172.21.15.155:0/775983794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55b0efbfb380 tx=0x55b0efae57a0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/775983794 shutdown_connections 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 --2- 172.21.15.155:0/775983794 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efc8c000 0x55b0efa85700 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 --2- 172.21.15.155:0/775983794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0f0629400 0x55b0efa84680 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/775983794 >> 172.21.15.155:0/775983794 conn(0x55b0f0628800 msgr2=0x55b0ef888000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/775983794 shutdown_connections 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.717+0000 7f1ef737da80 1 -- 172.21.15.155:0/775983794 wait complete. 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.718+0000 7f1ef737da80 1 -- 172.21.15.155:0/3241145156 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efb26000 msgr2=0x55b0efa83080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.718+0000 7f1ef737da80 1 --2- 172.21.15.155:0/3241145156 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efb26000 0x55b0efa83080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55b0f0613080 tx=0x55b0efae4600 comp rx=0 tx=0).stop 2024-04-19T23:45:39.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.718+0000 7f1ef737da80 1 -- 172.21.15.155:0/3241145156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 msgr2=0x55b0efa82580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.718+0000 7f1ef737da80 1 --2- 172.21.15.155:0/3241145156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55b0f060bf20 tx=0x55b0ef88b920 comp rx=0 tx=0).stop 2024-04-19T23:45:39.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.718+0000 7f1ef737da80 1 -- 172.21.15.155:0/3241145156 shutdown_connections 2024-04-19T23:45:39.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.718+0000 7f1ef737da80 1 --2- 172.21.15.155:0/3241145156 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55b0efb26000 0x55b0efa83080 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.718+0000 7f1ef737da80 1 --2- 172.21.15.155:0/3241145156 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55b0ef79a800 0x55b0efa82580 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.718+0000 7f1ef737da80 1 -- 172.21.15.155:0/3241145156 >> 172.21.15.155:0/3241145156 conn(0x55b0ef79a400 msgr2=0x55b0ef887000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.718+0000 7f1ef737da80 1 -- 172.21.15.155:0/3241145156 shutdown_connections 2024-04-19T23:45:39.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.718+0000 7f1ef737da80 1 -- 172.21.15.155:0/3241145156 wait complete. 2024-04-19T23:45:39.749 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:39.749 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo", 2024-04-19T23:45:39.749 INFO:teuthology.orchestra.run.smithi155.stdout: "num_shards": 11, 2024-04-19T23:45:39.749 INFO:teuthology.orchestra.run.smithi155.stdout: "tenant": "", 2024-04-19T23:45:39.749 INFO:teuthology.orchestra.run.smithi155.stdout: "zonegroup": "415e25ff-1f45-4d94-b7a7-66fe1b576744", 2024-04-19T23:45:39.749 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_rule": "default-placement", 2024-04-19T23:45:39.749 INFO:teuthology.orchestra.run.smithi155.stdout: "explicit_placement": { 2024-04-19T23:45:39.749 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": "", 2024-04-19T23:45:39.749 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "", 2024-04-19T23:45:39.749 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": "" 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "marker": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "index_type": "Normal", 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "versioned": false, 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "versioning_enabled": false, 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "object_lock_enabled": false, 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_enabled": false, 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1", 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2024-04-19T23:45:39.168535Z", 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "creation_time": "2024-04-19T23:45:39.164552Z", 2024-04-19T23:45:39.750 INFO:teuthology.orchestra.run.smithi155.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2024-04-19T23:45:39.751 INFO:teuthology.orchestra.run.smithi155.stdout: "usage": {}, 2024-04-19T23:45:39.751 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:39.751 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:39.751 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:39.751 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:39.751 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:39.751 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:39.751 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:39.751 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:39.751 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '415e25ff-1f45-4d94-b7a7-66fe1b576744', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'marker': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-19T23:45:39.168535Z', 'creation_time': '2024-04-19T23:45:39.164552Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-19T23:45:39.751 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-19T23:45:39.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-19T23:45:39.752 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-19T23:45:39.797 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:39.797 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:39.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.798+0000 7feeae4e6a80 1 Processor -- start 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.798+0000 7feeae4e6a80 1 -- start start 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.798+0000 7feeae4e6a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.798+0000 7feeae4e6a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bbcf20d500 con 0x55bbceee2c00 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.798+0000 7feeae4e6a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bbcef84a00 con 0x55bbceee2800 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.798+0000 7feeac490700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.798+0000 7feeac490700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35454/0 (socket says 172.21.15.155:35454) 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.798+0000 7feeac490700 1 -- 172.21.15.155:0/3365168883 learned_addr learned my addr 172.21.15.155:0/3365168883 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.799+0000 7feeac490700 1 -- 172.21.15.155:0/3365168883 >> v1:172.21.15.76:6789/0 conn(0x55bbceee2c00 legacy=0x55bbcefce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.799+0000 7feeac490700 1 -- 172.21.15.155:0/3365168883 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbcef0bd40 con 0x55bbceee2800 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.799+0000 7feeac490700 1 --2- 172.21.15.155:0/3365168883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55bbcf1c59e0 tx=0x55bbcefd3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2959b948ddeaa63 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.799+0000 7feeab48e700 1 -- 172.21.15.155:0/3365168883 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcef9b4a0 con 0x55bbceee2800 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.799+0000 7feeab48e700 1 -- 172.21.15.155:0/3365168883 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbcf20d800 con 0x55bbceee2800 2024-04-19T23:45:39.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.799+0000 7feeab48e700 1 -- 172.21.15.155:0/3365168883 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcef9b600 con 0x55bbceee2800 2024-04-19T23:45:39.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.799+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3365168883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 msgr2=0x55bbcf1ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.799+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/3365168883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55bbcf1c59e0 tx=0x55bbcefd3920 comp rx=0 tx=0).stop 2024-04-19T23:45:39.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.799+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3365168883 shutdown_connections 2024-04-19T23:45:39.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.799+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/3365168883 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.799+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3365168883 >> 172.21.15.155:0/3365168883 conn(0x55bbceee2400 msgr2=0x55bbcefce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.800+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3365168883 shutdown_connections 2024-04-19T23:45:39.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.800+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3365168883 wait complete. 2024-04-19T23:45:39.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.800+0000 7feeae4e6a80 1 Processor -- start 2024-04-19T23:45:39.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.800+0000 7feeae4e6a80 1 -- start start 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.800+0000 7feeae4e6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.800+0000 7feeae4e6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcef84500 con 0x55bbceee2800 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.801+0000 7feeac490700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.801+0000 7feeac490700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35468/0 (socket says 172.21.15.155:35468) 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.801+0000 7feeac490700 1 -- 172.21.15.155:0/2481998971 learned_addr learned my addr 172.21.15.155:0/2481998971 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.801+0000 7feeac490700 1 -- 172.21.15.155:0/2481998971 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbcef0bba0 con 0x55bbceee2800 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.801+0000 7feeac490700 1 --2- 172.21.15.155:0/2481998971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x55bbcfcac1b0 tx=0x55bbcefd3800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28ddb10941d7833 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.801+0000 7feeaac8d700 1 -- 172.21.15.155:0/2481998971 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcef9b760 con 0x55bbceee2800 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.801+0000 7feeaac8d700 1 -- 172.21.15.155:0/2481998971 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbcf20db00 con 0x55bbceee2800 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.801+0000 7feeaac8d700 1 -- 172.21.15.155:0/2481998971 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcef9b4a0 con 0x55bbceee2800 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.802+0000 7feeae4e6a80 1 -- 172.21.15.155:0/2481998971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 msgr2=0x55bbcf1ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.802+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/2481998971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x55bbcfcac1b0 tx=0x55bbcefd3800 comp rx=0 tx=0).stop 2024-04-19T23:45:39.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.802+0000 7feeae4e6a80 1 -- 172.21.15.155:0/2481998971 shutdown_connections 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.802+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/2481998971 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.802+0000 7feeae4e6a80 1 -- 172.21.15.155:0/2481998971 >> 172.21.15.155:0/2481998971 conn(0x55bbceee2400 msgr2=0x55bbcefcf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.802+0000 7feeae4e6a80 1 -- 172.21.15.155:0/2481998971 shutdown_connections 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.802+0000 7feeae4e6a80 1 -- 172.21.15.155:0/2481998971 wait complete. 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.802+0000 7feeae4e6a80 1 Processor -- start 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.802+0000 7feeae4e6a80 1 -- start start 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.802+0000 7feeae4e6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.802+0000 7feeae4e6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcef843c0 con 0x55bbceee2800 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.803+0000 7feeac490700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.803+0000 7feeac490700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35482/0 (socket says 172.21.15.155:35482) 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.803+0000 7feeac490700 1 -- 172.21.15.155:0/3466345076 learned_addr learned my addr 172.21.15.155:0/3466345076 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.803+0000 7feeac490700 1 -- 172.21.15.155:0/3466345076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbcef0ba00 con 0x55bbceee2800 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.803+0000 7feeac490700 1 --2- 172.21.15.155:0/3466345076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55bbcfcad890 tx=0x55bbcefd3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.803+0000 7feea948a700 1 -- 172.21.15.155:0/3466345076 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcef9b600 con 0x55bbceee2800 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.803+0000 7feea948a700 1 -- 172.21.15.155:0/3466345076 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbcf20dc80 con 0x55bbceee2800 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.803+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3466345076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bbcef0b860 con 0x55bbceee2800 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.803+0000 7feea948a700 1 -- 172.21.15.155:0/3466345076 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcef9b8c0 con 0x55bbceee2800 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.803+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3466345076 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbcef0b6c0 con 0x55bbceee2800 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feeae4e6a80 1 Processor -- start 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feeae4e6a80 1 -- start start 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feea948a700 1 -- 172.21.15.155:0/3466345076 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55bbcfc84b00 con 0x55bbceee2800 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feeae4e6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 0x55bbcf1cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feeae4e6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcef84000 con 0x55bbceee3400 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feea948a700 1 --2- 172.21.15.155:0/3466345076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf262000 0x55bbcf1cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feea948a700 1 -- 172.21.15.155:0/3466345076 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55bbcef5d180 con 0x55bbceee2800 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feeac490700 1 --2- 172.21.15.155:0/3466345076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf262000 0x55bbcf1cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feeacc91700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 0x55bbcf1cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feeacc91700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 0x55bbcf1cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35484/0 (socket says 172.21.15.155:35484) 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feeacc91700 1 -- 172.21.15.155:0/4225658667 learned_addr learned my addr 172.21.15.155:0/4225658667 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feeacc91700 1 -- 172.21.15.155:0/4225658667 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbcef0a000 con 0x55bbceee3400 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.804+0000 7feeac490700 1 --2- 172.21.15.155:0/3466345076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf262000 0x55bbcf1cb080 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55bbcfd6ee70 tx=0x55bbcf226540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feeacc91700 1 --2- 172.21.15.155:0/4225658667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 0x55bbcf1cab00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55bbcfd6e1b0 tx=0x55bbcf226720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b42f13282c7e3e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feea6c85700 1 -- 172.21.15.155:0/4225658667 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcef9b600 con 0x55bbceee3400 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feea6c85700 1 -- 172.21.15.155:0/4225658667 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbcef83c80 con 0x55bbceee3400 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feea6c85700 1 -- 172.21.15.155:0/4225658667 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcef9b8c0 con 0x55bbceee3400 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4225658667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 msgr2=0x55bbcf1cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/4225658667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 0x55bbcf1cab00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55bbcfd6e1b0 tx=0x55bbcf226720 comp rx=0 tx=0).stop 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4225658667 shutdown_connections 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/4225658667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 0x55bbcf1cab00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4225658667 >> 172.21.15.155:0/4225658667 conn(0x55bbceee2c00 msgr2=0x55bbcefcf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4225658667 shutdown_connections 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4225658667 wait complete. 2024-04-19T23:45:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feeae4e6a80 1 Processor -- start 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.805+0000 7feeae4e6a80 1 -- start start 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feeae4e6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 0x55bbcf1cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feeae4e6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcef1e640 con 0x55bbceee3400 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feeacc91700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 0x55bbcf1cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feeacc91700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 0x55bbcf1cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35488/0 (socket says 172.21.15.155:35488) 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 learned_addr learned my addr 172.21.15.155:0/1068385478 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbcef0aea0 con 0x55bbceee3400 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feeacc91700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 0x55bbcf1cab00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55bbcfd6e390 tx=0x55bbcefd38c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feea5482700 1 -- 172.21.15.155:0/1068385478 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcef9b760 con 0x55bbceee3400 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feea5482700 1 -- 172.21.15.155:0/1068385478 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbcef83b00 con 0x55bbceee3400 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bbcef0a820 con 0x55bbceee3400 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feea5482700 1 -- 172.21.15.155:0/1068385478 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcef9b600 con 0x55bbceee3400 2024-04-19T23:45:39.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.806+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbcef0a9c0 con 0x55bbceee3400 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.807+0000 7feea5482700 1 -- 172.21.15.155:0/1068385478 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55bbcfc84dc0 con 0x55bbceee3400 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.807+0000 7feea5482700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf262c00 0x55bbcf1cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.807+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.807+0000 7feea5482700 1 -- 172.21.15.155:0/1068385478 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55bbcef5d340 con 0x55bbceee3400 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.807+0000 7feeabc8f700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf262c00 0x55bbcf1cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.807+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bbceee3800 0x55bbcf1cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbceee3c00 con 0x55bbceee3800 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeacc91700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bbceee3800 0x55bbcf1cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeacc91700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bbceee3800 0x55bbcf1cbb80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeabc8f700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf262c00 0x55bbcf1cb600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55bbcf1c5f80 tx=0x55bbcf227320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeae4e6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeae4e6a80 20 realm 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf263000 con 0x55bbceee3800 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeae4e6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeae4e6a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.808+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf263400 con 0x55bbceee3800 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeae4e6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf263800 con 0x55bbceee3800 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeae4e6a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf263c00 con 0x55bbceee3800 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeae4e6a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeae4e6a80 20 searching for the correct realm 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bbcf263000 0x55bbcf1cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf263400 con 0x55bbcf263000 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.809+0000 7feeac490700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bbcf263000 0x55bbcf1cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.810+0000 7feeac490700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bbcf263000 0x55bbcf1cc100 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.810+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.810+0000 7feeac490700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bbcf263400 0x55bbcf1ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.810+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a000 con 0x55bbcf263400 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.810+0000 7feeabc8f700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bbcf263400 0x55bbcf1ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.811+0000 7feeabc8f700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bbcf263400 0x55bbcf1ccc00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.811+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.811+0000 7feeabc8f700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bbcfd7a000 0x55bbcf1cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.811+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcfd7a000 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.811+0000 7feeacc91700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bbcfd7a000 0x55bbcf1cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.811+0000 7feeacc91700 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bbcfd7a000 0x55bbcf1cd180 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.812+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.812+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbceee3800 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.812+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.812+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbceee3800 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.812+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.812+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcfd7a000 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.812+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.812+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcfd7a000 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.812+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.812+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263400 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.813+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.813+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263000 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.813+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.813+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbceee3800 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.813+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.813+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcfd7a000 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.813+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.813+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbceee3800 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.814+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.814+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263400 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.814+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.814+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263000 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.814+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.814+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263000 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.814+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.814+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcfd7a000 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.814+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.814+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263000 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.815+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.815+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263000 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.815+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.815+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbceee3800 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.815+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.815+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbceee3800 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.815+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.815+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcfd7a000 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.816+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.816+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263000 2024-04-19T23:45:39.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.816+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.816+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263400 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.816+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.816+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbceee3800 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.816+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.816+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcfd7a000 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.816+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.817+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263000 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.817+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.817+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcfd7a000 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.817+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.817+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263400 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.817+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.817+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263000 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.817+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.817+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcfd7a000 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.818+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.818+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbceee3800 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.818+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.818+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263400 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.818+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.818+0000 7feeae4e6a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.818+0000 7feeae4e6a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.818+0000 7feeae4e6a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.818+0000 7feeae4e6a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.818+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.818+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbceee3c00 con 0x55bbceee3800 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7ac00 con 0x55bbceee3800 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7b000 con 0x55bbcf263400 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 20 zone default found 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 4 Realm: () 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:39.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 20 zonegroup default 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.819+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7b400 con 0x55bbcfd7a000 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeae4e6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7b800 con 0x55bbcf263000 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeae4e6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7bc00 con 0x55bbcf263000 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeae4e6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeae4e6a80 20 started sync module instance, tier type = 2024-04-19T23:45:39.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeae4e6a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:39.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.820+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7ac00 con 0x55bbcf263400 2024-04-19T23:45:39.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.821+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.821+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94265121970944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbceee3c00 con 0x55bbcf263400 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.821+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf263800 con 0x55bbceee3800 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.822+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94265121970944] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.822+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.822+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94265121972096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf263c00 con 0x55bbceee3800 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.822+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcf263000 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.824+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94265121972096] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.824+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.824+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94265121973248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7b000 con 0x55bbcf263000 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.824+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7ac00 con 0x55bbcf263400 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.825+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94265121973248] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.825+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.825+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94265121974400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a400 con 0x55bbcf263400 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.825+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7b800 con 0x55bbceee3800 2024-04-19T23:45:39.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.826+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94265121974400] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.826+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.826+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94265121975552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7bc00 con 0x55bbceee3800 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.826+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7a800 con 0x55bbcfd7a000 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.827+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.827+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94265121976704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7b400 con 0x55bbcfd7a000 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.827+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7b800 con 0x55bbcfd7a000 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.827+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94265121975552] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.828+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94265121976704] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.828+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.828+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94265121977856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7bc00 con 0x55bbcfd7a000 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.828+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf263800 con 0x55bbcfd7a000 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.831+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.831+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94265121979008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf263c00 con 0x55bbcfd7a000 2024-04-19T23:45:39.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.831+0000 7feeae4e6a80 20 add_watcher() i=0 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.831+0000 7feeae4e6a80 20 add_watcher() i=1 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.831+0000 7feeae4e6a80 20 add_watcher() i=2 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.831+0000 7feeae4e6a80 20 add_watcher() i=3 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.831+0000 7feeae4e6a80 20 add_watcher() i=4 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.831+0000 7feeae4e6a80 20 add_watcher() i=5 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.831+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94265121977856] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.831+0000 7feeae4e6a80 20 add_watcher() i=6 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.834+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94265121979008] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.834+0000 7feeae4e6a80 20 add_watcher() i=7 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.834+0000 7feeae4e6a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.834+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf263800 con 0x55bbceee3800 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.834+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.834+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94265123487744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf263c00 con 0x55bbceee3800 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.835+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94265123487744] v30'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.835+0000 7fee9345e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.836+0000 7feeae4e6a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.836+0000 7feeae4e6a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.836+0000 7feeae4e6a80 1 Processor -- start 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.836+0000 7feeae4e6a80 1 -- start start 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.836+0000 7feeae4e6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.836+0000 7feeae4e6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcef1e780 con 0x55bbcfd7b400 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.836+0000 7feeabc8f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.836+0000 7feeabc8f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35500/0 (socket says 172.21.15.155:35500) 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.836+0000 7feeabc8f700 1 -- 172.21.15.155:0/1715952502 learned_addr learned my addr 172.21.15.155:0/1715952502 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.837+0000 7feeabc8f700 1 -- 172.21.15.155:0/1715952502 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbcef0ab60 con 0x55bbcfd7b400 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.837+0000 7feeabc8f700 1 --2- 172.21.15.155:0/1715952502 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55bbcf33c0c0 tx=0x55bbcf227680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39586cacd354b05 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.837+0000 7fee92c5d700 1 -- 172.21.15.155:0/1715952502 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcf34e000 con 0x55bbcfd7b400 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.837+0000 7fee92c5d700 1 -- 172.21.15.155:0/1715952502 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbcf350000 con 0x55bbcfd7b400 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.837+0000 7fee92c5d700 1 -- 172.21.15.155:0/1715952502 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcf34e160 con 0x55bbcfd7b400 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.838+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1715952502 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 msgr2=0x55bbcf1cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.838+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/1715952502 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55bbcf33c0c0 tx=0x55bbcf227680 comp rx=0 tx=0).stop 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.838+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1715952502 shutdown_connections 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.838+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/1715952502 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.838+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1715952502 >> 172.21.15.155:0/1715952502 conn(0x55bbcfd7a800 msgr2=0x55bbcefd0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.838+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1715952502 shutdown_connections 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.838+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1715952502 wait complete. 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.838+0000 7feeae4e6a80 1 Processor -- start 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.838+0000 7feeae4e6a80 1 -- start start 2024-04-19T23:45:39.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.838+0000 7feeae4e6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.838+0000 7feeae4e6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcef84000 con 0x55bbcfd7b400 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.839+0000 7feeabc8f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.839+0000 7feeabc8f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35504/0 (socket says 172.21.15.155:35504) 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.839+0000 7feeabc8f700 1 -- 172.21.15.155:0/4199415671 learned_addr learned my addr 172.21.15.155:0/4199415671 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.839+0000 7feeabc8f700 1 -- 172.21.15.155:0/4199415671 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbcef0ad00 con 0x55bbcfd7b400 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.839+0000 7feeabc8f700 1 --2- 172.21.15.155:0/4199415671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55bbcf33d380 tx=0x55bbcf2277a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.839+0000 7fee9145a700 1 -- 172.21.15.155:0/4199415671 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcf34e2c0 con 0x55bbcfd7b400 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.839+0000 7fee9145a700 1 -- 172.21.15.155:0/4199415671 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbcf350180 con 0x55bbcfd7b400 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.839+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4199415671 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bbcef0a340 con 0x55bbcfd7b400 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.839+0000 7fee9145a700 1 -- 172.21.15.155:0/4199415671 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bbcf34e000 con 0x55bbcfd7b400 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.839+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4199415671 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbcef0ab60 con 0x55bbcfd7b400 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.840+0000 7fee9145a700 1 -- 172.21.15.155:0/4199415671 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55bbcfc85b80 con 0x55bbcfd7b400 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.840+0000 7fee9145a700 1 --2- 172.21.15.155:0/4199415671 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf3d0000 0x55bbcf1cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.840+0000 7fee9145a700 1 -- 172.21.15.155:0/4199415671 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55bbcef5d500 con 0x55bbcfd7b400 2024-04-19T23:45:39.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.840+0000 7feeae4e6a80 5 note: GC not initialized 2024-04-19T23:45:39.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.840+0000 7feeacc91700 1 --2- 172.21.15.155:0/4199415671 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf3d0000 0x55bbcf1cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.840+0000 7feeacc91700 1 --2- 172.21.15.155:0/4199415671 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf3d0000 0x55bbcf1cd700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55bbcf2b9470 tx=0x55bbcf2274a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.841+0000 7fee8ec55700 20 reqs_thread_entry: start 2024-04-19T23:45:39.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.841+0000 7feeae4e6a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:39.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.841+0000 7feeae4e6a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:39.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.841+0000 7fee8cc51700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:10 2024 2024-04-19T23:45:39.854 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:39.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.841+0000 7fee8c42f700 20 reqs_thread_entry: start 2024-04-19T23:45:39.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.841+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.841+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7bc00 con 0x55bbceee3800 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.842+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.842+0000 7feeae4e6a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.842+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf3d0400 con 0x55bbcf263400 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.842+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.842+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.842+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf3d0800 con 0x55bbcf263400 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf3d0c00 con 0x55bbceee3800 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-19T23:45:39.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 4.18 4:18bf188b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf3d1000 con 0x55bbcf263400 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 4.1e 4:78fbacd6:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf3d1400 con 0x55bbcfd7a000 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 4.3e 4:7f7048b3:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf3d1800 con 0x55bbcf263400 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 4.1b 4:d86c5742:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf3d1c00 con 0x55bbcf263400 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 4.34 4:2c84189a:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf3d0400 con 0x55bbcf263400 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 4.2d 4:b7b7c48d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf3d0800 con 0x55bbcfd7a000 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:72 4.30 4:0e2208dd:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7ac00 con 0x55bbcf263000 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 4.10 4:0a1e2427:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbceee3c00 con 0x55bbcf263000 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:74 4.3a 4:5cb7eb41:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf442000 con 0x55bbcf263000 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 4.9 4:9256d036:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf442400 con 0x55bbceee3800 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:76 4.0 4:034cf032:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf442800 con 0x55bbcf263000 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(67 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.843+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.844+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(66 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.844+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(75 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.844+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(68 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.844+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(72 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.844+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(69 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.844+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(74 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.844+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(70 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.844+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(73 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.844+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(76 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.844+0000 7fee9345e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.844+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94265123487744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf442c00 con 0x55bbceee3800 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.845+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94265123487744] v30'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.846+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94265121970944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf443000 con 0x55bbcf263400 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.847+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94265121970944] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.847+0000 7feeae4e6a80 20 remove_watcher() i=0 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.847+0000 7feeae4e6a80 2 removed watcher, disabling cache 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.847+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94265121972096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf443400 con 0x55bbceee3800 2024-04-19T23:45:39.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.848+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94265121972096] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.848+0000 7feeae4e6a80 20 remove_watcher() i=1 2024-04-19T23:45:39.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.848+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94265121973248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf443800 con 0x55bbcf263000 2024-04-19T23:45:39.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.851+0000 7feeac490700 1 -- 172.21.15.155:0/1068385478 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94265121973248] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31b200 con 0x55bbcf263000 2024-04-19T23:45:39.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.851+0000 7feeae4e6a80 20 remove_watcher() i=2 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.851+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94265121974400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf443c00 con 0x55bbcf263400 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.852+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94265121974400] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31b440 con 0x55bbcf263400 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.852+0000 7feeae4e6a80 20 remove_watcher() i=3 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.852+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94265121975552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf443000 con 0x55bbceee3800 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.853+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94265121975552] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbceee3800 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.853+0000 7feeae4e6a80 20 remove_watcher() i=4 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.853+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94265121976704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcf442400 con 0x55bbcfd7a000 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.856+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94265121976704] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.856+0000 7feeae4e6a80 20 remove_watcher() i=5 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.856+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94265121977856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbceee3c00 con 0x55bbcfd7a000 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.858+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94265121977856] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.859+0000 7feeae4e6a80 20 remove_watcher() i=6 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.859+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94265121979008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbcfd7bc00 con 0x55bbcfd7a000 2024-04-19T23:45:39.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeacc91700 1 -- 172.21.15.155:0/1068385478 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94265121979008] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bbcf31ab40 con 0x55bbcfd7a000 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 20 remove_watcher() i=7 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bbcfd7a000 msgr2=0x55bbcf1cd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bbcfd7a000 0x55bbcf1cd180 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bbceee3800 msgr2=0x55bbcf1cbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bbceee3800 0x55bbcf1cbb80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bbcf263400 msgr2=0x55bbcf1ccc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bbcf263400 0x55bbcf1ccc00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bbcf263000 msgr2=0x55bbcf1cc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bbcf263000 0x55bbcf1cc100 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf262c00 msgr2=0x55bbcf1cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf262c00 0x55bbcf1cb600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55bbcf1c5f80 tx=0x55bbcf227320 comp rx=0 tx=0).stop 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 msgr2=0x55bbcf1cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/1068385478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee3400 0x55bbcf1cab00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55bbcfd6e390 tx=0x55bbcefd38c0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 reap_dead start 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeabc8f700 1 -- 172.21.15.155:0/1068385478 reap_dead start 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 shutdown_connections 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 >> 172.21.15.155:0/1068385478 conn(0x55bbceee2c00 msgr2=0x55bbcefcf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 shutdown_connections 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/1068385478 wait complete. 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4199415671 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf3d0000 msgr2=0x55bbcf1cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/4199415671 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf3d0000 0x55bbcf1cd700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55bbcf2b9470 tx=0x55bbcf2274a0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4199415671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 msgr2=0x55bbcf1cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/4199415671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55bbcf33d380 tx=0x55bbcf2277a0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4199415671 shutdown_connections 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/4199415671 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf3d0000 0x55bbcf1cd700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/4199415671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbcfd7b400 0x55bbcf1cc680 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4199415671 >> 172.21.15.155:0/4199415671 conn(0x55bbcfd7a800 msgr2=0x55bbcefd0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4199415671 shutdown_connections 2024-04-19T23:45:39.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.860+0000 7feeae4e6a80 1 -- 172.21.15.155:0/4199415671 wait complete. 2024-04-19T23:45:39.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.861+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3466345076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf262000 msgr2=0x55bbcf1cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.861+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/3466345076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf262000 0x55bbcf1cb080 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55bbcfd6ee70 tx=0x55bbcf226540 comp rx=0 tx=0).stop 2024-04-19T23:45:39.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.861+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3466345076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 msgr2=0x55bbcf1ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.861+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/3466345076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55bbcfcad890 tx=0x55bbcefd3920 comp rx=0 tx=0).stop 2024-04-19T23:45:39.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.861+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3466345076 shutdown_connections 2024-04-19T23:45:39.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.861+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/3466345076 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bbcf262000 0x55bbcf1cb080 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.861+0000 7feeae4e6a80 1 --2- 172.21.15.155:0/3466345076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bbceee2800 0x55bbcf1ca580 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.861+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3466345076 >> 172.21.15.155:0/3466345076 conn(0x55bbceee2400 msgr2=0x55bbcefcf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.861+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3466345076 shutdown_connections 2024-04-19T23:45:39.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.861+0000 7feeae4e6a80 1 -- 172.21.15.155:0/3466345076 wait complete. 2024-04-19T23:45:39.866 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2024-04-19T23:45:39.866 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:39.866 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo", 2024-04-19T23:45:39.866 INFO:teuthology.orchestra.run.smithi155.stdout: "num_shards": 11, 2024-04-19T23:45:39.866 INFO:teuthology.orchestra.run.smithi155.stdout: "tenant": "", 2024-04-19T23:45:39.866 INFO:teuthology.orchestra.run.smithi155.stdout: "zonegroup": "415e25ff-1f45-4d94-b7a7-66fe1b576744", 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_rule": "default-placement", 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "explicit_placement": { 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": "", 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "", 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": "" 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "marker": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "index_type": "Normal", 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "versioned": false, 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "versioning_enabled": false, 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "object_lock_enabled": false, 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_enabled": false, 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:45:39.867 INFO:teuthology.orchestra.run.smithi155.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1", 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2024-04-19T23:45:39.168535Z", 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: "creation_time": "2024-04-19T23:45:39.164552Z", 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: "usage": {}, 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:39.868 INFO:teuthology.orchestra.run.smithi155.stdout:] 2024-04-19T23:45:39.869 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '415e25ff-1f45-4d94-b7a7-66fe1b576744', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'marker': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-19T23:45:39.168535Z', 'creation_time': '2024-04-19T23:45:39.164552Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-19T23:45:39.874 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-19T23:45:39.874 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-19T23:45:39.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-19T23:45:39.874 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-19T23:45:39.919 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:39.919 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:39.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.920+0000 7f7013d58a80 1 Processor -- start 2024-04-19T23:45:39.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.920+0000 7f7013d58a80 1 -- start start 2024-04-19T23:45:39.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.920+0000 7f7013d58a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55685e238c00 0x55685e520580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.920+0000 7f7013d58a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55685e563500 con 0x55685e238800 2024-04-19T23:45:39.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.920+0000 7f7013d58a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55685e2daa00 con 0x55685e238c00 2024-04-19T23:45:39.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.921+0000 7f7011501700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55685e238c00 0x55685e520580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.921+0000 7f7011d02700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55685e238800 0x55685e324800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46702/0 (socket says 172.21.15.155:46702) 2024-04-19T23:45:39.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.921+0000 7f7011d02700 1 -- 172.21.15.155:0/2322383794 learned_addr learned my addr 172.21.15.155:0/2322383794 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:39.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.921+0000 7f7011501700 1 -- 172.21.15.155:0/2322383794 >> v1:172.21.15.76:6789/0 conn(0x55685e238800 legacy=0x55685e324800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.921+0000 7f7011501700 1 -- 172.21.15.155:0/2322383794 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55685e261d40 con 0x55685e238c00 2024-04-19T23:45:39.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.921+0000 7f7011501700 1 --2- 172.21.15.155:0/2322383794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238c00 0x55685e520580 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x55685e51b890 tx=0x55685e329920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5309c95382db4869 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.921+0000 7f7010d00700 1 -- 172.21.15.155:0/2322383794 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e2f14a0 con 0x55685e238c00 2024-04-19T23:45:39.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.921+0000 7f7010d00700 1 -- 172.21.15.155:0/2322383794 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55685e563800 con 0x55685e238c00 2024-04-19T23:45:39.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.921+0000 7f7010d00700 1 -- 172.21.15.155:0/2322383794 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e2f1600 con 0x55685e238c00 2024-04-19T23:45:39.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.922+0000 7f7013d58a80 1 -- 172.21.15.155:0/2322383794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238c00 msgr2=0x55685e520580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.922+0000 7f7013d58a80 1 --2- 172.21.15.155:0/2322383794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238c00 0x55685e520580 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x55685e51b890 tx=0x55685e329920 comp rx=0 tx=0).stop 2024-04-19T23:45:39.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.922+0000 7f7013d58a80 1 -- 172.21.15.155:0/2322383794 shutdown_connections 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.922+0000 7f7013d58a80 1 --2- 172.21.15.155:0/2322383794 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238c00 0x55685e520580 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.922+0000 7f7013d58a80 1 -- 172.21.15.155:0/2322383794 >> 172.21.15.155:0/2322383794 conn(0x55685e238400 msgr2=0x55685e324000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.922+0000 7f7013d58a80 1 -- 172.21.15.155:0/2322383794 shutdown_connections 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.922+0000 7f7013d58a80 1 -- 172.21.15.155:0/2322383794 wait complete. 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.922+0000 7f7013d58a80 1 Processor -- start 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.922+0000 7f7013d58a80 1 -- start start 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.922+0000 7f7013d58a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.923+0000 7f7013d58a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55685e2da500 con 0x55685e238800 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.923+0000 7f7011d02700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.923+0000 7f7011d02700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35522/0 (socket says 172.21.15.155:35522) 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.923+0000 7f7011d02700 1 -- 172.21.15.155:0/1319059911 learned_addr learned my addr 172.21.15.155:0/1319059911 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.923+0000 7f7011d02700 1 -- 172.21.15.155:0/1319059911 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55685e261ba0 con 0x55685e238800 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.923+0000 7f7011d02700 1 --2- 172.21.15.155:0/1319059911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x55685e3a9890 tx=0x55685e329b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f013569c4aece722 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.923+0000 7f70104ff700 1 -- 172.21.15.155:0/1319059911 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e2f14a0 con 0x55685e238800 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.923+0000 7f70104ff700 1 -- 172.21.15.155:0/1319059911 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55685e563b00 con 0x55685e238800 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.923+0000 7f70104ff700 1 -- 172.21.15.155:0/1319059911 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e2f1600 con 0x55685e238800 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7013d58a80 1 -- 172.21.15.155:0/1319059911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 msgr2=0x55685e520580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7013d58a80 1 --2- 172.21.15.155:0/1319059911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x55685e3a9890 tx=0x55685e329b60 comp rx=0 tx=0).stop 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7013d58a80 1 -- 172.21.15.155:0/1319059911 shutdown_connections 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7013d58a80 1 --2- 172.21.15.155:0/1319059911 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7013d58a80 1 -- 172.21.15.155:0/1319059911 >> 172.21.15.155:0/1319059911 conn(0x55685e238400 msgr2=0x55685e325000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7013d58a80 1 -- 172.21.15.155:0/1319059911 shutdown_connections 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7013d58a80 1 -- 172.21.15.155:0/1319059911 wait complete. 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7013d58a80 1 Processor -- start 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7013d58a80 1 -- start start 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7013d58a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7013d58a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55685e2da3c0 con 0x55685e238800 2024-04-19T23:45:39.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7011d02700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7011d02700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35538/0 (socket says 172.21.15.155:35538) 2024-04-19T23:45:39.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.924+0000 7f7011d02700 1 -- 172.21.15.155:0/3150857477 learned_addr learned my addr 172.21.15.155:0/3150857477 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.925+0000 7f7011d02700 1 -- 172.21.15.155:0/3150857477 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55685e261a00 con 0x55685e238800 2024-04-19T23:45:39.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.925+0000 7f7011d02700 1 --2- 172.21.15.155:0/3150857477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55685e3a9aa0 tx=0x55685e329a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.925+0000 7f700ecfc700 1 -- 172.21.15.155:0/3150857477 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e2f18c0 con 0x55685e238800 2024-04-19T23:45:39.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.925+0000 7f700ecfc700 1 -- 172.21.15.155:0/3150857477 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55685e2d9c80 con 0x55685e238800 2024-04-19T23:45:39.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.925+0000 7f7013d58a80 1 -- 172.21.15.155:0/3150857477 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55685e261860 con 0x55685e238800 2024-04-19T23:45:39.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.925+0000 7f700ecfc700 1 -- 172.21.15.155:0/3150857477 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e2f14a0 con 0x55685e238800 2024-04-19T23:45:39.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.925+0000 7f7013d58a80 1 -- 172.21.15.155:0/3150857477 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55685e2616c0 con 0x55685e238800 2024-04-19T23:45:39.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.925+0000 7f7013d58a80 1 Processor -- start 2024-04-19T23:45:39.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f7013d58a80 1 -- start start 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f700ecfc700 1 -- 172.21.15.155:0/3150857477 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55685efdab00 con 0x55685e238800 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f7013d58a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 0x55685e520b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f7013d58a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55685e2da000 con 0x55685e239400 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f700ecfc700 1 --2- 172.21.15.155:0/3150857477 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e5ba000 0x55685e521080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f700ecfc700 1 -- 172.21.15.155:0/3150857477 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55685e2b3180 con 0x55685e238800 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f7012503700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 0x55685e520b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f7012503700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 0x55685e520b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35542/0 (socket says 172.21.15.155:35542) 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f7012503700 1 -- 172.21.15.155:0/1093625290 learned_addr learned my addr 172.21.15.155:0/1093625290 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f7011d02700 1 --2- 172.21.15.155:0/3150857477 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e5ba000 0x55685e521080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f7012503700 1 -- 172.21.15.155:0/1093625290 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55685e260000 con 0x55685e239400 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f7011d02700 1 --2- 172.21.15.155:0/3150857477 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e5ba000 0x55685e521080 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55685f0aaab0 tx=0x55685e57c240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f7012503700 1 --2- 172.21.15.155:0/1093625290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 0x55685e520b00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55685f0aa930 tx=0x55685e57c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225c3c51a187ca9a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f700c4f7700 1 -- 172.21.15.155:0/1093625290 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e2f18c0 con 0x55685e239400 2024-04-19T23:45:39.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f700c4f7700 1 -- 172.21.15.155:0/1093625290 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55685e562300 con 0x55685e239400 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.926+0000 7f700c4f7700 1 -- 172.21.15.155:0/1093625290 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e2f14a0 con 0x55685e239400 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7013d58a80 1 -- 172.21.15.155:0/1093625290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 msgr2=0x55685e520b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7013d58a80 1 --2- 172.21.15.155:0/1093625290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 0x55685e520b00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55685f0aa930 tx=0x55685e57c060 comp rx=0 tx=0).stop 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7013d58a80 1 -- 172.21.15.155:0/1093625290 shutdown_connections 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7013d58a80 1 --2- 172.21.15.155:0/1093625290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 0x55685e520b00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7013d58a80 1 -- 172.21.15.155:0/1093625290 >> 172.21.15.155:0/1093625290 conn(0x55685e238c00 msgr2=0x55685e325800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7013d58a80 1 -- 172.21.15.155:0/1093625290 shutdown_connections 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7013d58a80 1 -- 172.21.15.155:0/1093625290 wait complete. 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7013d58a80 1 Processor -- start 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7013d58a80 1 -- start start 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7013d58a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 0x55685e520b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7013d58a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55685e274640 con 0x55685e239400 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.927+0000 7f7012503700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 0x55685e520b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.928+0000 7f7012503700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 0x55685e520b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35556/0 (socket says 172.21.15.155:35556) 2024-04-19T23:45:39.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.928+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 learned_addr learned my addr 172.21.15.155:0/3936466469 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.928+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55685e260ea0 con 0x55685e239400 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.928+0000 7f7012503700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 0x55685e520b00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55685f0abfb0 tx=0x55685e329f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.928+0000 7f700acf4700 1 -- 172.21.15.155:0/3936466469 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e2f1b80 con 0x55685e239400 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.928+0000 7f700acf4700 1 -- 172.21.15.155:0/3936466469 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55685e2d9c80 con 0x55685e239400 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.928+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55685e260820 con 0x55685e239400 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.928+0000 7f700acf4700 1 -- 172.21.15.155:0/3936466469 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e2f18c0 con 0x55685e239400 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.928+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55685e2609c0 con 0x55685e239400 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.929+0000 7f700acf4700 1 -- 172.21.15.155:0/3936466469 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55685efdadc0 con 0x55685e239400 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.929+0000 7f700acf4700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e5bac00 0x55685e521600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.929+0000 7f700acf4700 1 -- 172.21.15.155:0/3936466469 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55685e2b3340 con 0x55685e239400 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.929+0000 7f7011501700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e5bac00 0x55685e521600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.929+0000 7f7011501700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e5bac00 0x55685e521600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55685e51b890 tx=0x55685e329800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.929+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.929+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55685e239800 0x55685e521b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.929+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e239c00 con 0x55685e239800 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7012503700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55685e239800 0x55685e521b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7012503700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55685e239800 0x55685e521b80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7013d58a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7013d58a80 20 realm 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e5bb000 con 0x55685e239800 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7013d58a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7013d58a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.930+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e5bb400 con 0x55685e239800 2024-04-19T23:45:39.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7013d58a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e5bb800 con 0x55685e239800 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7013d58a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e5bbc00 con 0x55685e239800 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7013d58a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7013d58a80 20 searching for the correct realm 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55685e5bb000 0x55685e522100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e5bb400 con 0x55685e5bb000 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.931+0000 7f7011d02700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55685e5bb000 0x55685e522100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.932+0000 7f7011d02700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55685e5bb000 0x55685e522100 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.932+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.932+0000 7f7011d02700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55685e5bb400 0x55685e522c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.932+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684000 con 0x55685e5bb400 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.932+0000 7f7011501700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55685e5bb400 0x55685e522c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.932+0000 7f7011501700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55685e5bb400 0x55685e522c00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.933+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.933+0000 7f7011501700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55685e684000 0x55685e523180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.933+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e684000 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.933+0000 7f7012503700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55685e684000 0x55685e523180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.933+0000 7f7012503700 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55685e684000 0x55685e523180 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.933+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.933+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e239800 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.934+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.934+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e239800 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.934+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.934+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e684000 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.934+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.934+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e684000 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.934+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.934+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb400 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.935+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.935+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb000 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.935+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.935+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e239800 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.935+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.935+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e684000 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.935+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.935+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e239800 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.936+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.936+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb400 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.936+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.936+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb000 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.936+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.936+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb000 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.936+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.936+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e684000 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.937+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.937+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb000 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.937+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.937+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb000 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.937+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.937+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e239800 2024-04-19T23:45:39.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.937+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.937+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e239800 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.937+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.938+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e684000 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.938+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.938+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb000 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.938+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.938+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb400 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.938+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.938+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e239800 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.938+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.939+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e684000 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.939+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.939+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb000 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.939+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.939+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e684000 2024-04-19T23:45:39.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.939+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.939+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb400 2024-04-19T23:45:39.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.940+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.940+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb000 2024-04-19T23:45:39.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.940+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.940+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e684000 2024-04-19T23:45:39.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.940+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.940+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e239800 2024-04-19T23:45:39.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.940+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.940+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb400 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e239c00 con 0x55685e239800 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684c00 con 0x55685e239800 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:39.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685000 con 0x55685e5bb400 2024-04-19T23:45:39.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:39.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 zone default found 2024-04-19T23:45:39.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 4 Realm: () 2024-04-19T23:45:39.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:39.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:39.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:39.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 zonegroup default 2024-04-19T23:45:39.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.941+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685400 con 0x55685e684000 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7013d58a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685800 con 0x55685e5bb000 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7013d58a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685c00 con 0x55685e5bb000 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7013d58a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7013d58a80 20 started sync module instance, tier type = 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.942+0000 7f7013d58a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.943+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684c00 con 0x55685e5bb400 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.943+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.944+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93906747357952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e239c00 con 0x55685e5bb400 2024-04-19T23:45:39.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.944+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e5bb800 con 0x55685e239800 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.944+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93906747357952] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.945+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.945+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93906747359104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e5bbc00 con 0x55685e239800 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.945+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e5bb000 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.948+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93906747359104] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.948+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.948+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93906747360256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685000 con 0x55685e5bb000 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.948+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684c00 con 0x55685e5bb400 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.949+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.949+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93906747361408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684400 con 0x55685e5bb400 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.949+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685800 con 0x55685e239800 2024-04-19T23:45:39.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.950+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93906747360256] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.950+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93906747361408] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.953+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.953+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93906747362560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685c00 con 0x55685e239800 2024-04-19T23:45:39.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.953+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684800 con 0x55685e684000 2024-04-19T23:45:39.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.955+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.955+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93906747363712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685400 con 0x55685e684000 2024-04-19T23:45:39.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.955+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685800 con 0x55685e684000 2024-04-19T23:45:39.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.957+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93906747362560] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.960+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93906747363712] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.960+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.960+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93906747364864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685c00 con 0x55685e684000 2024-04-19T23:45:39.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.960+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e5bb800 con 0x55685e684000 2024-04-19T23:45:39.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.962+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93906747364864] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.965+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.965+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93906747366016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e5bbc00 con 0x55685e684000 2024-04-19T23:45:39.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.965+0000 7f7013d58a80 20 add_watcher() i=0 2024-04-19T23:45:39.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.965+0000 7f7013d58a80 20 add_watcher() i=1 2024-04-19T23:45:39.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.965+0000 7f7013d58a80 20 add_watcher() i=2 2024-04-19T23:45:39.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.965+0000 7f7013d58a80 20 add_watcher() i=3 2024-04-19T23:45:39.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.965+0000 7f7013d58a80 20 add_watcher() i=4 2024-04-19T23:45:39.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.965+0000 7f7013d58a80 20 add_watcher() i=5 2024-04-19T23:45:39.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.965+0000 7f7013d58a80 20 add_watcher() i=6 2024-04-19T23:45:39.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.966+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93906747366016] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.966+0000 7f7013d58a80 20 add_watcher() i=7 2024-04-19T23:45:39.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.966+0000 7f7013d58a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:39.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.966+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e5bb800 con 0x55685e239800 2024-04-19T23:45:39.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.966+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.966+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93906748907520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e5bbc00 con 0x55685e239800 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.967+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93906748907520] v30'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.967+0000 7f6ff8cd0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.968+0000 7f7013d58a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.968+0000 7f7013d58a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.968+0000 7f7013d58a80 1 Processor -- start 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.968+0000 7f7013d58a80 1 -- start start 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.968+0000 7f7013d58a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.968+0000 7f7013d58a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55685e274780 con 0x55685e685400 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.968+0000 7f7011501700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.968+0000 7f7011501700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35560/0 (socket says 172.21.15.155:35560) 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.968+0000 7f7011501700 1 -- 172.21.15.155:0/3331661785 learned_addr learned my addr 172.21.15.155:0/3331661785 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.969+0000 7f7011501700 1 -- 172.21.15.155:0/3331661785 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55685e260b60 con 0x55685e685400 2024-04-19T23:45:39.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.969+0000 7f7011501700 1 --2- 172.21.15.155:0/3331661785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x55685e60d6e0 tx=0x55685e57d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5947b037fde6fa5d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.969+0000 7f6ff84cf700 1 -- 172.21.15.155:0/3331661785 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e2f1760 con 0x55685e685400 2024-04-19T23:45:39.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.969+0000 7f6ff84cf700 1 -- 172.21.15.155:0/3331661785 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55685e6ae000 con 0x55685e685400 2024-04-19T23:45:39.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.969+0000 7f6ff84cf700 1 -- 172.21.15.155:0/3331661785 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e6b0000 con 0x55685e685400 2024-04-19T23:45:39.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.970+0000 7f7013d58a80 1 -- 172.21.15.155:0/3331661785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 msgr2=0x55685e522680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.970+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3331661785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x55685e60d6e0 tx=0x55685e57d6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.970+0000 7f7013d58a80 1 -- 172.21.15.155:0/3331661785 shutdown_connections 2024-04-19T23:45:39.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.970+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3331661785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.970+0000 7f7013d58a80 1 -- 172.21.15.155:0/3331661785 >> 172.21.15.155:0/3331661785 conn(0x55685e684800 msgr2=0x55685e326000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.970+0000 7f7013d58a80 1 -- 172.21.15.155:0/3331661785 shutdown_connections 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.970+0000 7f7013d58a80 1 -- 172.21.15.155:0/3331661785 wait complete. 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.970+0000 7f7013d58a80 1 Processor -- start 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.970+0000 7f7013d58a80 1 -- start start 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.970+0000 7f7013d58a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.970+0000 7f7013d58a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55685e2da000 con 0x55685e685400 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.971+0000 7f7011501700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.971+0000 7f7011501700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35568/0 (socket says 172.21.15.155:35568) 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.971+0000 7f7011501700 1 -- 172.21.15.155:0/3076357633 learned_addr learned my addr 172.21.15.155:0/3076357633 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.971+0000 7f7011501700 1 -- 172.21.15.155:0/3076357633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55685e260d00 con 0x55685e685400 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.971+0000 7f7011501700 1 --2- 172.21.15.155:0/3076357633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x55685e6a6210 tx=0x55685e57d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.971+0000 7f6ff6ccc700 1 -- 172.21.15.155:0/3076357633 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e6b0160 con 0x55685e685400 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.971+0000 7f6ff6ccc700 1 -- 172.21.15.155:0/3076357633 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55685e6ae180 con 0x55685e685400 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.971+0000 7f7013d58a80 1 -- 172.21.15.155:0/3076357633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55685e260340 con 0x55685e685400 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.971+0000 7f6ff6ccc700 1 -- 172.21.15.155:0/3076357633 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55685e6b02c0 con 0x55685e685400 2024-04-19T23:45:39.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.971+0000 7f7013d58a80 1 -- 172.21.15.155:0/3076357633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55685e261d40 con 0x55685e685400 2024-04-19T23:45:39.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.972+0000 7f6ff6ccc700 1 -- 172.21.15.155:0/3076357633 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55685efdbb80 con 0x55685e685400 2024-04-19T23:45:39.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.972+0000 7f6ff6ccc700 1 --2- 172.21.15.155:0/3076357633 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e728000 0x55685e523700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:39.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.972+0000 7f6ff6ccc700 1 -- 172.21.15.155:0/3076357633 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55685e2b3500 con 0x55685e685400 2024-04-19T23:45:39.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.972+0000 7f7013d58a80 5 note: GC not initialized 2024-04-19T23:45:39.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.972+0000 7f7012503700 1 --2- 172.21.15.155:0/3076357633 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e728000 0x55685e523700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:39.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.972+0000 7f7012503700 1 --2- 172.21.15.155:0/3076357633 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e728000 0x55685e523700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55685e60d710 tx=0x55685e57d5c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:39.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.973+0000 7f6ff44c7700 20 reqs_thread_entry: start 2024-04-19T23:45:39.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.973+0000 7f7013d58a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:39.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.973+0000 7f7013d58a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:39.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.973+0000 7f6ff24c3700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:10 2024 2024-04-19T23:45:39.978 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:39.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.973+0000 7f6ff1ca1700 20 reqs_thread_entry: start 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.973+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.973+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685c00 con 0x55685e5bb400 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.974+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.974+0000 7f7013d58a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.974+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.974+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e728400 con 0x55685e239800 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.974+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(63 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.974+0000 7f7013d58a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.974+0000 7f7013d58a80 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.974+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.974+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e728800 con 0x55685e5bb400 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.974+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:39.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e728c00 con 0x55685e239800 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 4.18 4:18bf188b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e729000 con 0x55685e5bb400 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 4.1e 4:78fbacd6:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e729400 con 0x55685e684000 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 4.3e 4:7f7048b3:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e729800 con 0x55685e5bb400 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 4.1b 4:d86c5742:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e729c00 con 0x55685e5bb400 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 4.34 4:2c84189a:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e728800 con 0x55685e5bb400 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 4.2d 4:b7b7c48d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e684c00 con 0x55685e684000 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:72 4.30 4:0e2208dd:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685c00 con 0x55685e5bb000 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 4.10 4:0a1e2427:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e239c00 con 0x55685e5bb000 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:74 4.3a 4:5cb7eb41:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e7aa000 con 0x55685e5bb000 2024-04-19T23:45:39.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 4.9 4:9256d036:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e7aa400 con 0x55685e239800 2024-04-19T23:45:39.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:76 4.0 4:034cf032:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e7aa800 con 0x55685e5bb000 2024-04-19T23:45:39.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(67 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(66 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(68 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(69 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(70 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(75 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(72 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.975+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(73 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.976+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(74 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.976+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(76 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.976+0000 7f6ff8cd0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:39.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.976+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93906748907520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e7aac00 con 0x55685e239800 2024-04-19T23:45:39.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.977+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93906748907520] v30'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.977+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93906747357952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e7ab000 con 0x55685e5bb400 2024-04-19T23:45:39.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.978+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93906747357952] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.978+0000 7f7013d58a80 20 remove_watcher() i=0 2024-04-19T23:45:39.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.978+0000 7f7013d58a80 2 removed watcher, disabling cache 2024-04-19T23:45:39.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.978+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93906747359104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e7ab400 con 0x55685e239800 2024-04-19T23:45:39.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.980+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93906747359104] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.980+0000 7f7013d58a80 20 remove_watcher() i=1 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.980+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93906747360256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e7ab800 con 0x55685e5bb000 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.981+0000 7f7011d02700 1 -- 172.21.15.155:0/3936466469 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93906747360256] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e675200 con 0x55685e5bb000 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.981+0000 7f7013d58a80 20 remove_watcher() i=2 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.981+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93906747361408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e7abc00 con 0x55685e5bb400 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.981+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93906747361408] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e675440 con 0x55685e5bb400 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.982+0000 7f7013d58a80 20 remove_watcher() i=3 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.982+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93906747362560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e7ab000 con 0x55685e239800 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.983+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93906747362560] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e239800 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.983+0000 7f7013d58a80 20 remove_watcher() i=4 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.983+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93906747363712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e7aa000 con 0x55685e684000 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.984+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93906747363712] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.984+0000 7f7013d58a80 20 remove_watcher() i=5 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.984+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93906747364864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685000 con 0x55685e684000 2024-04-19T23:45:39.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.985+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93906747364864] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.985+0000 7f7013d58a80 20 remove_watcher() i=6 2024-04-19T23:45:39.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.985+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93906747366016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55685e685c00 con 0x55685e684000 2024-04-19T23:45:39.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.985+0000 7f7012503700 1 -- 172.21.15.155:0/3936466469 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93906747366016] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55685e674b40 con 0x55685e684000 2024-04-19T23:45:39.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.985+0000 7f7013d58a80 20 remove_watcher() i=7 2024-04-19T23:45:39.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55685e684000 msgr2=0x55685e523180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55685e684000 0x55685e523180 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55685e239800 msgr2=0x55685e521b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55685e239800 0x55685e521b80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55685e5bb400 msgr2=0x55685e522c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55685e5bb400 0x55685e522c00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55685e5bb000 msgr2=0x55685e522100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55685e5bb000 0x55685e522100 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e5bac00 msgr2=0x55685e521600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e5bac00 0x55685e521600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55685e51b890 tx=0x55685e329800 comp rx=0 tx=0).stop 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 msgr2=0x55685e520b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3936466469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e239400 0x55685e520b00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55685f0abfb0 tx=0x55685e329f20 comp rx=0 tx=0).stop 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 reap_dead start 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7011501700 1 -- 172.21.15.155:0/3936466469 reap_dead start 2024-04-19T23:45:39.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 shutdown_connections 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 >> 172.21.15.155:0/3936466469 conn(0x55685e238c00 msgr2=0x55685e325800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 shutdown_connections 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3936466469 wait complete. 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3076357633 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e728000 msgr2=0x55685e523700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3076357633 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e728000 0x55685e523700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55685e60d710 tx=0x55685e57d5c0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3076357633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 msgr2=0x55685e522680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3076357633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x55685e6a6210 tx=0x55685e57d800 comp rx=0 tx=0).stop 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3076357633 shutdown_connections 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3076357633 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e728000 0x55685e523700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3076357633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e685400 0x55685e522680 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3076357633 >> 172.21.15.155:0/3076357633 conn(0x55685e684800 msgr2=0x55685e326000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3076357633 shutdown_connections 2024-04-19T23:45:39.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.986+0000 7f7013d58a80 1 -- 172.21.15.155:0/3076357633 wait complete. 2024-04-19T23:45:39.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.987+0000 7f7013d58a80 1 -- 172.21.15.155:0/3150857477 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e5ba000 msgr2=0x55685e521080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.987+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3150857477 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e5ba000 0x55685e521080 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55685f0aaab0 tx=0x55685e57c240 comp rx=0 tx=0).stop 2024-04-19T23:45:39.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.987+0000 7f7013d58a80 1 -- 172.21.15.155:0/3150857477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 msgr2=0x55685e520580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:39.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.987+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3150857477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55685e3a9aa0 tx=0x55685e329a40 comp rx=0 tx=0).stop 2024-04-19T23:45:39.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.987+0000 7f7013d58a80 1 -- 172.21.15.155:0/3150857477 shutdown_connections 2024-04-19T23:45:39.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.987+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3150857477 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55685e5ba000 0x55685e521080 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.987+0000 7f7013d58a80 1 --2- 172.21.15.155:0/3150857477 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55685e238800 0x55685e520580 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:39.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.987+0000 7f7013d58a80 1 -- 172.21.15.155:0/3150857477 >> 172.21.15.155:0/3150857477 conn(0x55685e238400 msgr2=0x55685e325000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:39.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.987+0000 7f7013d58a80 1 -- 172.21.15.155:0/3150857477 shutdown_connections 2024-04-19T23:45:39.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:39.987+0000 7f7013d58a80 1 -- 172.21.15.155:0/3150857477 wait complete. 2024-04-19T23:45:39.992 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:39.992 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo", 2024-04-19T23:45:39.992 INFO:teuthology.orchestra.run.smithi155.stdout: "num_shards": 11, 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "tenant": "", 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "zonegroup": "415e25ff-1f45-4d94-b7a7-66fe1b576744", 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_rule": "default-placement", 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "explicit_placement": { 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": "", 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "", 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": "" 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "marker": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "index_type": "Normal", 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "versioned": false, 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "versioning_enabled": false, 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "object_lock_enabled": false, 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_enabled": false, 2024-04-19T23:45:39.993 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1", 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2024-04-19T23:45:39.168535Z", 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "creation_time": "2024-04-19T23:45:39.164552Z", 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "usage": { 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "rgw.main": { 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 3, 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "size_actual": 4096, 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "size_utilized": 3, 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "size_kb": 1, 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "size_kb_actual": 4, 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "size_kb_utilized": 1, 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: "num_objects": 1 2024-04-19T23:45:39.994 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:39.995 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:39.995 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:39.995 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:39.995 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:39.995 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:39.995 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:39.995 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:39.995 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:39.995 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:39.995 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '415e25ff-1f45-4d94-b7a7-66fe1b576744', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'marker': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-19T23:45:39.168535Z', 'creation_time': '2024-04-19T23:45:39.164552Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-19T23:45:39.996 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-19T23:45:39.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-19T23:45:39.996 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-04-19T23:45:40.042 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:40.042 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:40.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.043+0000 7f19af52ea80 1 Processor -- start 2024-04-19T23:45:40.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.043+0000 7f19af52ea80 1 -- start start 2024-04-19T23:45:40.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.043+0000 7f19af52ea80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.043+0000 7f19af52ea80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559c17b5d500 con 0x559c17832c00 2024-04-19T23:45:40.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.043+0000 7f19af52ea80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x559c178d4a00 con 0x559c17832800 2024-04-19T23:45:40.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.043+0000 7f19ad4d8700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.043+0000 7f19accd7700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x559c17832c00 0x559c1791e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46708/0 (socket says 172.21.15.155:46708) 2024-04-19T23:45:40.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.043+0000 7f19ad4d8700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35570/0 (socket says 172.21.15.155:35570) 2024-04-19T23:45:40.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.043+0000 7f19accd7700 1 -- 172.21.15.155:0/1664747345 learned_addr learned my addr 172.21.15.155:0/1664747345 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:40.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.044+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1664747345 >> v1:172.21.15.76:6789/0 conn(0x559c17832c00 legacy=0x559c1791e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.044+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1664747345 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c1785bd40 con 0x559c17832800 2024-04-19T23:45:40.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.044+0000 7f19ac4d6700 1 -- 172.21.15.155:0/1664747345 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157952526 0 0) 0x559c18600000 con 0x559c17832c00 2024-04-19T23:45:40.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.044+0000 7f19ad4d8700 1 --2- 172.21.15.155:0/1664747345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x559c17b159e0 tx=0x559c17923920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997c2ec8e9d8ca15 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.044+0000 7f19ac4d6700 1 -- 172.21.15.155:0/1664747345 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c178eb4a0 con 0x559c17832800 2024-04-19T23:45:40.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.044+0000 7f19ac4d6700 1 -- 172.21.15.155:0/1664747345 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c17b5d800 con 0x559c17832800 2024-04-19T23:45:40.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.044+0000 7f19ac4d6700 1 -- 172.21.15.155:0/1664747345 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c178eb600 con 0x559c17832800 2024-04-19T23:45:40.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.045+0000 7f19af52ea80 1 -- 172.21.15.155:0/1664747345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 msgr2=0x559c17b1a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.045+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1664747345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x559c17b159e0 tx=0x559c17923920 comp rx=0 tx=0).stop 2024-04-19T23:45:40.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.045+0000 7f19af52ea80 1 -- 172.21.15.155:0/1664747345 shutdown_connections 2024-04-19T23:45:40.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.045+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1664747345 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.045+0000 7f19af52ea80 1 -- 172.21.15.155:0/1664747345 >> 172.21.15.155:0/1664747345 conn(0x559c17832400 msgr2=0x559c1791e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.045+0000 7f19af52ea80 1 -- 172.21.15.155:0/1664747345 shutdown_connections 2024-04-19T23:45:40.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.045+0000 7f19af52ea80 1 -- 172.21.15.155:0/1664747345 wait complete. 2024-04-19T23:45:40.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.045+0000 7f19af52ea80 1 Processor -- start 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.045+0000 7f19af52ea80 1 -- start start 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.046+0000 7f19af52ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.046+0000 7f19af52ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c178d4500 con 0x559c17832800 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.046+0000 7f19ad4d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.046+0000 7f19ad4d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35574/0 (socket says 172.21.15.155:35574) 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.046+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1557430676 learned_addr learned my addr 172.21.15.155:0/1557430676 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.046+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1557430676 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c1785bba0 con 0x559c17832800 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.046+0000 7f19ad4d8700 1 --2- 172.21.15.155:0/1557430676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x559c18603800 tx=0x559c17923800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4145172838d3731c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.046+0000 7f19abcd5700 1 -- 172.21.15.155:0/1557430676 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c178eb760 con 0x559c17832800 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.046+0000 7f19abcd5700 1 -- 172.21.15.155:0/1557430676 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c17b5db00 con 0x559c17832800 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.046+0000 7f19abcd5700 1 -- 172.21.15.155:0/1557430676 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c178eb4a0 con 0x559c17832800 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19af52ea80 1 -- 172.21.15.155:0/1557430676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 msgr2=0x559c17b1a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1557430676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x559c18603800 tx=0x559c17923800 comp rx=0 tx=0).stop 2024-04-19T23:45:40.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19af52ea80 1 -- 172.21.15.155:0/1557430676 shutdown_connections 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1557430676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19af52ea80 1 -- 172.21.15.155:0/1557430676 >> 172.21.15.155:0/1557430676 conn(0x559c17832400 msgr2=0x559c1791f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19af52ea80 1 -- 172.21.15.155:0/1557430676 shutdown_connections 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19af52ea80 1 -- 172.21.15.155:0/1557430676 wait complete. 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19af52ea80 1 Processor -- start 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19af52ea80 1 -- start start 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19af52ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19af52ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c178d43c0 con 0x559c17832800 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19ad4d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19ad4d8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35578/0 (socket says 172.21.15.155:35578) 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.047+0000 7f19ad4d8700 1 -- 172.21.15.155:0/3105628898 learned_addr learned my addr 172.21.15.155:0/3105628898 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.048+0000 7f19ad4d8700 1 -- 172.21.15.155:0/3105628898 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c1785ba00 con 0x559c17832800 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.048+0000 7f19ad4d8700 1 --2- 172.21.15.155:0/3105628898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x559c186039e0 tx=0x559c17923920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.048+0000 7f19aa4d2700 1 -- 172.21.15.155:0/3105628898 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c178eb600 con 0x559c17832800 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.048+0000 7f19af52ea80 1 -- 172.21.15.155:0/3105628898 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559c1785b860 con 0x559c17832800 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.048+0000 7f19aa4d2700 1 -- 172.21.15.155:0/3105628898 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c17b5dc80 con 0x559c17832800 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.048+0000 7f19aa4d2700 1 -- 172.21.15.155:0/3105628898 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c178eb8c0 con 0x559c17832800 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.048+0000 7f19af52ea80 1 -- 172.21.15.155:0/3105628898 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c1785b6c0 con 0x559c17832800 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.048+0000 7f19af52ea80 1 Processor -- start 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19af52ea80 1 -- start start 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19aa4d2700 1 -- 172.21.15.155:0/3105628898 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x559c185d4b00 con 0x559c17832800 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19af52ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 0x559c17b1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19af52ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c178d4000 con 0x559c17833400 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19aa4d2700 1 --2- 172.21.15.155:0/3105628898 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17bb0000 0x559c17b1b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19aa4d2700 1 -- 172.21.15.155:0/3105628898 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x559c178ad180 con 0x559c17832800 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19adcd9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 0x559c17b1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19ad4d8700 1 --2- 172.21.15.155:0/3105628898 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17bb0000 0x559c17b1b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19adcd9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 0x559c17b1ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35592/0 (socket says 172.21.15.155:35592) 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19adcd9700 1 -- 172.21.15.155:0/100187435 learned_addr learned my addr 172.21.15.155:0/100187435 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19adcd9700 1 -- 172.21.15.155:0/100187435 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c1785a000 con 0x559c17833400 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19ad4d8700 1 --2- 172.21.15.155:0/3105628898 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17bb0000 0x559c17b1b080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x559c186ab050 tx=0x559c17b76540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19adcd9700 1 --2- 172.21.15.155:0/100187435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 0x559c17b1ab00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x559c186aa390 tx=0x559c17b76720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d425b380a12922 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19a7ccd700 1 -- 172.21.15.155:0/100187435 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c178eb600 con 0x559c17833400 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19a7ccd700 1 -- 172.21.15.155:0/100187435 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c178d3c80 con 0x559c17833400 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.049+0000 7f19a7ccd700 1 -- 172.21.15.155:0/100187435 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c178eb8c0 con 0x559c17833400 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19af52ea80 1 -- 172.21.15.155:0/100187435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 msgr2=0x559c17b1ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19af52ea80 1 --2- 172.21.15.155:0/100187435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 0x559c17b1ab00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x559c186aa390 tx=0x559c17b76720 comp rx=0 tx=0).stop 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19af52ea80 1 -- 172.21.15.155:0/100187435 shutdown_connections 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19af52ea80 1 --2- 172.21.15.155:0/100187435 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 0x559c17b1ab00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19af52ea80 1 -- 172.21.15.155:0/100187435 >> 172.21.15.155:0/100187435 conn(0x559c17832c00 msgr2=0x559c1791f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19af52ea80 1 -- 172.21.15.155:0/100187435 shutdown_connections 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19af52ea80 1 -- 172.21.15.155:0/100187435 wait complete. 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19af52ea80 1 Processor -- start 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19af52ea80 1 -- start start 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19af52ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 0x559c17b1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19af52ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1786e640 con 0x559c17833400 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.050+0000 7f19adcd9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 0x559c17b1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.051+0000 7f19adcd9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 0x559c17b1ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35596/0 (socket says 172.21.15.155:35596) 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.051+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 learned_addr learned my addr 172.21.15.155:0/1699540904 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.051+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c1785aea0 con 0x559c17833400 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.051+0000 7f19adcd9700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 0x559c17b1ab00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x559c186abf20 tx=0x559c179238c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.051+0000 7f19a64ca700 1 -- 172.21.15.155:0/1699540904 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c178eb760 con 0x559c17833400 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.051+0000 7f19a64ca700 1 -- 172.21.15.155:0/1699540904 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c178d3b00 con 0x559c17833400 2024-04-19T23:45:40.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.051+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559c1785a820 con 0x559c17833400 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.051+0000 7f19a64ca700 1 -- 172.21.15.155:0/1699540904 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c178eb600 con 0x559c17833400 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.051+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c1785a9c0 con 0x559c17833400 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.052+0000 7f19a64ca700 1 -- 172.21.15.155:0/1699540904 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x559c185d4dc0 con 0x559c17833400 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.052+0000 7f19a64ca700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17bb0c00 0x559c17b1b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.052+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.052+0000 7f19a64ca700 1 -- 172.21.15.155:0/1699540904 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x559c178ad340 con 0x559c17833400 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.052+0000 7f19accd7700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17bb0c00 0x559c17b1b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.052+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559c17833800 0x559c17b1bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.052+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17833c00 con 0x559c17833800 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.052+0000 7f19adcd9700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559c17833800 0x559c17b1bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.052+0000 7f19accd7700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17bb0c00 0x559c17b1b600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x559c18602030 tx=0x559c17b77320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19adcd9700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559c17833800 0x559c17b1bb80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19af52ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19af52ea80 20 realm 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17bb1000 con 0x559c17833800 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19af52ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19af52ea80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17bb1400 con 0x559c17833800 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19af52ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17bb1800 con 0x559c17833800 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.053+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.054+0000 7f19af52ea80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.054+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.054+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17bb1c00 con 0x559c17833800 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.054+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.054+0000 7f19af52ea80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.054+0000 7f19af52ea80 20 searching for the correct realm 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.054+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x559c17bb1000 0x559c17b1c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.054+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17bb1400 con 0x559c17bb1000 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.054+0000 7f19ad4d8700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x559c17bb1000 0x559c17b1c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.054+0000 7f19ad4d8700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x559c17bb1000 0x559c17b1c100 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.055+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.055+0000 7f19ad4d8700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x559c17bb1400 0x559c17b1cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.055+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0000 con 0x559c17bb1400 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.055+0000 7f19accd7700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x559c17bb1400 0x559c17b1cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.055+0000 7f19accd7700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x559c17bb1400 0x559c17b1cc00 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.055+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.055+0000 7f19accd7700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x559c186d0000 0x559c17b1d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.055+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c186d0000 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.055+0000 7f19adcd9700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x559c186d0000 0x559c17b1d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.056+0000 7f19adcd9700 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x559c186d0000 0x559c17b1d180 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.056+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.056+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17833800 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.056+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.056+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17833800 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.056+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.056+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c186d0000 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.057+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.057+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c186d0000 2024-04-19T23:45:40.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.057+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.057+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1400 2024-04-19T23:45:40.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.057+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.057+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1000 2024-04-19T23:45:40.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.057+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.057+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17833800 2024-04-19T23:45:40.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.058+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.058+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c186d0000 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.058+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.058+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17833800 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.058+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.058+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1400 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.058+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.058+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1000 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.059+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.059+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1000 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.059+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.059+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c186d0000 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.059+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.059+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1000 2024-04-19T23:45:40.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.059+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.059+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1000 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.059+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.059+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17833800 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.060+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.060+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17833800 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.060+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.060+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c186d0000 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.060+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.060+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1000 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.060+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.060+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1400 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.061+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.061+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17833800 2024-04-19T23:45:40.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.061+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.061+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c186d0000 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.061+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.061+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1000 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.061+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.061+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c186d0000 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.062+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.062+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1400 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.062+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.062+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1000 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.062+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.062+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c186d0000 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.062+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.062+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17833800 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1400 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17833c00 con 0x559c17833800 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0c00 con 0x559c17833800 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.063+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d1000 con 0x559c17bb1400 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 20 zone default found 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 4 Realm: () 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 20 zonegroup default 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d1400 con 0x559c186d0000 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d1800 con 0x559c17bb1000 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d1c00 con 0x559c17bb1000 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.064+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.065+0000 7f19af52ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.065+0000 7f19af52ea80 20 started sync module instance, tier type = 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.065+0000 7f19af52ea80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.065+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0c00 con 0x559c17bb1400 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.066+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.066+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94128900741888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17833c00 con 0x559c17bb1400 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.066+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17bb1800 con 0x559c17833800 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.067+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94128900741888] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.067+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.067+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94128900743040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17bb1c00 con 0x559c17833800 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.067+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c17bb1000 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.068+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94128900743040] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.068+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.068+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94128900744192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d1000 con 0x559c17bb1000 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.068+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0c00 con 0x559c17bb1400 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.069+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94128900744192] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.069+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.069+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94128900745344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0400 con 0x559c17bb1400 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.069+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d1800 con 0x559c17833800 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.070+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.070+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94128900746496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d1c00 con 0x559c17833800 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.070+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0800 con 0x559c186d0000 2024-04-19T23:45:40.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.070+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94128900745344] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.071+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.071+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94128900747648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d1400 con 0x559c186d0000 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.071+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d1800 con 0x559c186d0000 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.071+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94128900746496] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.072+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94128900747648] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.072+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.072+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94128900748800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d1c00 con 0x559c186d0000 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.072+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17bb1800 con 0x559c186d0000 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.073+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94128900748800] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.073+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.073+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94128900749952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17bb1c00 con 0x559c186d0000 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.073+0000 7f19af52ea80 20 add_watcher() i=0 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.073+0000 7f19af52ea80 20 add_watcher() i=1 2024-04-19T23:45:40.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.073+0000 7f19af52ea80 20 add_watcher() i=2 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.073+0000 7f19af52ea80 20 add_watcher() i=3 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.073+0000 7f19af52ea80 20 add_watcher() i=4 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.073+0000 7f19af52ea80 20 add_watcher() i=5 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.073+0000 7f19af52ea80 20 add_watcher() i=6 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.074+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94128900749952] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.074+0000 7f19af52ea80 20 add_watcher() i=7 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.074+0000 7f19af52ea80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.074+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17bb1800 con 0x559c17833800 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.074+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.074+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94128902258688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17bb1c00 con 0x559c17833800 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.075+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94128902258688] v30'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.075+0000 7f19944a6700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.076+0000 7f19af52ea80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:40.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.076+0000 7f19af52ea80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.076+0000 7f19af52ea80 1 Processor -- start 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.076+0000 7f19af52ea80 1 -- start start 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.076+0000 7f19af52ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.076+0000 7f19af52ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1786e780 con 0x559c186d1400 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.076+0000 7f19accd7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.076+0000 7f19accd7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35608/0 (socket says 172.21.15.155:35608) 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.076+0000 7f19accd7700 1 -- 172.21.15.155:0/488608857 learned_addr learned my addr 172.21.15.155:0/488608857 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.076+0000 7f19accd7700 1 -- 172.21.15.155:0/488608857 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c1785ab60 con 0x559c186d1400 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.077+0000 7f19accd7700 1 --2- 172.21.15.155:0/488608857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x559c17c886c0 tx=0x559c17b77680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf07549df86e20cf server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.077+0000 7f1993ca5700 1 -- 172.21.15.155:0/488608857 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c17c9c000 con 0x559c186d1400 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.077+0000 7f1993ca5700 1 -- 172.21.15.155:0/488608857 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c17ca4000 con 0x559c186d1400 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.077+0000 7f1993ca5700 1 -- 172.21.15.155:0/488608857 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c17c9c160 con 0x559c186d1400 2024-04-19T23:45:40.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.077+0000 7f19af52ea80 1 -- 172.21.15.155:0/488608857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 msgr2=0x559c17b1c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.077+0000 7f19af52ea80 1 --2- 172.21.15.155:0/488608857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x559c17c886c0 tx=0x559c17b77680 comp rx=0 tx=0).stop 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.077+0000 7f19af52ea80 1 -- 172.21.15.155:0/488608857 shutdown_connections 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.077+0000 7f19af52ea80 1 --2- 172.21.15.155:0/488608857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.077+0000 7f19af52ea80 1 -- 172.21.15.155:0/488608857 >> 172.21.15.155:0/488608857 conn(0x559c186d0800 msgr2=0x559c17920000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.077+0000 7f19af52ea80 1 -- 172.21.15.155:0/488608857 shutdown_connections 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.077+0000 7f19af52ea80 1 -- 172.21.15.155:0/488608857 wait complete. 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.078+0000 7f19af52ea80 1 Processor -- start 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.078+0000 7f19af52ea80 1 -- start start 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.078+0000 7f19af52ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.078+0000 7f19af52ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c178d4000 con 0x559c186d1400 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.078+0000 7f19accd7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.078+0000 7f19accd7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35620/0 (socket says 172.21.15.155:35620) 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.078+0000 7f19accd7700 1 -- 172.21.15.155:0/2667942215 learned_addr learned my addr 172.21.15.155:0/2667942215 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.078+0000 7f19accd7700 1 -- 172.21.15.155:0/2667942215 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c1785ad00 con 0x559c186d1400 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.079+0000 7f19accd7700 1 --2- 172.21.15.155:0/2667942215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x559c17c888d0 tx=0x559c17b777a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.079+0000 7f19924a2700 1 -- 172.21.15.155:0/2667942215 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c17c9c2c0 con 0x559c186d1400 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.079+0000 7f19924a2700 1 -- 172.21.15.155:0/2667942215 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c17ca4180 con 0x559c186d1400 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.079+0000 7f19af52ea80 1 -- 172.21.15.155:0/2667942215 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559c1785a340 con 0x559c186d1400 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.079+0000 7f19924a2700 1 -- 172.21.15.155:0/2667942215 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559c17c9c000 con 0x559c186d1400 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.079+0000 7f19af52ea80 1 -- 172.21.15.155:0/2667942215 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c1785ab60 con 0x559c186d1400 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.079+0000 7f19924a2700 1 -- 172.21.15.155:0/2667942215 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x559c185d5b80 con 0x559c186d1400 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.080+0000 7f19924a2700 1 --2- 172.21.15.155:0/2667942215 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17d20000 0x559c17b1d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.080+0000 7f19924a2700 1 -- 172.21.15.155:0/2667942215 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x559c178ad500 con 0x559c186d1400 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.080+0000 7f19af52ea80 5 note: GC not initialized 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.080+0000 7f19adcd9700 1 --2- 172.21.15.155:0/2667942215 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17d20000 0x559c17b1d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.080+0000 7f19adcd9700 1 --2- 172.21.15.155:0/2667942215 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17d20000 0x559c17b1d700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x559c17c19aa0 tx=0x559c17b774a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.081+0000 7f198fc9d700 20 reqs_thread_entry: start 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.081+0000 7f19af52ea80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:40.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.081+0000 7f19af52ea80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:40.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.081+0000 7f198dc99700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:10 2024 2024-04-19T23:45:40.094 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:40.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.081+0000 7f198d477700 20 reqs_thread_entry: start 2024-04-19T23:45:40.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.081+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.081+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d1c00 con 0x559c17833800 2024-04-19T23:45:40.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.081+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.081+0000 7f19af52ea80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:40.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.081+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d20400 con 0x559c17bb1400 2024-04-19T23:45:40.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d20800 con 0x559c17833800 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 4.18 4:18bf188b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d20c00 con 0x559c17bb1400 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:66 4.1e 4:78fbacd6:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d21000 con 0x559c186d0000 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 4.3e 4:7f7048b3:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d21400 con 0x559c17bb1400 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 4.1b 4:d86c5742:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d21800 con 0x559c17bb1400 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 4.34 4:2c84189a:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d21c00 con 0x559c17bb1400 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 4.2d 4:b7b7c48d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d20400 con 0x559c186d0000 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:71 4.30 4:0e2208dd:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d20c00 con 0x559c17bb1000 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:72 4.10 4:0a1e2427:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c186d0c00 con 0x559c17bb1000 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 4.3a 4:5cb7eb41:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17833c00 con 0x559c17bb1000 2024-04-19T23:45:40.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:74 4.9 4:9256d036:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17c94000 con 0x559c17833800 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.082+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:75 4.0 4:034cf032:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17c94400 con 0x559c17bb1000 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(67 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(68 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(69 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(74 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(66 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(73 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(71 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(72 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(75 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.083+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17c94800 con 0x559c17bb1400 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.084+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(76 foo.buckets [call] v30'15 uv15 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.085+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17c94c00 con 0x559c17bb1400 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.085+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(77 foo.buckets [call] v30'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.086+0000 7f19af52ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.086+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17c95000 con 0x559c17833800 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.086+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(78 foo [stat out=16b,read 0~357 out=357b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+373 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.086+0000 7f19af52ea80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.086+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17c95400 con 0x559c17bb1400 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.086+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.087+0000 7f19944a6700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.087+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94128902258688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17c95800 con 0x559c17833800 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.088+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94128902258688] v30'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.088+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94128900741888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17c95c00 con 0x559c17bb1400 2024-04-19T23:45:40.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.089+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 20 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94128900741888] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.089+0000 7f19af52ea80 20 remove_watcher() i=0 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.089+0000 7f19af52ea80 2 removed watcher, disabling cache 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.089+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94128900743040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17c94800 con 0x559c17833800 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.090+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94128900743040] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.090+0000 7f19af52ea80 20 remove_watcher() i=1 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.090+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94128900744192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17c94c00 con 0x559c17bb1000 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.091+0000 7f19ad4d8700 1 -- 172.21.15.155:0/1699540904 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94128900744192] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6f200 con 0x559c17bb1000 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.091+0000 7f19af52ea80 20 remove_watcher() i=2 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.091+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94128900745344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d21400 con 0x559c17bb1400 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.092+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 <== osd.2 v2:172.21.15.155:6812/41834 21 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94128900745344] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6f440 con 0x559c17bb1400 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.092+0000 7f19af52ea80 20 remove_watcher() i=3 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.092+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94128900746496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d21800 con 0x559c17833800 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.099+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94128900746496] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c17833800 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.099+0000 7f19af52ea80 20 remove_watcher() i=4 2024-04-19T23:45:40.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.099+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94128900747648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d21c00 con 0x559c186d0000 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.100+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94128900747648] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.100+0000 7f19af52ea80 20 remove_watcher() i=5 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.100+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94128900748800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d20c00 con 0x559c186d0000 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.101+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94128900748800] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.101+0000 7f19af52ea80 20 remove_watcher() i=6 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.101+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94128900749952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559c17d20800 con 0x559c186d0000 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19adcd9700 1 -- 172.21.15.155:0/1699540904 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94128900749952] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559c17c6eb40 con 0x559c186d0000 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 20 remove_watcher() i=7 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x559c186d0000 msgr2=0x559c17b1d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x559c186d0000 0x559c17b1d180 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559c17833800 msgr2=0x559c17b1bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559c17833800 0x559c17b1bb80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x559c17bb1400 msgr2=0x559c17b1cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x559c17bb1400 0x559c17b1cc00 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x559c17bb1000 msgr2=0x559c17b1c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x559c17bb1000 0x559c17b1c100 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17bb0c00 msgr2=0x559c17b1b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17bb0c00 0x559c17b1b600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x559c18602030 tx=0x559c17b77320 comp rx=0 tx=0).stop 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 msgr2=0x559c17b1ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 --2- 172.21.15.155:0/1699540904 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17833400 0x559c17b1ab00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x559c186abf20 tx=0x559c179238c0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 reap_dead start 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19accd7700 1 -- 172.21.15.155:0/1699540904 reap_dead start 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 shutdown_connections 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.102+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 >> 172.21.15.155:0/1699540904 conn(0x559c17832c00 msgr2=0x559c1791f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 shutdown_connections 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/1699540904 wait complete. 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/2667942215 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17d20000 msgr2=0x559c17b1d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 --2- 172.21.15.155:0/2667942215 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17d20000 0x559c17b1d700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x559c17c19aa0 tx=0x559c17b774a0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/2667942215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 msgr2=0x559c17b1c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 --2- 172.21.15.155:0/2667942215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x559c17c888d0 tx=0x559c17b777a0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/2667942215 shutdown_connections 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 --2- 172.21.15.155:0/2667942215 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17d20000 0x559c17b1d700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 --2- 172.21.15.155:0/2667942215 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c186d1400 0x559c17b1c680 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/2667942215 >> 172.21.15.155:0/2667942215 conn(0x559c186d0800 msgr2=0x559c17920000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/2667942215 shutdown_connections 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/2667942215 wait complete. 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/3105628898 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17bb0000 msgr2=0x559c17b1b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 --2- 172.21.15.155:0/3105628898 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17bb0000 0x559c17b1b080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x559c186ab050 tx=0x559c17b76540 comp rx=0 tx=0).stop 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/3105628898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 msgr2=0x559c17b1a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 --2- 172.21.15.155:0/3105628898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x559c186039e0 tx=0x559c17923920 comp rx=0 tx=0).stop 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/3105628898 shutdown_connections 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 --2- 172.21.15.155:0/3105628898 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559c17bb0000 0x559c17b1b080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 --2- 172.21.15.155:0/3105628898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559c17832800 0x559c17b1a580 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/3105628898 >> 172.21.15.155:0/3105628898 conn(0x559c17832400 msgr2=0x559c1791f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/3105628898 shutdown_connections 2024-04-19T23:45:40.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.103+0000 7f19af52ea80 1 -- 172.21.15.155:0/3105628898 wait complete. 2024-04-19T23:45:40.112 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:40.113 INFO:teuthology.orchestra.run.smithi155.stdout: "stats": { 2024-04-19T23:45:40.113 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 3, 2024-04-19T23:45:40.113 INFO:teuthology.orchestra.run.smithi155.stdout: "size_actual": 4096, 2024-04-19T23:45:40.113 INFO:teuthology.orchestra.run.smithi155.stdout: "size_kb": 1, 2024-04-19T23:45:40.113 INFO:teuthology.orchestra.run.smithi155.stdout: "size_kb_actual": 4, 2024-04-19T23:45:40.113 INFO:teuthology.orchestra.run.smithi155.stdout: "num_objects": 1 2024-04-19T23:45:40.113 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:40.113 INFO:teuthology.orchestra.run.smithi155.stdout: "last_stats_sync": "2024-04-19T23:45:40.086069Z", 2024-04-19T23:45:40.113 INFO:teuthology.orchestra.run.smithi155.stdout: "last_stats_update": "2024-04-19T23:45:40.084997Z" 2024-04-19T23:45:40.113 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:40.113 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-04-19T23:45:40.086069Z', 'last_stats_update': '2024-04-19T23:45:40.084997Z'} 2024-04-19T23:45:40.118 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:40.118 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-19T23:45:40.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-19T23:45:40.118 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-04-19T23:45:40.165 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:40.165 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:40.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.166+0000 7f166c933a80 1 Processor -- start 2024-04-19T23:45:40.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.166+0000 7f166c933a80 1 -- start start 2024-04-19T23:45:40.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.166+0000 7f166c933a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5569c8d9e800 0x5569c9086580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.166+0000 7f166c933a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5569c90c9500 con 0x5569c8d9ec00 2024-04-19T23:45:40.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.166+0000 7f166c933a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5569c8e40a00 con 0x5569c8d9e800 2024-04-19T23:45:40.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.166+0000 7f166a8dd700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5569c8d9e800 0x5569c9086580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.166+0000 7f166a0dc700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5569c8d9ec00 0x5569c8e8a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46722/0 (socket says 172.21.15.155:46722) 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.166+0000 7f166a0dc700 1 -- 172.21.15.155:0/2828774362 learned_addr learned my addr 172.21.15.155:0/2828774362 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.166+0000 7f166a8dd700 1 -- 172.21.15.155:0/2828774362 >> v1:172.21.15.76:6789/0 conn(0x5569c8d9ec00 legacy=0x5569c8e8a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.166+0000 7f166a8dd700 1 -- 172.21.15.155:0/2828774362 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569c8dc7d40 con 0x5569c8d9e800 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.167+0000 7f166a8dd700 1 --2- 172.21.15.155:0/2828774362 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x5569c90819e0 tx=0x5569c8e8f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5938466096491b82 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.167+0000 7f16698db700 1 -- 172.21.15.155:0/2828774362 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c8e574a0 con 0x5569c8d9e800 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.167+0000 7f16698db700 1 -- 172.21.15.155:0/2828774362 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569c90c9800 con 0x5569c8d9e800 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.167+0000 7f16698db700 1 -- 172.21.15.155:0/2828774362 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c8e57600 con 0x5569c8d9e800 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.167+0000 7f166c933a80 1 -- 172.21.15.155:0/2828774362 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 msgr2=0x5569c9086580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.167+0000 7f166c933a80 1 --2- 172.21.15.155:0/2828774362 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x5569c90819e0 tx=0x5569c8e8f920 comp rx=0 tx=0).stop 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.167+0000 7f166c933a80 1 -- 172.21.15.155:0/2828774362 shutdown_connections 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.167+0000 7f166c933a80 1 --2- 172.21.15.155:0/2828774362 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.167+0000 7f166c933a80 1 -- 172.21.15.155:0/2828774362 >> 172.21.15.155:0/2828774362 conn(0x5569c8d9e400 msgr2=0x5569c8e8a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.167+0000 7f166c933a80 1 -- 172.21.15.155:0/2828774362 shutdown_connections 2024-04-19T23:45:40.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.167+0000 7f166c933a80 1 -- 172.21.15.155:0/2828774362 wait complete. 2024-04-19T23:45:40.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.168+0000 7f166c933a80 1 Processor -- start 2024-04-19T23:45:40.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.168+0000 7f166c933a80 1 -- start start 2024-04-19T23:45:40.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.168+0000 7f166c933a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.168+0000 7f166c933a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c8e40500 con 0x5569c8d9e800 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.168+0000 7f166a8dd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.168+0000 7f166a8dd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35640/0 (socket says 172.21.15.155:35640) 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.168+0000 7f166a8dd700 1 -- 172.21.15.155:0/1894037040 learned_addr learned my addr 172.21.15.155:0/1894037040 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.168+0000 7f166a8dd700 1 -- 172.21.15.155:0/1894037040 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569c8dc7ba0 con 0x5569c8d9e800 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.168+0000 7f166a8dd700 1 --2- 172.21.15.155:0/1894037040 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x5569c9b77740 tx=0x5569c8e8f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbef477644e4072 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f16690da700 1 -- 172.21.15.155:0/1894037040 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c8e57760 con 0x5569c8d9e800 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f16690da700 1 -- 172.21.15.155:0/1894037040 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569c90c9b00 con 0x5569c8d9e800 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f16690da700 1 -- 172.21.15.155:0/1894037040 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c8e574a0 con 0x5569c8d9e800 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f166c933a80 1 -- 172.21.15.155:0/1894037040 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 msgr2=0x5569c9086580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f166c933a80 1 --2- 172.21.15.155:0/1894037040 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x5569c9b77740 tx=0x5569c8e8f800 comp rx=0 tx=0).stop 2024-04-19T23:45:40.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f166c933a80 1 -- 172.21.15.155:0/1894037040 shutdown_connections 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f166c933a80 1 --2- 172.21.15.155:0/1894037040 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f166c933a80 1 -- 172.21.15.155:0/1894037040 >> 172.21.15.155:0/1894037040 conn(0x5569c8d9e400 msgr2=0x5569c8e8b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f166c933a80 1 -- 172.21.15.155:0/1894037040 shutdown_connections 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f166c933a80 1 -- 172.21.15.155:0/1894037040 wait complete. 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f166c933a80 1 Processor -- start 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f166c933a80 1 -- start start 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f166c933a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.169+0000 7f166c933a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c8e403c0 con 0x5569c8d9e800 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.170+0000 7f166a8dd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.170+0000 7f166a8dd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35642/0 (socket says 172.21.15.155:35642) 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.170+0000 7f166a8dd700 1 -- 172.21.15.155:0/697706923 learned_addr learned my addr 172.21.15.155:0/697706923 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.170+0000 7f166a8dd700 1 -- 172.21.15.155:0/697706923 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569c8dc7a00 con 0x5569c8d9e800 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.170+0000 7f166a8dd700 1 --2- 172.21.15.155:0/697706923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x5569c9b775f0 tx=0x5569c8e8f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.170+0000 7f16678d7700 1 -- 172.21.15.155:0/697706923 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c8e57600 con 0x5569c8d9e800 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.170+0000 7f16678d7700 1 -- 172.21.15.155:0/697706923 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569c90c9c80 con 0x5569c8d9e800 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.170+0000 7f166c933a80 1 -- 172.21.15.155:0/697706923 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5569c8dc7860 con 0x5569c8d9e800 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.170+0000 7f16678d7700 1 -- 172.21.15.155:0/697706923 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c8e578c0 con 0x5569c8d9e800 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.170+0000 7f166c933a80 1 -- 172.21.15.155:0/697706923 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569c8dc76c0 con 0x5569c8d9e800 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f166c933a80 1 Processor -- start 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f16678d7700 1 -- 172.21.15.155:0/697706923 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5569c9b40b00 con 0x5569c8d9e800 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f166c933a80 1 -- start start 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f16678d7700 1 --2- 172.21.15.155:0/697706923 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c8d9f400 0x5569c9087080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f16678d7700 1 -- 172.21.15.155:0/697706923 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5569c8e19180 con 0x5569c8d9e800 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f166c933a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 0x5569c9086b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f166c933a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c8dda640 con 0x5569c8d9f800 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f166b0de700 1 --2- 172.21.15.155:0/697706923 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c8d9f400 0x5569c9087080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f166a8dd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 0x5569c9086b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f166a8dd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 0x5569c9086b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35658/0 (socket says 172.21.15.155:35658) 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f166a8dd700 1 -- 172.21.15.155:0/1803692134 learned_addr learned my addr 172.21.15.155:0/1803692134 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f166a8dd700 1 -- 172.21.15.155:0/1803692134 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569c8dc6000 con 0x5569c8d9f800 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.171+0000 7f166b0de700 1 --2- 172.21.15.155:0/697706923 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c8d9f400 0x5569c9087080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5569c911c030 tx=0x5569c90e2540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f166a8dd700 1 --2- 172.21.15.155:0/1803692134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 0x5569c9086b00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x5569c9c26f90 tx=0x5569c90e24e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed215ced1e35e8e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f16650d2700 1 -- 172.21.15.155:0/1803692134 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c8e57600 con 0x5569c8d9f800 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f16650d2700 1 -- 172.21.15.155:0/1803692134 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569c90c9c80 con 0x5569c8d9f800 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f16650d2700 1 -- 172.21.15.155:0/1803692134 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c8e578c0 con 0x5569c8d9f800 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f166c933a80 1 -- 172.21.15.155:0/1803692134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 msgr2=0x5569c9086b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f166c933a80 1 --2- 172.21.15.155:0/1803692134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 0x5569c9086b00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x5569c9c26f90 tx=0x5569c90e24e0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f166c933a80 1 -- 172.21.15.155:0/1803692134 shutdown_connections 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f166c933a80 1 --2- 172.21.15.155:0/1803692134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 0x5569c9086b00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f166c933a80 1 -- 172.21.15.155:0/1803692134 >> 172.21.15.155:0/1803692134 conn(0x5569c8d9ec00 msgr2=0x5569c8e8b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f166c933a80 1 -- 172.21.15.155:0/1803692134 shutdown_connections 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f166c933a80 1 -- 172.21.15.155:0/1803692134 wait complete. 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.172+0000 7f166c933a80 1 Processor -- start 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f166c933a80 1 -- start start 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f166c933a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 0x5569c9086b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f166c933a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c8dda8c0 con 0x5569c8d9f800 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f166a8dd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 0x5569c9086b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f166a8dd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 0x5569c9086b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35670/0 (socket says 172.21.15.155:35670) 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 learned_addr learned my addr 172.21.15.155:0/2967245983 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569c8dc6ea0 con 0x5569c8d9f800 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f166a8dd700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 0x5569c9086b00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5569c911ca80 tx=0x5569c90e2720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f16638cf700 1 -- 172.21.15.155:0/2967245983 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c8e57760 con 0x5569c8d9f800 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f16638cf700 1 -- 172.21.15.155:0/2967245983 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569c8e3fe00 con 0x5569c8d9f800 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5569c8dc6820 con 0x5569c8d9f800 2024-04-19T23:45:40.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f16638cf700 1 -- 172.21.15.155:0/2967245983 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c8e574a0 con 0x5569c8d9f800 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.173+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569c8dc69c0 con 0x5569c8d9f800 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.174+0000 7f16638cf700 1 -- 172.21.15.155:0/2967245983 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5569c9b40dc0 con 0x5569c8d9f800 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.174+0000 7f16638cf700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c913cc00 0x5569c9087600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.174+0000 7f16638cf700 1 -- 172.21.15.155:0/2967245983 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5569c8e19340 con 0x5569c8d9f800 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.174+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.174+0000 7f166a0dc700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c913cc00 0x5569c9087600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.174+0000 7f166c933a80 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5569c8d9fc00 0x5569c9087b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.174+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913d000 con 0x5569c8d9fc00 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166b0de700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5569c8d9fc00 0x5569c9087b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166a0dc700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c913cc00 0x5569c9087600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x5569c9c26510 tx=0x5569c90e26c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166b0de700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5569c8d9fc00 0x5569c9087b80 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166c933a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166c933a80 20 realm 2024-04-19T23:45:40.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913d400 con 0x5569c8d9fc00 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166c933a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166c933a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.175+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913d800 con 0x5569c8d9fc00 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166c933a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913dc00 con 0x5569c8d9fc00 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166c933a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913d000 con 0x5569c8d9fc00 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166c933a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166c933a80 20 searching for the correct realm 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166c933a80 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5569c913d400 0x5569c9088100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913d800 con 0x5569c913d400 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.176+0000 7f166a8dd700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5569c913d400 0x5569c9088100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.177+0000 7f166a8dd700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5569c913d400 0x5569c9088100 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.177+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.177+0000 7f166a8dd700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5569c913d800 0x5569c9088c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.177+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913c400 con 0x5569c913d800 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.177+0000 7f166a0dc700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5569c913d800 0x5569c9088c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.177+0000 7f166a0dc700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5569c913d800 0x5569c9088c00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.178+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.178+0000 7f166a0dc700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5569c913c400 0x5569c9089180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.178+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913c400 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.178+0000 7f166b0de700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5569c913c400 0x5569c9089180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.178+0000 7f166b0de700 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5569c913c400 0x5569c9089180 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.178+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.178+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c8d9fc00 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.179+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.179+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c8d9fc00 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.179+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.179+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913c400 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.179+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.179+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913c400 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.179+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.179+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d800 2024-04-19T23:45:40.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.180+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.180+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d400 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.180+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.180+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c8d9fc00 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.180+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.180+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913c400 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.180+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.180+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c8d9fc00 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.180+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.180+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d800 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.181+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.181+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d400 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.181+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.181+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d400 2024-04-19T23:45:40.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.181+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.181+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913c400 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.181+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.181+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d400 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.182+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.182+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d400 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.182+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.182+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c8d9fc00 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.182+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.182+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c8d9fc00 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.182+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.182+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913c400 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.182+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.182+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d400 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.183+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.183+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d800 2024-04-19T23:45:40.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.183+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.183+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c8d9fc00 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.183+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.183+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913c400 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.183+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.183+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d400 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.184+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.184+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913c400 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.184+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.184+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d800 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.184+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.184+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d400 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.184+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.184+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913c400 2024-04-19T23:45:40.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c8d9fc00 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d800 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166c933a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166c933a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166c933a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166c933a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913dc00 con 0x5569c8d9fc00 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166c933a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.185+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913d000 con 0x5569c8d9fc00 2024-04-19T23:45:40.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4400 con 0x5569c913d800 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 20 zone default found 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 4 Realm: () 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 20 zonegroup default 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4800 con 0x5569c913c400 2024-04-19T23:45:40.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.186+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4c00 con 0x5569c913d400 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.187+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.187+0000 7f166c933a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.187+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.187+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d5000 con 0x5569c913d400 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.187+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.187+0000 7f166c933a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.187+0000 7f166c933a80 20 started sync module instance, tier type = 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.187+0000 7f166c933a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.187+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d5400 con 0x5569c913d800 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.188+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.188+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93912832662272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d5800 con 0x5569c913d800 2024-04-19T23:45:40.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.188+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d5c00 con 0x5569c8d9fc00 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.189+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93912832662272] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.189+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.189+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93912832663424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4800 con 0x5569c8d9fc00 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.189+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d5c00 con 0x5569c913d400 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.190+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.190+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93912832664576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913d400 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.190+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4400 con 0x5569c913d800 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.190+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93912832663424] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.191+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93912832664576] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.191+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.191+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93912832665728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d5400 con 0x5569c913d800 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.191+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913dc00 con 0x5569c8d9fc00 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.192+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93912832665728] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.193+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.193+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93912832666880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913d000 con 0x5569c8d9fc00 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.193+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4c00 con 0x5569c913c400 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.194+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.194+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93912832668032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d5000 con 0x5569c913c400 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.194+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d5c00 con 0x5569c913c400 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.194+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93912832666880] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.195+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93912832668032] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.195+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.195+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93912832669184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c913c400 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.195+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4800 con 0x5569c913c400 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.196+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.196+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93912832670336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4c00 con 0x5569c913c400 2024-04-19T23:45:40.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.196+0000 7f166c933a80 20 add_watcher() i=0 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.196+0000 7f166c933a80 20 add_watcher() i=1 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.196+0000 7f166c933a80 20 add_watcher() i=2 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.196+0000 7f166c933a80 20 add_watcher() i=3 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.196+0000 7f166c933a80 20 add_watcher() i=4 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.196+0000 7f166c933a80 20 add_watcher() i=5 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.196+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93912832669184] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.196+0000 7f166c933a80 20 add_watcher() i=6 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.197+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93912832670336] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.197+0000 7f166c933a80 20 add_watcher() i=7 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.197+0000 7f166c933a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.197+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d5000 con 0x5569c8d9fc00 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.197+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.197+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93912834072576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c913dc00 con 0x5569c8d9fc00 2024-04-19T23:45:40.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.198+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93912834072576] v30'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.198+0000 7f16518ab700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.198+0000 7f166c933a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.198+0000 7f166c933a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.198+0000 7f166c933a80 1 Processor -- start 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.198+0000 7f166c933a80 1 -- start start 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.198+0000 7f166c933a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.198+0000 7f166c933a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c8e403c0 con 0x5569c913dc00 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.199+0000 7f166a0dc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.199+0000 7f166a0dc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35676/0 (socket says 172.21.15.155:35676) 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.199+0000 7f166a0dc700 1 -- 172.21.15.155:0/1465771952 learned_addr learned my addr 172.21.15.155:0/1465771952 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.199+0000 7f166a0dc700 1 -- 172.21.15.155:0/1465771952 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569c8dc6b60 con 0x5569c913dc00 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.199+0000 7f166a0dc700 1 --2- 172.21.15.155:0/1465771952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x5569c91de0c0 tx=0x5569c90e3500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53087e0658f31d26 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.199+0000 7f16510aa700 1 -- 172.21.15.155:0/1465771952 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c91d4160 con 0x5569c913dc00 2024-04-19T23:45:40.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.199+0000 7f16510aa700 1 -- 172.21.15.155:0/1465771952 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569c91e6000 con 0x5569c913dc00 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.199+0000 7f16510aa700 1 -- 172.21.15.155:0/1465771952 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c91d42c0 con 0x5569c913dc00 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.200+0000 7f166c933a80 1 -- 172.21.15.155:0/1465771952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 msgr2=0x5569c9088680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.200+0000 7f166c933a80 1 --2- 172.21.15.155:0/1465771952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x5569c91de0c0 tx=0x5569c90e3500 comp rx=0 tx=0).stop 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.200+0000 7f166c933a80 1 -- 172.21.15.155:0/1465771952 shutdown_connections 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.200+0000 7f166c933a80 1 --2- 172.21.15.155:0/1465771952 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.200+0000 7f166c933a80 1 -- 172.21.15.155:0/1465771952 >> 172.21.15.155:0/1465771952 conn(0x5569c913d000 msgr2=0x5569c8e8c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.200+0000 7f166c933a80 1 -- 172.21.15.155:0/1465771952 shutdown_connections 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.200+0000 7f166c933a80 1 -- 172.21.15.155:0/1465771952 wait complete. 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.200+0000 7f166c933a80 1 Processor -- start 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.200+0000 7f166c933a80 1 -- start start 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f166c933a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f166c933a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569c8e40500 con 0x5569c913dc00 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f166a0dc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f166a0dc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35682/0 (socket says 172.21.15.155:35682) 2024-04-19T23:45:40.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f166a0dc700 1 -- 172.21.15.155:0/3840960939 learned_addr learned my addr 172.21.15.155:0/3840960939 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f166a0dc700 1 -- 172.21.15.155:0/3840960939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569c8dc6d00 con 0x5569c913dc00 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f166a0dc700 1 --2- 172.21.15.155:0/3840960939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x5569c91df380 tx=0x5569c90e3620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f164f8a7700 1 -- 172.21.15.155:0/3840960939 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c91d4420 con 0x5569c913dc00 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f164f8a7700 1 -- 172.21.15.155:0/3840960939 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569c91e6180 con 0x5569c913dc00 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f164f8a7700 1 -- 172.21.15.155:0/3840960939 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569c91d4160 con 0x5569c913dc00 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f166c933a80 1 -- 172.21.15.155:0/3840960939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5569c8dc6340 con 0x5569c913dc00 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.201+0000 7f166c933a80 1 -- 172.21.15.155:0/3840960939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569c8dc6b60 con 0x5569c913dc00 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.202+0000 7f164f8a7700 1 -- 172.21.15.155:0/3840960939 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5569c9b41b80 con 0x5569c913dc00 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.202+0000 7f164f8a7700 1 --2- 172.21.15.155:0/3840960939 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c9272000 0x5569c9089700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.202+0000 7f164f8a7700 1 -- 172.21.15.155:0/3840960939 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5569c8e196c0 con 0x5569c913dc00 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.202+0000 7f166c933a80 5 note: GC not initialized 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.202+0000 7f166b0de700 1 --2- 172.21.15.155:0/3840960939 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c9272000 0x5569c9089700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.203+0000 7f166b0de700 1 --2- 172.21.15.155:0/3840960939 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c9272000 0x5569c9089700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5569c91dff20 tx=0x5569c90e3380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.203+0000 7f164d0a2700 20 reqs_thread_entry: start 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.203+0000 7f166c933a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.203+0000 7f166c933a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.203+0000 7f164b09e700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:10 2024 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.203+0000 7f164a87c700 20 reqs_thread_entry: start 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4000 con 0x5569c8d9fc00 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:40.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4800 con 0x5569c913d800 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 : miss 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.204+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4c00 con 0x5569c8d9fc00 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.205+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.205+0000 7f166c933a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.205+0000 7f166c933a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.205+0000 7f166c933a80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:40.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.205+0000 7f166c933a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.205+0000 7f166c933a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.205+0000 7f166c933a80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.205+0000 7f166c933a80 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.205+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d5000 con 0x5569c913d800 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.206+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 foo.buckets [call] v30'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.206+0000 7f166c933a80 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.206+0000 7f166c933a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.206+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c9272400 con 0x5569c913d800 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.206+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.206+0000 7f166c933a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.206+0000 7f166c933a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.206+0000 7f166c933a80 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.206+0000 7f166c933a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.206+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c9272c00 con 0x5569c913d800 2024-04-19T23:45:40.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f166c933a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f166c933a80 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f166c933a80 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93912834074880 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c9273000 con 0x5569c913c400 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== watch-notify(notify (1) cookie 93912832669184 notify 128849018890 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x5569c92e0000 con 0x5569c913c400 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f16650d2700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 93912832669184 notifier 4509 bl.length()=338 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f16650d2700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f16650d2700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(68 notify.6 [notify cookie 93912834074880 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f16650d2700 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c92ea000 con 0x5569c913c400 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.208+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== watch-notify(notify_complete (2) cookie 93912834074880 notify 128849018890 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5569c92e01a0 con 0x5569c913c400 2024-04-19T23:45:40.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.209+0000 7f16518ab700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.209+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93912834072576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c9273400 con 0x5569c8d9fc00 2024-04-19T23:45:40.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.210+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93912834072576] v30'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.210+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93912832662272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c9273800 con 0x5569c913d800 2024-04-19T23:45:40.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.211+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93912832662272] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.211+0000 7f166c933a80 20 remove_watcher() i=0 2024-04-19T23:45:40.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.211+0000 7f166c933a80 2 removed watcher, disabling cache 2024-04-19T23:45:40.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.211+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93912832663424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4400 con 0x5569c8d9fc00 2024-04-19T23:45:40.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.212+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93912832663424] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.212+0000 7f166c933a80 20 remove_watcher() i=1 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.212+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93912832664576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d4800 con 0x5569c913d400 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.213+0000 7f166a8dd700 1 -- 172.21.15.155:0/2967245983 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93912832664576] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b3200 con 0x5569c913d400 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.213+0000 7f166c933a80 20 remove_watcher() i=2 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.213+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93912832665728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c90d5000 con 0x5569c913d800 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.214+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93912832665728] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b3440 con 0x5569c913d800 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.214+0000 7f166c933a80 20 remove_watcher() i=3 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.214+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93912832666880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c92ea800 con 0x5569c8d9fc00 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.215+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93912832666880] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c8d9fc00 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.215+0000 7f166c933a80 20 remove_watcher() i=4 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.215+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93912832668032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c92eac00 con 0x5569c913c400 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.216+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93912832668032] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.216+0000 7f166c933a80 20 remove_watcher() i=5 2024-04-19T23:45:40.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.216+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93912832669184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c92eb000 con 0x5569c913c400 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.217+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93912832669184] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.217+0000 7f166c933a80 20 remove_watcher() i=6 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.217+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93912832670336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569c92eb400 con 0x5569c913c400 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166b0de700 1 -- 172.21.15.155:0/2967245983 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93912832670336] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5569c91b2b40 con 0x5569c913c400 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 20 remove_watcher() i=7 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5569c913c400 msgr2=0x5569c9089180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5569c913c400 0x5569c9089180 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5569c8d9fc00 msgr2=0x5569c9087b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5569c8d9fc00 0x5569c9087b80 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5569c913d800 msgr2=0x5569c9088c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5569c913d800 0x5569c9088c00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5569c913d400 msgr2=0x5569c9088100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5569c913d400 0x5569c9088100 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c913cc00 msgr2=0x5569c9087600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c913cc00 0x5569c9087600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x5569c9c26510 tx=0x5569c90e26c0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 msgr2=0x5569c9086b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 --2- 172.21.15.155:0/2967245983 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9f800 0x5569c9086b00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5569c911ca80 tx=0x5569c90e2720 comp rx=0 tx=0).stop 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 reap_dead start 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166a0dc700 1 -- 172.21.15.155:0/2967245983 reap_dead start 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 shutdown_connections 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 >> 172.21.15.155:0/2967245983 conn(0x5569c8d9ec00 msgr2=0x5569c8e8b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 shutdown_connections 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.218+0000 7f166c933a80 1 -- 172.21.15.155:0/2967245983 wait complete. 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/3840960939 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c9272000 msgr2=0x5569c9089700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 --2- 172.21.15.155:0/3840960939 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c9272000 0x5569c9089700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5569c91dff20 tx=0x5569c90e3380 comp rx=0 tx=0).stop 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/3840960939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 msgr2=0x5569c9088680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 --2- 172.21.15.155:0/3840960939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x5569c91df380 tx=0x5569c90e3620 comp rx=0 tx=0).stop 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/3840960939 shutdown_connections 2024-04-19T23:45:40.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 --2- 172.21.15.155:0/3840960939 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c9272000 0x5569c9089700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 --2- 172.21.15.155:0/3840960939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c913dc00 0x5569c9088680 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/3840960939 >> 172.21.15.155:0/3840960939 conn(0x5569c913d000 msgr2=0x5569c8e8c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/3840960939 shutdown_connections 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/3840960939 wait complete. 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/697706923 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c8d9f400 msgr2=0x5569c9087080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 --2- 172.21.15.155:0/697706923 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c8d9f400 0x5569c9087080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5569c911c030 tx=0x5569c90e2540 comp rx=0 tx=0).stop 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/697706923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 msgr2=0x5569c9086580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 --2- 172.21.15.155:0/697706923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x5569c9b775f0 tx=0x5569c8e8f920 comp rx=0 tx=0).stop 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/697706923 shutdown_connections 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 --2- 172.21.15.155:0/697706923 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569c8d9f400 0x5569c9087080 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 --2- 172.21.15.155:0/697706923 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569c8d9e800 0x5569c9086580 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/697706923 >> 172.21.15.155:0/697706923 conn(0x5569c8d9e400 msgr2=0x5569c8e8b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/697706923 shutdown_connections 2024-04-19T23:45:40.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.219+0000 7f166c933a80 1 -- 172.21.15.155:0/697706923 wait complete. 2024-04-19T23:45:40.233 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-19T23:45:40.233 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-19T23:45:40.233 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-19T23:45:40.286 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:40.286 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:40.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.287+0000 7fa707628a80 1 Processor -- start 2024-04-19T23:45:40.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.287+0000 7fa707628a80 1 -- start start 2024-04-19T23:45:40.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.287+0000 7fa707628a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55608d628c00 0x55608d910580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.287+0000 7fa707628a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55608d953500 con 0x55608d628800 2024-04-19T23:45:40.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.287+0000 7fa707628a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55608d6caa00 con 0x55608d628c00 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.287+0000 7fa704dd1700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55608d628c00 0x55608d910580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.287+0000 7fa7055d2700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55608d628800 0x55608d714800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46738/0 (socket says 172.21.15.155:46738) 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.287+0000 7fa7055d2700 1 -- 172.21.15.155:0/2440417696 learned_addr learned my addr 172.21.15.155:0/2440417696 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa704dd1700 1 -- 172.21.15.155:0/2440417696 >> v1:172.21.15.76:6789/0 conn(0x55608d628800 legacy=0x55608d714800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa704dd1700 1 -- 172.21.15.155:0/2440417696 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55608d651d40 con 0x55608d628c00 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa7045d0700 1 -- 172.21.15.155:0/2440417696 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546158484 0 0) 0x55608e3f6000 con 0x55608d628800 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa704dd1700 1 --2- 172.21.15.155:0/2440417696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628c00 0x55608d910580 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x55608d90b890 tx=0x55608d719920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937be1ae864deac4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa7045d0700 1 -- 172.21.15.155:0/2440417696 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608d6e14a0 con 0x55608d628c00 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa7045d0700 1 -- 172.21.15.155:0/2440417696 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55608d953800 con 0x55608d628c00 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa7045d0700 1 -- 172.21.15.155:0/2440417696 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608d6e1600 con 0x55608d628c00 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa707628a80 1 -- 172.21.15.155:0/2440417696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628c00 msgr2=0x55608d910580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa707628a80 1 --2- 172.21.15.155:0/2440417696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628c00 0x55608d910580 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x55608d90b890 tx=0x55608d719920 comp rx=0 tx=0).stop 2024-04-19T23:45:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa707628a80 1 -- 172.21.15.155:0/2440417696 shutdown_connections 2024-04-19T23:45:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa707628a80 1 --2- 172.21.15.155:0/2440417696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628c00 0x55608d910580 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa707628a80 1 -- 172.21.15.155:0/2440417696 >> 172.21.15.155:0/2440417696 conn(0x55608d628400 msgr2=0x55608d714000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa707628a80 1 -- 172.21.15.155:0/2440417696 shutdown_connections 2024-04-19T23:45:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.288+0000 7fa707628a80 1 -- 172.21.15.155:0/2440417696 wait complete. 2024-04-19T23:45:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.289+0000 7fa707628a80 1 Processor -- start 2024-04-19T23:45:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.289+0000 7fa707628a80 1 -- start start 2024-04-19T23:45:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.289+0000 7fa707628a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.289+0000 7fa707628a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55608d6ca500 con 0x55608d628800 2024-04-19T23:45:40.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.289+0000 7fa7055d2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.289+0000 7fa7055d2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35692/0 (socket says 172.21.15.155:35692) 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.289+0000 7fa7055d2700 1 -- 172.21.15.155:0/402230985 learned_addr learned my addr 172.21.15.155:0/402230985 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.290+0000 7fa7055d2700 1 -- 172.21.15.155:0/402230985 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55608d651ba0 con 0x55608d628800 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.290+0000 7fa7055d2700 1 --2- 172.21.15.155:0/402230985 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55608e3f9d70 tx=0x55608d719b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8caea51388f70dfc server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.290+0000 7fa703dcf700 1 -- 172.21.15.155:0/402230985 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608d6e11e0 con 0x55608d628800 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.290+0000 7fa703dcf700 1 -- 172.21.15.155:0/402230985 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55608d953b00 con 0x55608d628800 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.290+0000 7fa703dcf700 1 -- 172.21.15.155:0/402230985 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608d6e14a0 con 0x55608d628800 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa707628a80 1 -- 172.21.15.155:0/402230985 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 msgr2=0x55608d910580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa707628a80 1 --2- 172.21.15.155:0/402230985 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55608e3f9d70 tx=0x55608d719b60 comp rx=0 tx=0).stop 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa707628a80 1 -- 172.21.15.155:0/402230985 shutdown_connections 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa707628a80 1 --2- 172.21.15.155:0/402230985 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa707628a80 1 -- 172.21.15.155:0/402230985 >> 172.21.15.155:0/402230985 conn(0x55608d628400 msgr2=0x55608d715000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa707628a80 1 -- 172.21.15.155:0/402230985 shutdown_connections 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa707628a80 1 -- 172.21.15.155:0/402230985 wait complete. 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa707628a80 1 Processor -- start 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa707628a80 1 -- start start 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa707628a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa707628a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55608d6ca3c0 con 0x55608d628800 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa7055d2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa7055d2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35704/0 (socket says 172.21.15.155:35704) 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.291+0000 7fa7055d2700 1 -- 172.21.15.155:0/1039636873 learned_addr learned my addr 172.21.15.155:0/1039636873 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.292+0000 7fa7055d2700 1 -- 172.21.15.155:0/1039636873 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55608d651a00 con 0x55608d628800 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.292+0000 7fa7055d2700 1 --2- 172.21.15.155:0/1039636873 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55608e3f9e00 tx=0x55608d719a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.292+0000 7fa7025cc700 1 -- 172.21.15.155:0/1039636873 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608d6e1600 con 0x55608d628800 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.292+0000 7fa707628a80 1 -- 172.21.15.155:0/1039636873 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55608d651860 con 0x55608d628800 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.292+0000 7fa7025cc700 1 -- 172.21.15.155:0/1039636873 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55608d6c9c80 con 0x55608d628800 2024-04-19T23:45:40.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.292+0000 7fa7025cc700 1 -- 172.21.15.155:0/1039636873 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608d6e11e0 con 0x55608d628800 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.292+0000 7fa707628a80 1 -- 172.21.15.155:0/1039636873 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55608d6516c0 con 0x55608d628800 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa707628a80 1 Processor -- start 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa707628a80 1 -- start start 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa7025cc700 1 -- 172.21.15.155:0/1039636873 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55608e3cab00 con 0x55608d628800 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa707628a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 0x55608d910b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa707628a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55608d664640 con 0x55608d629400 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa7025cc700 1 --2- 172.21.15.155:0/1039636873 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608d9ae000 0x55608d911080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa7025cc700 1 -- 172.21.15.155:0/1039636873 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55608d6a3180 con 0x55608d628800 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa705dd3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 0x55608d910b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa705dd3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 0x55608d910b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35712/0 (socket says 172.21.15.155:35712) 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa705dd3700 1 -- 172.21.15.155:0/1885042249 learned_addr learned my addr 172.21.15.155:0/1885042249 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa7055d2700 1 --2- 172.21.15.155:0/1039636873 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608d9ae000 0x55608d911080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa705dd3700 1 -- 172.21.15.155:0/1885042249 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55608d650000 con 0x55608d629400 2024-04-19T23:45:40.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.293+0000 7fa7055d2700 1 --2- 172.21.15.155:0/1039636873 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608d9ae000 0x55608d911080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55608e4baf00 tx=0x55608d974240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa705dd3700 1 --2- 172.21.15.155:0/1885042249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 0x55608d910b00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55608e4bae10 tx=0x55608d9749c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd58bf5ca596b74c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa6ffdc7700 1 -- 172.21.15.155:0/1885042249 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608d6e1600 con 0x55608d629400 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa6ffdc7700 1 -- 172.21.15.155:0/1885042249 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55608d952300 con 0x55608d629400 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa6ffdc7700 1 -- 172.21.15.155:0/1885042249 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608d6e11e0 con 0x55608d629400 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa707628a80 1 -- 172.21.15.155:0/1885042249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 msgr2=0x55608d910b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa707628a80 1 --2- 172.21.15.155:0/1885042249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 0x55608d910b00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55608e4bae10 tx=0x55608d9749c0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa707628a80 1 -- 172.21.15.155:0/1885042249 shutdown_connections 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa707628a80 1 --2- 172.21.15.155:0/1885042249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 0x55608d910b00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa707628a80 1 -- 172.21.15.155:0/1885042249 >> 172.21.15.155:0/1885042249 conn(0x55608d628c00 msgr2=0x55608d715800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa707628a80 1 -- 172.21.15.155:0/1885042249 shutdown_connections 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa707628a80 1 -- 172.21.15.155:0/1885042249 wait complete. 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa707628a80 1 Processor -- start 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.294+0000 7fa707628a80 1 -- start start 2024-04-19T23:45:40.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa707628a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 0x55608d910b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa707628a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55608d6648c0 con 0x55608d629400 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa705dd3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 0x55608d910b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa705dd3700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 0x55608d910b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35716/0 (socket says 172.21.15.155:35716) 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 learned_addr learned my addr 172.21.15.155:0/2900910741 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55608d650ea0 con 0x55608d629400 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa705dd3700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 0x55608d910b00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55608e4ba450 tx=0x55608d974060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa6fe5c4700 1 -- 172.21.15.155:0/2900910741 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608d6e1a20 con 0x55608d629400 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa6fe5c4700 1 -- 172.21.15.155:0/2900910741 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55608d6c9c80 con 0x55608d629400 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55608d650820 con 0x55608d629400 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa6fe5c4700 1 -- 172.21.15.155:0/2900910741 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608d6e1600 con 0x55608d629400 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.295+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55608d6509c0 con 0x55608d629400 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.296+0000 7fa6fe5c4700 1 -- 172.21.15.155:0/2900910741 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55608e3cadc0 con 0x55608d629400 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.296+0000 7fa6fe5c4700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608d9aec00 0x55608d911600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.296+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.296+0000 7fa6fe5c4700 1 -- 172.21.15.155:0/2900910741 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55608d6a3340 con 0x55608d629400 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.296+0000 7fa704dd1700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608d9aec00 0x55608d911600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.296+0000 7fa707628a80 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55608d629800 0x55608d911b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.296+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d629c00 con 0x55608d629800 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa705dd3700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55608d629800 0x55608d911b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa704dd1700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608d9aec00 0x55608d911600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55608d90b890 tx=0x55608d719800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa705dd3700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55608d629800 0x55608d911b80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa707628a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa707628a80 20 realm 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d9af000 con 0x55608d629800 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa707628a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa707628a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.297+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d9af400 con 0x55608d629800 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa707628a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d9af800 con 0x55608d629800 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa707628a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d9afc00 con 0x55608d629800 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa707628a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa707628a80 20 searching for the correct realm 2024-04-19T23:45:40.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa707628a80 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55608d9af000 0x55608d912100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.298+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d9af400 con 0x55608d9af000 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.299+0000 7fa7055d2700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55608d9af000 0x55608d912100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.299+0000 7fa7055d2700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55608d9af000 0x55608d912100 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.299+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.299+0000 7fa7055d2700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55608d9af400 0x55608d912c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.299+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72000 con 0x55608d9af400 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.299+0000 7fa704dd1700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55608d9af400 0x55608d912c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.300+0000 7fa704dd1700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55608d9af400 0x55608d912c00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.300+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.300+0000 7fa704dd1700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55608da72000 0x55608d913180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.300+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608da72000 2024-04-19T23:45:40.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.300+0000 7fa705dd3700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55608da72000 0x55608d913180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.300+0000 7fa705dd3700 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55608da72000 0x55608d913180 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.301+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.301+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d629800 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.301+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.301+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d629800 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.301+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.301+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608da72000 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.301+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.301+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608da72000 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.301+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.301+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af400 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.302+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.302+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af000 2024-04-19T23:45:40.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.302+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.302+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d629800 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.302+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.302+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608da72000 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.302+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.302+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d629800 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.303+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.303+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af400 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.303+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.303+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af000 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.303+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.303+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af000 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.303+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.303+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608da72000 2024-04-19T23:45:40.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.304+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.304+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af000 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.304+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.304+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af000 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.304+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.304+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d629800 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.304+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.304+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d629800 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.304+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.304+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608da72000 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.305+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.305+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af000 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.305+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.305+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af400 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.305+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.305+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d629800 2024-04-19T23:45:40.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.305+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.305+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608da72000 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.306+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.306+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af000 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.306+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.306+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608da72000 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.307+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.307+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af400 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.307+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.307+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af000 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.307+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.307+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608da72000 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.307+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.307+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d629800 2024-04-19T23:45:40.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.307+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.307+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af400 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d629c00 con 0x55608d629800 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72c00 con 0x55608d629800 2024-04-19T23:45:40.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da73000 con 0x55608d9af400 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 zone default found 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 4 Realm: () 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 zonegroup default 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.308+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da73400 con 0x55608da72000 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa707628a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da73800 con 0x55608d9af000 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa707628a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da73c00 con 0x55608d9af000 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa707628a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa707628a80 20 started sync module instance, tier type = 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa707628a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.309+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72c00 con 0x55608d9af400 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.310+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.310+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93873180277504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d629c00 con 0x55608d9af400 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.310+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d9af800 con 0x55608d629800 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.311+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93873180277504] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.311+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.311+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93873180278656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d9afc00 con 0x55608d629800 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.312+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608d9af000 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.312+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93873180278656] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.313+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.314+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93873180279808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da73000 con 0x55608d9af000 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.314+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72c00 con 0x55608d9af400 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.314+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.314+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93873180279808] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.315+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93873180280960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72400 con 0x55608d9af400 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.315+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da73800 con 0x55608d629800 2024-04-19T23:45:40.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.316+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.316+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93873180282112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da73c00 con 0x55608d629800 2024-04-19T23:45:40.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.316+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da72800 con 0x55608da72000 2024-04-19T23:45:40.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.316+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93873180280960] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.317+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93873180282112] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.317+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.317+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93873180283264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da73400 con 0x55608da72000 2024-04-19T23:45:40.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.317+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da73800 con 0x55608da72000 2024-04-19T23:45:40.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.318+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93873180283264] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.319+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.319+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93873180284416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da73c00 con 0x55608da72000 2024-04-19T23:45:40.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.319+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d9af800 con 0x55608da72000 2024-04-19T23:45:40.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.320+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.320+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93873180285568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d9afc00 con 0x55608da72000 2024-04-19T23:45:40.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.320+0000 7fa707628a80 20 add_watcher() i=0 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.320+0000 7fa707628a80 20 add_watcher() i=1 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.320+0000 7fa707628a80 20 add_watcher() i=2 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.320+0000 7fa707628a80 20 add_watcher() i=3 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.320+0000 7fa707628a80 20 add_watcher() i=4 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.320+0000 7fa707628a80 20 add_watcher() i=5 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.320+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93873180284416] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.320+0000 7fa707628a80 20 add_watcher() i=6 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.321+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93873180285568] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.321+0000 7fa707628a80 20 add_watcher() i=7 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.321+0000 7fa707628a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.321+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d9af800 con 0x55608d629800 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.322+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.322+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93873181827072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608d9afc00 con 0x55608d629800 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.322+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93873181827072] v30'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.323+0000 7fa6ec5a0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.323+0000 7fa707628a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.323+0000 7fa707628a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.323+0000 7fa707628a80 1 Processor -- start 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.323+0000 7fa707628a80 1 -- start start 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.323+0000 7fa707628a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.323+0000 7fa707628a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55608d6ca3c0 con 0x55608da73400 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.323+0000 7fa704dd1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.323+0000 7fa704dd1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35720/0 (socket says 172.21.15.155:35720) 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.323+0000 7fa704dd1700 1 -- 172.21.15.155:0/3963227509 learned_addr learned my addr 172.21.15.155:0/3963227509 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.323+0000 7fa704dd1700 1 -- 172.21.15.155:0/3963227509 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55608d650b60 con 0x55608da73400 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.324+0000 7fa704dd1700 1 --2- 172.21.15.155:0/3963227509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55608d9b1410 tx=0x55608d9756e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4325364f7391027 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.324+0000 7fa6ebd9f700 1 -- 172.21.15.155:0/3963227509 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608d6e1760 con 0x55608da73400 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.324+0000 7fa6ebd9f700 1 -- 172.21.15.155:0/3963227509 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55608da94000 con 0x55608da73400 2024-04-19T23:45:40.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.324+0000 7fa6ebd9f700 1 -- 172.21.15.155:0/3963227509 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608da9c000 con 0x55608da73400 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.324+0000 7fa707628a80 1 -- 172.21.15.155:0/3963227509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 msgr2=0x55608d912680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.324+0000 7fa707628a80 1 --2- 172.21.15.155:0/3963227509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55608d9b1410 tx=0x55608d9756e0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa707628a80 1 -- 172.21.15.155:0/3963227509 shutdown_connections 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa707628a80 1 --2- 172.21.15.155:0/3963227509 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa707628a80 1 -- 172.21.15.155:0/3963227509 >> 172.21.15.155:0/3963227509 conn(0x55608da72800 msgr2=0x55608d716000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa707628a80 1 -- 172.21.15.155:0/3963227509 shutdown_connections 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa707628a80 1 -- 172.21.15.155:0/3963227509 wait complete. 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa707628a80 1 Processor -- start 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa707628a80 1 -- start start 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa707628a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa707628a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55608d6ca500 con 0x55608da73400 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa704dd1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa704dd1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35732/0 (socket says 172.21.15.155:35732) 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa704dd1700 1 -- 172.21.15.155:0/1724214801 learned_addr learned my addr 172.21.15.155:0/1724214801 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.325+0000 7fa704dd1700 1 -- 172.21.15.155:0/1724214801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55608d650d00 con 0x55608da73400 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.326+0000 7fa704dd1700 1 --2- 172.21.15.155:0/1724214801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55608da87800 tx=0x55608d975800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.326+0000 7fa6ea59c700 1 -- 172.21.15.155:0/1724214801 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608da9c160 con 0x55608da73400 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.326+0000 7fa6ea59c700 1 -- 172.21.15.155:0/1724214801 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55608da94180 con 0x55608da73400 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.326+0000 7fa707628a80 1 -- 172.21.15.155:0/1724214801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55608d650340 con 0x55608da73400 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.326+0000 7fa6ea59c700 1 -- 172.21.15.155:0/1724214801 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55608da9c2c0 con 0x55608da73400 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.326+0000 7fa707628a80 1 -- 172.21.15.155:0/1724214801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55608d651d40 con 0x55608da73400 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.326+0000 7fa6ea59c700 1 -- 172.21.15.155:0/1724214801 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55608e3cbb80 con 0x55608da73400 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.327+0000 7fa6ea59c700 1 --2- 172.21.15.155:0/1724214801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608db16000 0x55608d913700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.327+0000 7fa6ea59c700 1 -- 172.21.15.155:0/1724214801 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55608d6a3500 con 0x55608da73400 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.327+0000 7fa707628a80 5 note: GC not initialized 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.327+0000 7fa705dd3700 1 --2- 172.21.15.155:0/1724214801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608db16000 0x55608d913700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.327+0000 7fa705dd3700 1 --2- 172.21.15.155:0/1724214801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608db16000 0x55608d913700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55608da19f80 tx=0x55608d974000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa6e7d97700 20 reqs_thread_entry: start 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa707628a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa707628a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa6e5d93700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:10 2024 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa6e5571700 20 reqs_thread_entry: start 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa707628a80 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608da73c00 con 0x55608da72000 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa707628a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa707628a80 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa707628a80 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa707628a80 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-19T23:45:40.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa707628a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db16400 con 0x55608da72000 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.328+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.329+0000 7fa707628a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.329+0000 7fa707628a80 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.329+0000 7fa707628a80 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.329+0000 7fa707628a80 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.329+0000 7fa707628a80 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.329+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db16800 con 0x55608da72000 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v30'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa707628a80 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa707628a80 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa707628a80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93873181829376 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db16c00 con 0x55608da72000 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== watch-notify(notify (1) cookie 93873180283264 notify 128849018891 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x55608da1dd40 con 0x55608da72000 2024-04-19T23:45:40.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa6ffdc7700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 93873180283264 notifier 4517 bl.length()=522 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(65 notify.5 [notify cookie 93873181829376 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa6ffdc7700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa6ffdc7700 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa6ffdc7700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db88000 con 0x55608da72000 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== watch-notify(notify_complete (2) cookie 93873181829376 notify 128849018891 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55608daddba0 con 0x55608da72000 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.330+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db17000 con 0x55608da72000 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.331+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.331+0000 7fa707628a80 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.331+0000 7fa707628a80 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.331+0000 7fa707628a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.331+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93873181829376 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db17400 con 0x55608d9af000 2024-04-19T23:45:40.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.332+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 93873180279808 notify 128849018883 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55608d973d40 con 0x55608d9af000 2024-04-19T23:45:40.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.332+0000 7fa6ffdc7700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 93873180279808 notifier 4517 bl.length()=177 2024-04-19T23:45:40.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.332+0000 7fa6ffdc7700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-19T23:45:40.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.332+0000 7fa6ffdc7700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:45:40.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.332+0000 7fa6ffdc7700 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db88400 con 0x55608d9af000 2024-04-19T23:45:40.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.332+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(68 notify.2 [notify cookie 93873181829376 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.332+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.332+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== watch-notify(notify_complete (2) cookie 93873181829376 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55608dadba00 con 0x55608d9af000 2024-04-19T23:45:40.343 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:40.343 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "fud", 2024-04-19T23:45:40.343 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Fud", 2024-04-19T23:45:40.343 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "", 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 1, 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "fud", 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:40.344 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:40.345 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:40.346 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:40.346 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:40.346 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.333+0000 7fa6ec5a0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.333+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93873181827072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db17800 con 0x55608d629800 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.334+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93873181827072] v30'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.334+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93873180277504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db17c00 con 0x55608d9af400 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.335+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93873180277504] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.335+0000 7fa707628a80 20 remove_watcher() i=0 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.335+0000 7fa707628a80 2 removed watcher, disabling cache 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.335+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93873180278656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db88000 con 0x55608d629800 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.336+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93873180278656] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.336+0000 7fa707628a80 20 remove_watcher() i=1 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.336+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93873180279808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db88800 con 0x55608d9af000 2024-04-19T23:45:40.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.337+0000 7fa7055d2700 1 -- 172.21.15.155:0/2900910741 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93873180279808] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6b200 con 0x55608d9af000 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.337+0000 7fa707628a80 20 remove_watcher() i=2 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.337+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93873180280960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db88c00 con 0x55608d9af400 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.338+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93873180280960] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6b440 con 0x55608d9af400 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.338+0000 7fa707628a80 20 remove_watcher() i=3 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.338+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93873180282112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db89000 con 0x55608d629800 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.339+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93873180282112] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608d629800 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.339+0000 7fa707628a80 20 remove_watcher() i=4 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.339+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93873180283264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db89400 con 0x55608da72000 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.340+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93873180283264] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.340+0000 7fa707628a80 20 remove_watcher() i=5 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.340+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93873180284416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db89800 con 0x55608da72000 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.341+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93873180284416] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.341+0000 7fa707628a80 20 remove_watcher() i=6 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.341+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93873180285568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55608db89c00 con 0x55608da72000 2024-04-19T23:45:40.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.342+0000 7fa705dd3700 1 -- 172.21.15.155:0/2900910741 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93873180285568] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55608da6ab40 con 0x55608da72000 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.342+0000 7fa707628a80 20 remove_watcher() i=7 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55608da72000 msgr2=0x55608d913180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55608da72000 0x55608d913180 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55608d629800 msgr2=0x55608d911b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55608d629800 0x55608d911b80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55608d9af400 msgr2=0x55608d912c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55608d9af400 0x55608d912c00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55608d9af000 msgr2=0x55608d912100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55608d9af000 0x55608d912100 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608d9aec00 msgr2=0x55608d911600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608d9aec00 0x55608d911600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55608d90b890 tx=0x55608d719800 comp rx=0 tx=0).stop 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 msgr2=0x55608d910b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 --2- 172.21.15.155:0/2900910741 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d629400 0x55608d910b00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55608e4ba450 tx=0x55608d974060 comp rx=0 tx=0).stop 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 reap_dead start 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 shutdown_connections 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa704dd1700 1 -- 172.21.15.155:0/2900910741 reap_dead start 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 >> 172.21.15.155:0/2900910741 conn(0x55608d628c00 msgr2=0x55608d715800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 shutdown_connections 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/2900910741 wait complete. 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/1724214801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608db16000 msgr2=0x55608d913700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 --2- 172.21.15.155:0/1724214801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608db16000 0x55608d913700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55608da19f80 tx=0x55608d974000 comp rx=0 tx=0).stop 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/1724214801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 msgr2=0x55608d912680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 --2- 172.21.15.155:0/1724214801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55608da87800 tx=0x55608d975800 comp rx=0 tx=0).stop 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/1724214801 shutdown_connections 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 --2- 172.21.15.155:0/1724214801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608db16000 0x55608d913700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 --2- 172.21.15.155:0/1724214801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608da73400 0x55608d912680 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/1724214801 >> 172.21.15.155:0/1724214801 conn(0x55608da72800 msgr2=0x55608d716000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/1724214801 shutdown_connections 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.343+0000 7fa707628a80 1 -- 172.21.15.155:0/1724214801 wait complete. 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.344+0000 7fa707628a80 1 -- 172.21.15.155:0/1039636873 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608d9ae000 msgr2=0x55608d911080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.344+0000 7fa707628a80 1 --2- 172.21.15.155:0/1039636873 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608d9ae000 0x55608d911080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55608e4baf00 tx=0x55608d974240 comp rx=0 tx=0).stop 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.344+0000 7fa707628a80 1 -- 172.21.15.155:0/1039636873 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 msgr2=0x55608d910580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.344+0000 7fa707628a80 1 --2- 172.21.15.155:0/1039636873 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55608e3f9e00 tx=0x55608d719a40 comp rx=0 tx=0).stop 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.344+0000 7fa707628a80 1 -- 172.21.15.155:0/1039636873 shutdown_connections 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.344+0000 7fa707628a80 1 --2- 172.21.15.155:0/1039636873 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55608d9ae000 0x55608d911080 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.344+0000 7fa707628a80 1 --2- 172.21.15.155:0/1039636873 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55608d628800 0x55608d910580 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.344+0000 7fa707628a80 1 -- 172.21.15.155:0/1039636873 >> 172.21.15.155:0/1039636873 conn(0x55608d628400 msgr2=0x55608d715000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.344+0000 7fa707628a80 1 -- 172.21.15.155:0/1039636873 shutdown_connections 2024-04-19T23:45:40.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.344+0000 7fa707628a80 1 -- 172.21.15.155:0/1039636873 wait complete. 2024-04-19T23:45:40.355 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:40.360 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-19T23:45:40.364 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:40.364 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-04-19T23:45:40.364 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-04-19T23:45:40.364 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-04-19T23:45:40.408 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:40.409 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:40.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.409+0000 7fd3dd0bea80 1 Processor -- start 2024-04-19T23:45:40.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.409+0000 7fd3dd0bea80 1 -- start start 2024-04-19T23:45:40.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.409+0000 7fd3dd0bea80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x556c5c874c00 0x556c5cb5c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.409+0000 7fd3dd0bea80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556c5cb9f500 con 0x556c5c874800 2024-04-19T23:45:40.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.409+0000 7fd3dd0bea80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x556c5c916a00 con 0x556c5c874c00 2024-04-19T23:45:40.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.410+0000 7fd3da867700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x556c5c874c00 0x556c5cb5c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.410+0000 7fd3db068700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x556c5c874800 0x556c5c960800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46748/0 (socket says 172.21.15.155:46748) 2024-04-19T23:45:40.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.410+0000 7fd3db068700 1 -- 172.21.15.155:0/898920579 learned_addr learned my addr 172.21.15.155:0/898920579 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:40.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.410+0000 7fd3da867700 1 -- 172.21.15.155:0/898920579 >> v1:172.21.15.76:6789/0 conn(0x556c5c874800 legacy=0x556c5c960800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.410+0000 7fd3da867700 1 -- 172.21.15.155:0/898920579 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c5c89dd40 con 0x556c5c874c00 2024-04-19T23:45:40.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.410+0000 7fd3da066700 1 -- 172.21.15.155:0/898920579 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539648511 0 0) 0x556c5d642000 con 0x556c5c874800 2024-04-19T23:45:40.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.410+0000 7fd3da867700 1 --2- 172.21.15.155:0/898920579 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874c00 0x556c5cb5c580 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x556c5cb57890 tx=0x556c5c965920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365afa4a44613417 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.410+0000 7fd3da066700 1 -- 172.21.15.155:0/898920579 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5c92d4a0 con 0x556c5c874c00 2024-04-19T23:45:40.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.410+0000 7fd3da066700 1 -- 172.21.15.155:0/898920579 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c5cb9f800 con 0x556c5c874c00 2024-04-19T23:45:40.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.410+0000 7fd3da066700 1 -- 172.21.15.155:0/898920579 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5c92d600 con 0x556c5c874c00 2024-04-19T23:45:40.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.411+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/898920579 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874c00 msgr2=0x556c5cb5c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.411+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/898920579 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874c00 0x556c5cb5c580 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x556c5cb57890 tx=0x556c5c965920 comp rx=0 tx=0).stop 2024-04-19T23:45:40.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.411+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/898920579 shutdown_connections 2024-04-19T23:45:40.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.411+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/898920579 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874c00 0x556c5cb5c580 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.411+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/898920579 >> 172.21.15.155:0/898920579 conn(0x556c5c874400 msgr2=0x556c5c960000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.411+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/898920579 shutdown_connections 2024-04-19T23:45:40.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.411+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/898920579 wait complete. 2024-04-19T23:45:40.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.411+0000 7fd3dd0bea80 1 Processor -- start 2024-04-19T23:45:40.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.411+0000 7fd3dd0bea80 1 -- start start 2024-04-19T23:45:40.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.412+0000 7fd3dd0bea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.412+0000 7fd3dd0bea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5c916500 con 0x556c5c874800 2024-04-19T23:45:40.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.412+0000 7fd3db068700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.412+0000 7fd3db068700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35742/0 (socket says 172.21.15.155:35742) 2024-04-19T23:45:40.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.412+0000 7fd3db068700 1 -- 172.21.15.155:0/2457937433 learned_addr learned my addr 172.21.15.155:0/2457937433 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.412+0000 7fd3db068700 1 -- 172.21.15.155:0/2457937433 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c5c89dba0 con 0x556c5c874800 2024-04-19T23:45:40.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.412+0000 7fd3db068700 1 --2- 172.21.15.155:0/2457937433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x556c5d645770 tx=0x556c5c965b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ac45a04d6df92c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.412+0000 7fd3d9865700 1 -- 172.21.15.155:0/2457937433 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5c92d1e0 con 0x556c5c874800 2024-04-19T23:45:40.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.412+0000 7fd3d9865700 1 -- 172.21.15.155:0/2457937433 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c5cb9fb00 con 0x556c5c874800 2024-04-19T23:45:40.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.412+0000 7fd3d9865700 1 -- 172.21.15.155:0/2457937433 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5c92d4a0 con 0x556c5c874800 2024-04-19T23:45:40.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/2457937433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 msgr2=0x556c5cb5c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/2457937433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x556c5d645770 tx=0x556c5c965b60 comp rx=0 tx=0).stop 2024-04-19T23:45:40.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/2457937433 shutdown_connections 2024-04-19T23:45:40.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/2457937433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/2457937433 >> 172.21.15.155:0/2457937433 conn(0x556c5c874400 msgr2=0x556c5c961000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/2457937433 shutdown_connections 2024-04-19T23:45:40.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/2457937433 wait complete. 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3dd0bea80 1 Processor -- start 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3dd0bea80 1 -- start start 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3dd0bea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3dd0bea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5c9163c0 con 0x556c5c874800 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3db068700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3db068700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35758/0 (socket says 172.21.15.155:35758) 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.413+0000 7fd3db068700 1 -- 172.21.15.155:0/1043649684 learned_addr learned my addr 172.21.15.155:0/1043649684 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.414+0000 7fd3db068700 1 -- 172.21.15.155:0/1043649684 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c5c89da00 con 0x556c5c874800 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.414+0000 7fd3db068700 1 --2- 172.21.15.155:0/1043649684 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x556c5d645e30 tx=0x556c5c965a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.414+0000 7fd3d8062700 1 -- 172.21.15.155:0/1043649684 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5c92d600 con 0x556c5c874800 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.414+0000 7fd3d8062700 1 -- 172.21.15.155:0/1043649684 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c5c915c80 con 0x556c5c874800 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.414+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1043649684 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556c5c89d860 con 0x556c5c874800 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.414+0000 7fd3d8062700 1 -- 172.21.15.155:0/1043649684 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5c92d1e0 con 0x556c5c874800 2024-04-19T23:45:40.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.414+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1043649684 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c5c89d6c0 con 0x556c5c874800 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.414+0000 7fd3dd0bea80 1 Processor -- start 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3dd0bea80 1 -- start start 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3dd0bea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 0x556c5cb5cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3dd0bea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5c916000 con 0x556c5c875400 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3d8062700 1 -- 172.21.15.155:0/1043649684 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x556c5d616b00 con 0x556c5c874800 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3db869700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 0x556c5cb5cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3db869700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 0x556c5cb5cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35774/0 (socket says 172.21.15.155:35774) 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3db869700 1 -- 172.21.15.155:0/4159926469 learned_addr learned my addr 172.21.15.155:0/4159926469 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3d8062700 1 --2- 172.21.15.155:0/1043649684 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cc04000 0x556c5cb5d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3d8062700 1 -- 172.21.15.155:0/1043649684 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x556c5c8ef180 con 0x556c5c874800 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3db068700 1 --2- 172.21.15.155:0/1043649684 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cc04000 0x556c5cb5d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3db869700 1 -- 172.21.15.155:0/4159926469 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c5c89c000 con 0x556c5c875400 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3db869700 1 --2- 172.21.15.155:0/4159926469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 0x556c5cb5cb00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x556c5d70fda0 tx=0x556c5cbca120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d6d0a69edf41ab server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3db068700 1 --2- 172.21.15.155:0/1043649684 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cc04000 0x556c5cb5d080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x556c5d70ef30 tx=0x556c5cbca240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3d585d700 1 -- 172.21.15.155:0/4159926469 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5c92d600 con 0x556c5c875400 2024-04-19T23:45:40.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.415+0000 7fd3d585d700 1 -- 172.21.15.155:0/4159926469 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c5cb9e300 con 0x556c5c875400 2024-04-19T23:45:40.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3d585d700 1 -- 172.21.15.155:0/4159926469 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5c92d1e0 con 0x556c5c875400 2024-04-19T23:45:40.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4159926469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 msgr2=0x556c5cb5cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/4159926469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 0x556c5cb5cb00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x556c5d70fda0 tx=0x556c5cbca120 comp rx=0 tx=0).stop 2024-04-19T23:45:40.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4159926469 shutdown_connections 2024-04-19T23:45:40.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/4159926469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 0x556c5cb5cb00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4159926469 >> 172.21.15.155:0/4159926469 conn(0x556c5c874c00 msgr2=0x556c5c961800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4159926469 shutdown_connections 2024-04-19T23:45:40.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4159926469 wait complete. 2024-04-19T23:45:40.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3dd0bea80 1 Processor -- start 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3dd0bea80 1 -- start start 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3dd0bea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 0x556c5cb5cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.416+0000 7fd3dd0bea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5c8b0640 con 0x556c5c875400 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.417+0000 7fd3db869700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 0x556c5cb5cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.417+0000 7fd3db869700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 0x556c5cb5cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35788/0 (socket says 172.21.15.155:35788) 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.417+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 learned_addr learned my addr 172.21.15.155:0/1394953708 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.417+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c5c89cea0 con 0x556c5c875400 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.417+0000 7fd3db869700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 0x556c5cb5cb00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x556c5d645f80 tx=0x556c5cbca8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.417+0000 7fd3d405a700 1 -- 172.21.15.155:0/1394953708 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5c92da20 con 0x556c5c875400 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.417+0000 7fd3d405a700 1 -- 172.21.15.155:0/1394953708 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c5c915c80 con 0x556c5c875400 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.417+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556c5c89c820 con 0x556c5c875400 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.417+0000 7fd3d405a700 1 -- 172.21.15.155:0/1394953708 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5c92d600 con 0x556c5c875400 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.417+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c5c89c9c0 con 0x556c5c875400 2024-04-19T23:45:40.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.418+0000 7fd3d405a700 1 -- 172.21.15.155:0/1394953708 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x556c5d616dc0 con 0x556c5c875400 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.418+0000 7fd3d405a700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cc04c00 0x556c5cb5d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.418+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.418+0000 7fd3d405a700 1 -- 172.21.15.155:0/1394953708 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x556c5c8ef340 con 0x556c5c875400 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.418+0000 7fd3da867700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cc04c00 0x556c5cb5d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.418+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x556c5c875800 0x556c5cb5db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.418+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5c875c00 con 0x556c5c875800 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.418+0000 7fd3db869700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x556c5c875800 0x556c5cb5db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3da867700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cc04c00 0x556c5cb5d600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x556c5cb57890 tx=0x556c5c965800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3db869700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x556c5c875800 0x556c5cb5db80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3dd0bea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3dd0bea80 20 realm 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cc05000 con 0x556c5c875800 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3dd0bea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3dd0bea80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cc05400 con 0x556c5c875800 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.419+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3dd0bea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cc05800 con 0x556c5c875800 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3dd0bea80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cc05c00 con 0x556c5c875800 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3dd0bea80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3dd0bea80 20 searching for the correct realm 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x556c5cc05000 0x556c5cb5e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cc05400 con 0x556c5cc05000 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.420+0000 7fd3db068700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x556c5cc05000 0x556c5cb5e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.421+0000 7fd3db068700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x556c5cc05000 0x556c5cb5e100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.421+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.421+0000 7fd3db068700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x556c5cc05400 0x556c5cb5ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.421+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc000 con 0x556c5cc05400 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.421+0000 7fd3da867700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x556c5cc05400 0x556c5cb5ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.422+0000 7fd3da867700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x556c5cc05400 0x556c5cb5ec00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.422+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.422+0000 7fd3da867700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x556c5ccbc000 0x556c5cb5f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.422+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5ccbc000 2024-04-19T23:45:40.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.422+0000 7fd3db869700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x556c5ccbc000 0x556c5cb5f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.423+0000 7fd3db869700 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x556c5ccbc000 0x556c5cb5f180 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.423+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.423+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5c875800 2024-04-19T23:45:40.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.423+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.423+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5c875800 2024-04-19T23:45:40.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.423+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.423+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5ccbc000 2024-04-19T23:45:40.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.424+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.424+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5ccbc000 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.424+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.424+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05400 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.424+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.424+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05000 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.424+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.424+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5c875800 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.425+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.425+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5ccbc000 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.425+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.425+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5c875800 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.425+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.425+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05400 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.425+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.425+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05000 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.426+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.426+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05000 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.426+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.426+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5ccbc000 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.426+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.426+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05000 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.426+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.426+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05000 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.427+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.427+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5c875800 2024-04-19T23:45:40.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.427+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.427+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5c875800 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.427+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.427+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5ccbc000 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.428+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.428+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05000 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.428+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.428+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05400 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.428+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.428+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5c875800 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.428+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.428+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5ccbc000 2024-04-19T23:45:40.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.429+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.429+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05000 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.429+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.429+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5ccbc000 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.429+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.429+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05400 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.429+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.429+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05000 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5ccbc000 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5c875800 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05400 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3dd0bea80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3dd0bea80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3dd0bea80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3dd0bea80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.430+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5c875c00 con 0x556c5c875800 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbcc00 con 0x556c5c875800 2024-04-19T23:45:40.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbd000 con 0x556c5cc05400 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 20 zone default found 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 4 Realm: () 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 20 zonegroup default 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbd400 con 0x556c5ccbc000 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.431+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3dd0bea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbd800 con 0x556c5cc05000 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3dd0bea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbdc00 con 0x556c5cc05000 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3dd0bea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3dd0bea80 20 started sync module instance, tier type = 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3dd0bea80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:40.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.432+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbcc00 con 0x556c5cc05400 2024-04-19T23:45:40.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.433+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.433+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93923900209920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5c875c00 con 0x556c5cc05400 2024-04-19T23:45:40.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.433+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cc05800 con 0x556c5c875800 2024-04-19T23:45:40.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.434+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93923900209920] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.435+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.435+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93923900211072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cc05c00 con 0x556c5c875800 2024-04-19T23:45:40.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.435+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5cc05000 2024-04-19T23:45:40.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.436+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93923900211072] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.436+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.436+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93923900212224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbd000 con 0x556c5cc05000 2024-04-19T23:45:40.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.436+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbcc00 con 0x556c5cc05400 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.437+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.437+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93923900213376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc400 con 0x556c5cc05400 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.437+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbd800 con 0x556c5c875800 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.437+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93923900212224] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.438+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.438+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93923900213376] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.438+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93923900214528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbdc00 con 0x556c5c875800 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.438+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbc800 con 0x556c5ccbc000 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.439+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.439+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93923900215680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbd400 con 0x556c5ccbc000 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.439+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbd800 con 0x556c5ccbc000 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.439+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93923900214528] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.440+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93923900215680] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.441+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.441+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93923900216832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbdc00 con 0x556c5ccbc000 2024-04-19T23:45:40.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.441+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cc05800 con 0x556c5ccbc000 2024-04-19T23:45:40.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.442+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93923900216832] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.442+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.442+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93923900217984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cc05c00 con 0x556c5ccbc000 2024-04-19T23:45:40.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.442+0000 7fd3dd0bea80 20 add_watcher() i=0 2024-04-19T23:45:40.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.442+0000 7fd3dd0bea80 20 add_watcher() i=1 2024-04-19T23:45:40.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.442+0000 7fd3dd0bea80 20 add_watcher() i=2 2024-04-19T23:45:40.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.442+0000 7fd3dd0bea80 20 add_watcher() i=3 2024-04-19T23:45:40.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.442+0000 7fd3dd0bea80 20 add_watcher() i=4 2024-04-19T23:45:40.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.442+0000 7fd3dd0bea80 20 add_watcher() i=5 2024-04-19T23:45:40.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.442+0000 7fd3dd0bea80 20 add_watcher() i=6 2024-04-19T23:45:40.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.443+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93923900217984] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.443+0000 7fd3dd0bea80 20 add_watcher() i=7 2024-04-19T23:45:40.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.443+0000 7fd3dd0bea80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:40.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.443+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cc05800 con 0x556c5c875800 2024-04-19T23:45:40.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.443+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.443+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93923901751296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cc05c00 con 0x556c5c875800 2024-04-19T23:45:40.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.444+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93923901751296] v30'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.444+0000 7fd3c2036700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.444+0000 7fd3dd0bea80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:40.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.444+0000 7fd3dd0bea80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:40.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.444+0000 7fd3dd0bea80 1 Processor -- start 2024-04-19T23:45:40.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.444+0000 7fd3dd0bea80 1 -- start start 2024-04-19T23:45:40.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.444+0000 7fd3dd0bea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.444+0000 7fd3dd0bea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5c8b0780 con 0x556c5ccbd400 2024-04-19T23:45:40.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.445+0000 7fd3da867700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.445+0000 7fd3da867700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35798/0 (socket says 172.21.15.155:35798) 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.445+0000 7fd3da867700 1 -- 172.21.15.155:0/2534134648 learned_addr learned my addr 172.21.15.155:0/2534134648 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.445+0000 7fd3da867700 1 -- 172.21.15.155:0/2534134648 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c5c89cb60 con 0x556c5ccbd400 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.445+0000 7fd3da867700 1 --2- 172.21.15.155:0/2534134648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x556c5cc02d50 tx=0x556c5cbcb6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f2b1cb0722f2fb server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.445+0000 7fd3c1835700 1 -- 172.21.15.155:0/2534134648 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5c92d760 con 0x556c5ccbd400 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.445+0000 7fd3c1835700 1 -- 172.21.15.155:0/2534134648 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c5cce4000 con 0x556c5ccbd400 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.445+0000 7fd3c1835700 1 -- 172.21.15.155:0/2534134648 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5cce6000 con 0x556c5ccbd400 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.446+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/2534134648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 msgr2=0x556c5cb5e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.446+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/2534134648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x556c5cc02d50 tx=0x556c5cbcb6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.446+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/2534134648 shutdown_connections 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.446+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/2534134648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.446+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/2534134648 >> 172.21.15.155:0/2534134648 conn(0x556c5ccbc800 msgr2=0x556c5c962000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.446+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/2534134648 shutdown_connections 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.446+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/2534134648 wait complete. 2024-04-19T23:45:40.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.446+0000 7fd3dd0bea80 1 Processor -- start 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3dd0bea80 1 -- start start 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3dd0bea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3dd0bea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5c916000 con 0x556c5ccbd400 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3da867700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3da867700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35808/0 (socket says 172.21.15.155:35808) 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3da867700 1 -- 172.21.15.155:0/4076782660 learned_addr learned my addr 172.21.15.155:0/4076782660 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3da867700 1 -- 172.21.15.155:0/4076782660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c5c89cd00 con 0x556c5ccbd400 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3da867700 1 --2- 172.21.15.155:0/4076782660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x556c5ccd1200 tx=0x556c5cbcb800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3c0032700 1 -- 172.21.15.155:0/4076782660 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5cce6160 con 0x556c5ccbd400 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3c0032700 1 -- 172.21.15.155:0/4076782660 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c5cce4180 con 0x556c5ccbd400 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4076782660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556c5c89c340 con 0x556c5ccbd400 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.447+0000 7fd3c0032700 1 -- 172.21.15.155:0/4076782660 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556c5cce62c0 con 0x556c5ccbd400 2024-04-19T23:45:40.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.448+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4076782660 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c5c89dd40 con 0x556c5ccbd400 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.448+0000 7fd3c0032700 1 -- 172.21.15.155:0/4076782660 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x556c5d617b80 con 0x556c5ccbd400 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.448+0000 7fd3c0032700 1 --2- 172.21.15.155:0/4076782660 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cd60000 0x556c5cb5f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.448+0000 7fd3c0032700 1 -- 172.21.15.155:0/4076782660 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x556c5c8ef500 con 0x556c5ccbd400 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.448+0000 7fd3db869700 1 --2- 172.21.15.155:0/4076782660 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cd60000 0x556c5cb5f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.448+0000 7fd3dd0bea80 5 note: GC not initialized 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.449+0000 7fd3db869700 1 --2- 172.21.15.155:0/4076782660 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cd60000 0x556c5cb5f700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x556c5d70e150 tx=0x556c5cbca0c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.449+0000 7fd3bd82d700 20 reqs_thread_entry: start 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.449+0000 7fd3dd0bea80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.449+0000 7fd3dd0bea80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.449+0000 7fd3bb829700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:10 2024 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.450+0000 7fd3bb007700 20 reqs_thread_entry: start 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.450+0000 7fd3dd0bea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.450+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbdc00 con 0x556c5cc05400 2024-04-19T23:45:40.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.450+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.450+0000 7fd3dd0bea80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.451+0000 7fd3c2036700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.451+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93923901751296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cd60400 con 0x556c5c875800 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.452+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93923901751296] v30'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.452+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93923900209920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cd60800 con 0x556c5cc05400 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.453+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93923900209920] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.453+0000 7fd3dd0bea80 20 remove_watcher() i=0 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.453+0000 7fd3dd0bea80 2 removed watcher, disabling cache 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.453+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93923900211072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cd60c00 con 0x556c5c875800 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.454+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93923900211072] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.454+0000 7fd3dd0bea80 20 remove_watcher() i=1 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.454+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93923900212224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cd61000 con 0x556c5cc05000 2024-04-19T23:45:40.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.455+0000 7fd3db068700 1 -- 172.21.15.155:0/1394953708 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93923900212224] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccab200 con 0x556c5cc05000 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.455+0000 7fd3dd0bea80 20 remove_watcher() i=2 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.455+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93923900213376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cd61400 con 0x556c5cc05400 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.456+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93923900213376] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccab440 con 0x556c5cc05400 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.456+0000 7fd3dd0bea80 20 remove_watcher() i=3 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.456+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93923900214528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cd61800 con 0x556c5c875800 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.457+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93923900214528] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5c875800 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.457+0000 7fd3dd0bea80 20 remove_watcher() i=4 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.457+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93923900215680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cd61c00 con 0x556c5ccbc000 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.458+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93923900215680] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.458+0000 7fd3dd0bea80 20 remove_watcher() i=5 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.458+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93923900216832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5cd60800 con 0x556c5ccbc000 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.459+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93923900216832] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.459+0000 7fd3dd0bea80 20 remove_watcher() i=6 2024-04-19T23:45:40.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.459+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93923900217984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c5ccbcc00 con 0x556c5ccbc000 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3db869700 1 -- 172.21.15.155:0/1394953708 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93923900217984] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556c5ccaab40 con 0x556c5ccbc000 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 20 remove_watcher() i=7 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x556c5ccbc000 msgr2=0x556c5cb5f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x556c5ccbc000 0x556c5cb5f180 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x556c5c875800 msgr2=0x556c5cb5db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x556c5c875800 0x556c5cb5db80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x556c5cc05400 msgr2=0x556c5cb5ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x556c5cc05400 0x556c5cb5ec00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x556c5cc05000 msgr2=0x556c5cb5e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x556c5cc05000 0x556c5cb5e100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cc04c00 msgr2=0x556c5cb5d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cc04c00 0x556c5cb5d600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x556c5cb57890 tx=0x556c5c965800 comp rx=0 tx=0).stop 2024-04-19T23:45:40.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 msgr2=0x556c5cb5cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1394953708 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c875400 0x556c5cb5cb00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x556c5d645f80 tx=0x556c5cbca8a0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 reap_dead start 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3da867700 1 -- 172.21.15.155:0/1394953708 reap_dead start 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 shutdown_connections 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.460+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 >> 172.21.15.155:0/1394953708 conn(0x556c5c874c00 msgr2=0x556c5c961800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 shutdown_connections 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1394953708 wait complete. 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4076782660 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cd60000 msgr2=0x556c5cb5f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/4076782660 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cd60000 0x556c5cb5f700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x556c5d70e150 tx=0x556c5cbca0c0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4076782660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 msgr2=0x556c5cb5e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/4076782660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x556c5ccd1200 tx=0x556c5cbcb800 comp rx=0 tx=0).stop 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4076782660 shutdown_connections 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/4076782660 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cd60000 0x556c5cb5f700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/4076782660 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5ccbd400 0x556c5cb5e680 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4076782660 >> 172.21.15.155:0/4076782660 conn(0x556c5ccbc800 msgr2=0x556c5c962000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4076782660 shutdown_connections 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/4076782660 wait complete. 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1043649684 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cc04000 msgr2=0x556c5cb5d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1043649684 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cc04000 0x556c5cb5d080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x556c5d70ef30 tx=0x556c5cbca240 comp rx=0 tx=0).stop 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1043649684 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 msgr2=0x556c5cb5c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1043649684 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x556c5d645e30 tx=0x556c5c965a40 comp rx=0 tx=0).stop 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1043649684 shutdown_connections 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1043649684 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x556c5cc04000 0x556c5cb5d080 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 --2- 172.21.15.155:0/1043649684 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x556c5c874800 0x556c5cb5c580 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1043649684 >> 172.21.15.155:0/1043649684 conn(0x556c5c874400 msgr2=0x556c5c961000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1043649684 shutdown_connections 2024-04-19T23:45:40.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.461+0000 7fd3dd0bea80 1 -- 172.21.15.155:0/1043649684 wait complete. 2024-04-19T23:45:40.477 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:40.477 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "bucket:myfoo", 2024-04-19T23:45:40.477 INFO:teuthology.orchestra.run.smithi155.stdout: "ver": { 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "tag": "_Xu6vqP8OaDoj969FLN5wAqI", 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "ver": 2 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2024-04-19T23:45:40.208009Z", 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "data": { 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": { 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "myfoo", 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "marker": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "tenant": "", 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "explicit_placement": { 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": "", 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "", 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": "" 2024-04-19T23:45:40.478 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:40.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:40.479 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:45:40.479 INFO:teuthology.orchestra.run.smithi155.stdout: "creation_time": "2024-04-19T23:45:39.164552Z", 2024-04-19T23:45:40.479 INFO:teuthology.orchestra.run.smithi155.stdout: "linked": false, 2024-04-19T23:45:40.479 INFO:teuthology.orchestra.run.smithi155.stdout: "has_bucket_info": false 2024-04-19T23:45:40.479 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:40.479 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:40.479 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_Xu6vqP8OaDoj969FLN5wAqI', 'ver': 2}, 'mtime': '2024-04-19T23:45:40.208009Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'bucket_id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-04-19T23:45:39.164552Z', 'linked': False, 'has_bucket_info': False}} 2024-04-19T23:45:40.479 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1'] 2024-04-19T23:45:40.479 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1'] 2024-04-19T23:45:40.479 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:40.529 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.530+0000 7f5cdd4baa80 1 Processor -- start 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.530+0000 7f5cdd4baa80 1 -- start start 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.530+0000 7f5cdd4baa80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5578f9c80800 0x5578f9f68580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.530+0000 7f5cdd4baa80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5578f9fab500 con 0x5578f9c80c00 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.530+0000 7f5cdd4baa80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5578f9d22a00 con 0x5578f9c80800 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.531+0000 7f5cdac63700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5578f9c80c00 0x5578f9d6c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46752/0 (socket says 172.21.15.155:46752) 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.531+0000 7f5cdac63700 1 -- 172.21.15.155:0/2353718759 learned_addr learned my addr 172.21.15.155:0/2353718759 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.531+0000 7f5cdb464700 1 --2- 172.21.15.155:0/2353718759 >> v2:172.21.15.76:3300/0 conn(0x5578f9c80800 0x5578f9f68580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.531+0000 7f5cda462700 1 -- 172.21.15.155:0/2353718759 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635194058 0 0) 0x5578faa4e000 con 0x5578f9c80c00 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.531+0000 7f5cda462700 1 -- 172.21.15.155:0/2353718759 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5578f9fab680 con 0x5578f9c80c00 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.531+0000 7f5cdb464700 1 -- 172.21.15.155:0/2353718759 >> v1:172.21.15.76:6789/0 conn(0x5578f9c80c00 legacy=0x5578f9d6c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.531+0000 7f5cdb464700 1 -- 172.21.15.155:0/2353718759 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578f9ca9d40 con 0x5578f9c80800 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.531+0000 7f5cdb464700 1 --2- 172.21.15.155:0/2353718759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x5578f9f639e0 tx=0x5578f9d71980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c64703c3aaa9ca server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.531+0000 7f5cda462700 1 -- 172.21.15.155:0/2353718759 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578f9d394a0 con 0x5578f9c80800 2024-04-19T23:45:40.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.531+0000 7f5cda462700 1 -- 172.21.15.155:0/2353718759 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578f9fab500 con 0x5578f9c80800 2024-04-19T23:45:40.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.531+0000 7f5cda462700 1 -- 172.21.15.155:0/2353718759 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578f9d39600 con 0x5578f9c80800 2024-04-19T23:45:40.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.532+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2353718759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 msgr2=0x5578f9f68580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.532+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/2353718759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x5578f9f639e0 tx=0x5578f9d71980 comp rx=0 tx=0).stop 2024-04-19T23:45:40.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.532+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2353718759 shutdown_connections 2024-04-19T23:45:40.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.532+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/2353718759 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.532+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2353718759 >> 172.21.15.155:0/2353718759 conn(0x5578f9c80400 msgr2=0x5578f9d6c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.532+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2353718759 shutdown_connections 2024-04-19T23:45:40.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.532+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2353718759 wait complete. 2024-04-19T23:45:40.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.532+0000 7f5cdd4baa80 1 Processor -- start 2024-04-19T23:45:40.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.532+0000 7f5cdd4baa80 1 -- start start 2024-04-19T23:45:40.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.532+0000 7f5cdd4baa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.532+0000 7f5cdd4baa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f9d22500 con 0x5578f9c80800 2024-04-19T23:45:40.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.533+0000 7f5cdb464700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.533+0000 7f5cdb464700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35824/0 (socket says 172.21.15.155:35824) 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.533+0000 7f5cdb464700 1 -- 172.21.15.155:0/3735500823 learned_addr learned my addr 172.21.15.155:0/3735500823 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.533+0000 7f5cdb464700 1 -- 172.21.15.155:0/3735500823 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578f9ca9ba0 con 0x5578f9c80800 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.533+0000 7f5cdb464700 1 --2- 172.21.15.155:0/3735500823 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x5578faa51e00 tx=0x5578f9d71800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63d895d4b17a7b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.533+0000 7f5cd9c61700 1 -- 172.21.15.155:0/3735500823 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578f9d39760 con 0x5578f9c80800 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.533+0000 7f5cd9c61700 1 -- 172.21.15.155:0/3735500823 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578f9fab980 con 0x5578f9c80800 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.533+0000 7f5cd9c61700 1 -- 172.21.15.155:0/3735500823 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578f9d394a0 con 0x5578f9c80800 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.533+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3735500823 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 msgr2=0x5578f9f68580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.533+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/3735500823 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x5578faa51e00 tx=0x5578f9d71800 comp rx=0 tx=0).stop 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3735500823 shutdown_connections 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/3735500823 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3735500823 >> 172.21.15.155:0/3735500823 conn(0x5578f9c80400 msgr2=0x5578f9d6d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3735500823 shutdown_connections 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3735500823 wait complete. 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdd4baa80 1 Processor -- start 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdd4baa80 1 -- start start 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdd4baa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdd4baa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f9d223c0 con 0x5578f9c80800 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdb464700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdb464700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35838/0 (socket says 172.21.15.155:35838) 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.534+0000 7f5cdb464700 1 -- 172.21.15.155:0/2599690320 learned_addr learned my addr 172.21.15.155:0/2599690320 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.535+0000 7f5cdb464700 1 -- 172.21.15.155:0/2599690320 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578f9ca9a00 con 0x5578f9c80800 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.535+0000 7f5cdb464700 1 --2- 172.21.15.155:0/2599690320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x5578faa51f20 tx=0x5578f9d71980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.535+0000 7f5cd845e700 1 -- 172.21.15.155:0/2599690320 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578f9d39600 con 0x5578f9c80800 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.535+0000 7f5cd845e700 1 -- 172.21.15.155:0/2599690320 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578f9fabb00 con 0x5578f9c80800 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.535+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2599690320 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5578f9ca9860 con 0x5578f9c80800 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.535+0000 7f5cd845e700 1 -- 172.21.15.155:0/2599690320 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578f9d398c0 con 0x5578f9c80800 2024-04-19T23:45:40.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.535+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2599690320 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578f9ca96c0 con 0x5578f9c80800 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cdd4baa80 1 Processor -- start 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cdd4baa80 1 -- start start 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cd845e700 1 -- 172.21.15.155:0/2599690320 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5578faa22b00 con 0x5578f9c80800 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cdd4baa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 0x5578f9f68b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cdd4baa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f9cbc640 con 0x5578f9c81400 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cd845e700 1 --2- 172.21.15.155:0/2599690320 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa002000 0x5578f9f69080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cd845e700 1 -- 172.21.15.155:0/2599690320 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5578f9cfb180 con 0x5578f9c80800 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cdbc65700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 0x5578f9f68b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cdb464700 1 --2- 172.21.15.155:0/2599690320 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa002000 0x5578f9f69080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cdbc65700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 0x5578f9f68b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35840/0 (socket says 172.21.15.155:35840) 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cdbc65700 1 -- 172.21.15.155:0/3353664608 learned_addr learned my addr 172.21.15.155:0/3353664608 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cdbc65700 1 -- 172.21.15.155:0/3353664608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578f9ca8000 con 0x5578f9c81400 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cdb464700 1 --2- 172.21.15.155:0/2599690320 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa002000 0x5578f9f69080 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5578faaf9590 tx=0x5578f9fc8540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.536+0000 7f5cdbc65700 1 --2- 172.21.15.155:0/3353664608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 0x5578f9f68b00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x5578faaf8390 tx=0x5578f9fc8720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbb37a49997f74f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cd5c59700 1 -- 172.21.15.155:0/3353664608 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578f9d39600 con 0x5578f9c81400 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cd5c59700 1 -- 172.21.15.155:0/3353664608 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578f9d21c80 con 0x5578f9c81400 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cd5c59700 1 -- 172.21.15.155:0/3353664608 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578f9d398c0 con 0x5578f9c81400 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3353664608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 msgr2=0x5578f9f68b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/3353664608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 0x5578f9f68b00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x5578faaf8390 tx=0x5578f9fc8720 comp rx=0 tx=0).stop 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3353664608 shutdown_connections 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/3353664608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 0x5578f9f68b00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3353664608 >> 172.21.15.155:0/3353664608 conn(0x5578f9c80c00 msgr2=0x5578f9d6d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3353664608 shutdown_connections 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3353664608 wait complete. 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cdd4baa80 1 Processor -- start 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cdd4baa80 1 -- start start 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cdd4baa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 0x5578f9f68b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.537+0000 7f5cdd4baa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f9cbc8c0 con 0x5578f9c81400 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.538+0000 7f5cdbc65700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 0x5578f9f68b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.538+0000 7f5cdbc65700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 0x5578f9f68b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35854/0 (socket says 172.21.15.155:35854) 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.538+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 learned_addr learned my addr 172.21.15.155:0/601416709 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.538+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578f9ca8ea0 con 0x5578f9c81400 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.538+0000 7f5cdbc65700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 0x5578f9f68b00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x5578faaf83f0 tx=0x5578f9d718c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.538+0000 7f5cd4456700 1 -- 172.21.15.155:0/601416709 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578f9d39760 con 0x5578f9c81400 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.538+0000 7f5cd4456700 1 -- 172.21.15.155:0/601416709 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578f9d21b00 con 0x5578f9c81400 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.538+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5578f9ca8820 con 0x5578f9c81400 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.538+0000 7f5cd4456700 1 -- 172.21.15.155:0/601416709 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578f9d39600 con 0x5578f9c81400 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.538+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578f9ca89c0 con 0x5578f9c81400 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.539+0000 7f5cd4456700 1 -- 172.21.15.155:0/601416709 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5578faa22dc0 con 0x5578f9c81400 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.539+0000 7f5cd4456700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa002c00 0x5578f9f69600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.539+0000 7f5cd4456700 1 -- 172.21.15.155:0/601416709 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5578f9cfb340 con 0x5578f9c81400 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.539+0000 7f5cdac63700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa002c00 0x5578f9f69600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.539+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.539+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5578f9c81800 0x5578f9f69b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.539+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578f9c81c00 con 0x5578f9c81800 2024-04-19T23:45:40.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.539+0000 7f5cdbc65700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5578f9c81800 0x5578f9f69b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdac63700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa002c00 0x5578f9f69600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5578faa50030 tx=0x5578f9fc9320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdbc65700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5578f9c81800 0x5578f9f69b80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdd4baa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdd4baa80 20 realm 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003000 con 0x5578f9c81800 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdd4baa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdd4baa80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003400 con 0x5578f9c81800 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdd4baa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.540+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003800 con 0x5578f9c81800 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.541+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.541+0000 7f5cdd4baa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.541+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.541+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003c00 con 0x5578f9c81800 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.541+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.541+0000 7f5cdd4baa80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.541+0000 7f5cdd4baa80 20 searching for the correct realm 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.541+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5578fa003000 0x5578f9f6a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.541+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003400 con 0x5578fa003000 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.541+0000 7f5cdb464700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5578fa003000 0x5578f9f6a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.541+0000 7f5cdb464700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5578fa003000 0x5578f9f6a100 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.542+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.542+0000 7f5cdb464700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5578fa003400 0x5578f9f6ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.542+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c000 con 0x5578fa003400 2024-04-19T23:45:40.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.542+0000 7f5cdac63700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5578fa003400 0x5578f9f6ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.542+0000 7f5cdac63700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5578fa003400 0x5578f9f6ac00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.542+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.542+0000 7f5cdac63700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5578fab1c000 0x5578f9f6b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.542+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fab1c000 2024-04-19T23:45:40.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.543+0000 7f5cdbc65700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5578fab1c000 0x5578f9f6b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.543+0000 7f5cdbc65700 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5578fab1c000 0x5578f9f6b180 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.543+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.543+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578f9c81800 2024-04-19T23:45:40.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.544+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.544+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578f9c81800 2024-04-19T23:45:40.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.544+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.544+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fab1c000 2024-04-19T23:45:40.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.544+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.544+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fab1c000 2024-04-19T23:45:40.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.544+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.544+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003400 2024-04-19T23:45:40.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.545+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.545+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003000 2024-04-19T23:45:40.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.545+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.545+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578f9c81800 2024-04-19T23:45:40.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.545+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.545+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fab1c000 2024-04-19T23:45:40.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.545+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.545+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578f9c81800 2024-04-19T23:45:40.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.546+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.546+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003400 2024-04-19T23:45:40.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.546+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.546+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003000 2024-04-19T23:45:40.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.546+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.546+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003000 2024-04-19T23:45:40.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.546+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.546+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fab1c000 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.546+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.546+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003000 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.547+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.547+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003000 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.547+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.547+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578f9c81800 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.547+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.547+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578f9c81800 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.547+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.547+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fab1c000 2024-04-19T23:45:40.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.548+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.548+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003000 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.548+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.548+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003400 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.548+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.548+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578f9c81800 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.548+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.548+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fab1c000 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.549+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.549+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003000 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.549+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.549+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fab1c000 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.549+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.549+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003400 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.549+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.549+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003000 2024-04-19T23:45:40.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fab1c000 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578f9c81800 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003400 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdd4baa80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdd4baa80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdd4baa80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdd4baa80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.550+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578f9c81c00 con 0x5578f9c81800 2024-04-19T23:45:40.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1cc00 con 0x5578f9c81800 2024-04-19T23:45:40.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1d000 con 0x5578fa003400 2024-04-19T23:45:40.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:40.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 20 zone default found 2024-04-19T23:45:40.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 4 Realm: () 2024-04-19T23:45:40.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:40.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:40.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:40.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 20 zonegroup default 2024-04-19T23:45:40.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1d400 con 0x5578fab1c000 2024-04-19T23:45:40.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.551+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1d800 con 0x5578fa003000 2024-04-19T23:45:40.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.552+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.552+0000 7f5cdd4baa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.552+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.552+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1dc00 con 0x5578fa003000 2024-04-19T23:45:40.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.552+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.552+0000 7f5cdd4baa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.552+0000 7f5cdd4baa80 20 started sync module instance, tier type = 2024-04-19T23:45:40.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.552+0000 7f5cdd4baa80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:40.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.552+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1cc00 con 0x5578fa003400 2024-04-19T23:45:40.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.553+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.553+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93978078083840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578f9c81c00 con 0x5578fa003400 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.553+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003800 con 0x5578f9c81800 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.554+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93978078083840] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.554+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.554+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93978078084992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003c00 con 0x5578f9c81800 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.554+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fa003000 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.555+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.555+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93978078086144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1d000 con 0x5578fa003000 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.555+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1cc00 con 0x5578fa003400 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.556+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93978078084992] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.556+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93978078086144] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.556+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.556+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93978078087296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c400 con 0x5578fa003400 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.556+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1d800 con 0x5578f9c81800 2024-04-19T23:45:40.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.557+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93978078087296] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.557+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.557+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93978078088448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1dc00 con 0x5578f9c81800 2024-04-19T23:45:40.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.557+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1c800 con 0x5578fab1c000 2024-04-19T23:45:40.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.558+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.558+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93978078089600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1d400 con 0x5578fab1c000 2024-04-19T23:45:40.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.558+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1d800 con 0x5578fab1c000 2024-04-19T23:45:40.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.559+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93978078088448] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.559+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93978078089600] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.559+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.559+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93978078090752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1dc00 con 0x5578fab1c000 2024-04-19T23:45:40.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.559+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003800 con 0x5578fab1c000 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.560+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.560+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93978078090752] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.560+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93978078091904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003c00 con 0x5578fab1c000 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.560+0000 7f5cdd4baa80 20 add_watcher() i=0 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.560+0000 7f5cdd4baa80 20 add_watcher() i=1 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.560+0000 7f5cdd4baa80 20 add_watcher() i=2 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.560+0000 7f5cdd4baa80 20 add_watcher() i=3 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.560+0000 7f5cdd4baa80 20 add_watcher() i=4 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.560+0000 7f5cdd4baa80 20 add_watcher() i=5 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.560+0000 7f5cdd4baa80 20 add_watcher() i=6 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.561+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93978078091904] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.561+0000 7f5cdd4baa80 20 add_watcher() i=7 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.561+0000 7f5cdd4baa80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.561+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003800 con 0x5578f9c81800 2024-04-19T23:45:40.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.562+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.562+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93978079600640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003c00 con 0x5578f9c81800 2024-04-19T23:45:40.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.563+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93978079600640] v30'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.563+0000 7f5cc2432700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.563+0000 7f5cdd4baa80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:40.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.563+0000 7f5cdd4baa80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:40.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.563+0000 7f5cdd4baa80 1 Processor -- start 2024-04-19T23:45:40.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.563+0000 7f5cdd4baa80 1 -- start start 2024-04-19T23:45:40.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.563+0000 7f5cdd4baa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.563+0000 7f5cdd4baa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f9d223c0 con 0x5578fab1d400 2024-04-19T23:45:40.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.563+0000 7f5cdac63700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.563+0000 7f5cdac63700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35860/0 (socket says 172.21.15.155:35860) 2024-04-19T23:45:40.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.563+0000 7f5cdac63700 1 -- 172.21.15.155:0/3741761567 learned_addr learned my addr 172.21.15.155:0/3741761567 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.564+0000 7f5cdac63700 1 -- 172.21.15.155:0/3741761567 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578f9ca8b60 con 0x5578fab1d400 2024-04-19T23:45:40.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.564+0000 7f5cdac63700 1 --2- 172.21.15.155:0/3741761567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x5578fa0da0c0 tx=0x5578f9fc9680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3153049d3d5ca3ec server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.564+0000 7f5cc1c31700 1 -- 172.21.15.155:0/3741761567 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578fa0ec000 con 0x5578fab1d400 2024-04-19T23:45:40.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.564+0000 7f5cc1c31700 1 -- 172.21.15.155:0/3741761567 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578fa0e0180 con 0x5578fab1d400 2024-04-19T23:45:40.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.564+0000 7f5cc1c31700 1 -- 172.21.15.155:0/3741761567 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578fa0ec160 con 0x5578fab1d400 2024-04-19T23:45:40.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3741761567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 msgr2=0x5578f9f6a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/3741761567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x5578fa0da0c0 tx=0x5578f9fc9680 comp rx=0 tx=0).stop 2024-04-19T23:45:40.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3741761567 shutdown_connections 2024-04-19T23:45:40.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/3741761567 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3741761567 >> 172.21.15.155:0/3741761567 conn(0x5578fab1c800 msgr2=0x5578f9d6e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3741761567 shutdown_connections 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/3741761567 wait complete. 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdd4baa80 1 Processor -- start 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdd4baa80 1 -- start start 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdd4baa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdd4baa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578f9d22500 con 0x5578fab1d400 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdac63700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdac63700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35862/0 (socket says 172.21.15.155:35862) 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.565+0000 7f5cdac63700 1 -- 172.21.15.155:0/2406878527 learned_addr learned my addr 172.21.15.155:0/2406878527 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.566+0000 7f5cdac63700 1 -- 172.21.15.155:0/2406878527 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578f9ca8d00 con 0x5578fab1d400 2024-04-19T23:45:40.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.566+0000 7f5cdac63700 1 --2- 172.21.15.155:0/2406878527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x5578fa0da2d0 tx=0x5578f9fc97a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.566+0000 7f5cc042e700 1 -- 172.21.15.155:0/2406878527 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578fa0ec2c0 con 0x5578fab1d400 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.566+0000 7f5cc042e700 1 -- 172.21.15.155:0/2406878527 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578fa0e0300 con 0x5578fab1d400 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.566+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2406878527 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5578f9ca8340 con 0x5578fab1d400 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.566+0000 7f5cc042e700 1 -- 172.21.15.155:0/2406878527 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5578fa0ec000 con 0x5578fab1d400 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.566+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2406878527 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578f9ca8b60 con 0x5578fab1d400 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.567+0000 7f5cc042e700 1 -- 172.21.15.155:0/2406878527 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5578faa23b80 con 0x5578fab1d400 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.567+0000 7f5cc042e700 1 --2- 172.21.15.155:0/2406878527 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa16e000 0x5578f9f6b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.567+0000 7f5cc042e700 1 -- 172.21.15.155:0/2406878527 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5578f9cfb500 con 0x5578fab1d400 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.567+0000 7f5cdd4baa80 5 note: GC not initialized 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.567+0000 7f5cdbc65700 1 --2- 172.21.15.155:0/2406878527 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa16e000 0x5578f9f6b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.567+0000 7f5cdbc65700 1 --2- 172.21.15.155:0/2406878527 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa16e000 0x5578f9f6b700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5578f9fe8e40 tx=0x5578f9fc94a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.568+0000 7f5cbdc29700 20 reqs_thread_entry: start 2024-04-19T23:45:40.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.568+0000 7f5cdd4baa80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.568+0000 7f5cdd4baa80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.568+0000 7f5cbbc25700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:10 2024 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.568+0000 7f5cbb403700 20 reqs_thread_entry: start 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.568+0000 7f5cdd4baa80 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.568+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.568+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1dc00 con 0x5578fab1c000 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 20 rados_obj.operate() r=0 bl.length=346 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:45:40.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa16e400 con 0x5578fa003400 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 : miss 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.569+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa16e800 con 0x5578f9c81800 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.570+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(64 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.570+0000 7f5cdd4baa80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.570+0000 7f5cdd4baa80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:40.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.570+0000 7f5cdd4baa80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.570+0000 7f5cdd4baa80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.570+0000 7f5cdd4baa80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.570+0000 7f5cdd4baa80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.570+0000 7f5cdd4baa80 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.570+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa16ec00 con 0x5578fa003400 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.571+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.571+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa16f400 con 0x5578f9c81800 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.572+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(66 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.572+0000 7f5cdd4baa80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.572+0000 7f5cdd4baa80 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.572+0000 7f5cdd4baa80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:40.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.572+0000 7f5cdd4baa80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1, ofs0, ns] 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.572+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93978079602944 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa16fc00 con 0x5578fa003000 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 93978078086144 notify 128849018884 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x5578f9fc5ba0 con 0x5578fa003000 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cd5c59700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 93978078086144 notifier 4533 bl.length()=725 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cd5c59700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cd5c59700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cd5c59700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cd5c59700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa003800 con 0x5578fa003000 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(67 notify.2 [notify cookie 93978079602944 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== watch-notify(notify_complete (2) cookie 93978079602944 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5578f9fc5d40 con 0x5578fa003000 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cdd4baa80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_sources= new_sources= 2024-04-19T23:45:40.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cdd4baa80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential sources added=[] removed=[] 2024-04-19T23:45:40.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cdd4baa80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_dests= new_dests= 2024-04-19T23:45:40.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cdd4baa80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential dests added=[] removed=[] 2024-04-19T23:45:40.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.573+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa16e800 con 0x5578fab1c000 2024-04-19T23:45:40.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.574+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(69 fud.buckets [call] v30'1 uv1 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.574+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa16f800 con 0x5578fa003400 2024-04-19T23:45:40.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.575+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.575+0000 7f5cdd4baa80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-19T23:45:40.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.575+0000 7f5cdd4baa80 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.575+0000 7f5cdd4baa80 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-19T23:45:40.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.575+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93978079602944 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa16f000 con 0x5578fab1c000 2024-04-19T23:45:40.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.576+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== watch-notify(notify (1) cookie 93978078090752 notify 128849018892 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x5578fa069d40 con 0x5578fab1c000 2024-04-19T23:45:40.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.576+0000 7f5cd5458700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 93978078090752 notifier 4533 bl.length()=314 2024-04-19T23:45:40.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.576+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(71 notify.6 [notify cookie 93978079602944 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.576+0000 7f5cd5458700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-19T23:45:40.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.576+0000 7f5cd5458700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.576+0000 7f5cd5458700 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa1e4000 con 0x5578fab1c000 2024-04-19T23:45:40.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.576+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.576+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== watch-notify(notify_complete (2) cookie 93978079602944 notify 128849018892 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5578fa069a00 con 0x5578fab1c000 2024-04-19T23:45:40.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.577+0000 7f5cc2432700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.577+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93978079600640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1dc00 con 0x5578f9c81800 2024-04-19T23:45:40.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.578+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93978079600640] v30'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.578+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93978078083840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fab1cc00 con 0x5578fa003400 2024-04-19T23:45:40.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.579+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93978078083840] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.579+0000 7f5cdd4baa80 20 remove_watcher() i=0 2024-04-19T23:45:40.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.579+0000 7f5cdd4baa80 2 removed watcher, disabling cache 2024-04-19T23:45:40.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.579+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93978078084992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578f9c81c00 con 0x5578f9c81800 2024-04-19T23:45:40.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.580+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93978078084992] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.580+0000 7f5cdd4baa80 20 remove_watcher() i=1 2024-04-19T23:45:40.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.580+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93978078086144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa1e4400 con 0x5578fa003000 2024-04-19T23:45:40.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.581+0000 7f5cdb464700 1 -- 172.21.15.155:0/601416709 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93978078086144] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c3200 con 0x5578fa003000 2024-04-19T23:45:40.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.581+0000 7f5cdd4baa80 20 remove_watcher() i=2 2024-04-19T23:45:40.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.581+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93978078087296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa1e4800 con 0x5578fa003400 2024-04-19T23:45:40.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.582+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93978078087296] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c3440 con 0x5578fa003400 2024-04-19T23:45:40.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.582+0000 7f5cdd4baa80 20 remove_watcher() i=3 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.582+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93978078088448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa1e4c00 con 0x5578f9c81800 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.583+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93978078088448] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578f9c81800 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.583+0000 7f5cdd4baa80 20 remove_watcher() i=4 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.583+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93978078089600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa1e5000 con 0x5578fab1c000 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.583+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93978078089600] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.583+0000 7f5cdd4baa80 20 remove_watcher() i=5 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.583+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93978078090752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa1e5400 con 0x5578fab1c000 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.584+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93978078090752] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.584+0000 7f5cdd4baa80 20 remove_watcher() i=6 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.585+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93978078091904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5578fa1e5800 con 0x5578fab1c000 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdbc65700 1 -- 172.21.15.155:0/601416709 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93978078091904] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5578fa0c2b40 con 0x5578fab1c000 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 20 remove_watcher() i=7 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5578fab1c000 msgr2=0x5578f9f6b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5578fab1c000 0x5578f9f6b180 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5578f9c81800 msgr2=0x5578f9f69b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5578f9c81800 0x5578f9f69b80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5578fa003400 msgr2=0x5578f9f6ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5578fa003400 0x5578f9f6ac00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5578fa003000 msgr2=0x5578f9f6a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5578fa003000 0x5578f9f6a100 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa002c00 msgr2=0x5578f9f69600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa002c00 0x5578f9f69600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5578faa50030 tx=0x5578f9fc9320 comp rx=0 tx=0).stop 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 msgr2=0x5578f9f68b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/601416709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c81400 0x5578f9f68b00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x5578faaf83f0 tx=0x5578f9d718c0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 reap_dead start 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdac63700 1 -- 172.21.15.155:0/601416709 reap_dead start 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 shutdown_connections 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 >> 172.21.15.155:0/601416709 conn(0x5578f9c80c00 msgr2=0x5578f9d6d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 shutdown_connections 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.587+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/601416709 wait complete. 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2406878527 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa16e000 msgr2=0x5578f9f6b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/2406878527 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa16e000 0x5578f9f6b700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5578f9fe8e40 tx=0x5578f9fc94a0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2406878527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 msgr2=0x5578f9f6a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/2406878527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x5578fa0da2d0 tx=0x5578f9fc97a0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2406878527 shutdown_connections 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/2406878527 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa16e000 0x5578f9f6b700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/2406878527 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578fab1d400 0x5578f9f6a680 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2406878527 >> 172.21.15.155:0/2406878527 conn(0x5578fab1c800 msgr2=0x5578f9d6e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2406878527 shutdown_connections 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2406878527 wait complete. 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2599690320 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa002000 msgr2=0x5578f9f69080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/2599690320 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa002000 0x5578f9f69080 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5578faaf9590 tx=0x5578f9fc8540 comp rx=0 tx=0).stop 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2599690320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 msgr2=0x5578f9f68580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/2599690320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x5578faa51f20 tx=0x5578f9d71980 comp rx=0 tx=0).stop 2024-04-19T23:45:40.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2599690320 shutdown_connections 2024-04-19T23:45:40.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/2599690320 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5578fa002000 0x5578f9f69080 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 --2- 172.21.15.155:0/2599690320 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5578f9c80800 0x5578f9f68580 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2599690320 >> 172.21.15.155:0/2599690320 conn(0x5578f9c80400 msgr2=0x5578f9d6d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2599690320 shutdown_connections 2024-04-19T23:45:40.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.588+0000 7f5cdd4baa80 1 -- 172.21.15.155:0/2599690320 wait complete. 2024-04-19T23:45:40.609 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-19T23:45:40.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-19T23:45:40.609 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-19T23:45:40.654 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:40.655 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:40.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.655+0000 7f9ce8e93a80 1 Processor -- start 2024-04-19T23:45:40.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.655+0000 7f9ce8e93a80 1 -- start start 2024-04-19T23:45:40.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce8e93a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x558eb48d0c00 0x558eb4bb8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce8e93a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558eb4bfb500 con 0x558eb48d0800 2024-04-19T23:45:40.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce8e93a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x558eb4972a00 con 0x558eb48d0c00 2024-04-19T23:45:40.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce663c700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x558eb48d0c00 0x558eb4bb8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce6e3d700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x558eb48d0800 0x558eb49bc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46768/0 (socket says 172.21.15.155:46768) 2024-04-19T23:45:40.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/1723974869 learned_addr learned my addr 172.21.15.155:0/1723974869 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce5e3b700 1 -- 172.21.15.155:0/1723974869 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550255470 0 0) 0x558eb569e000 con 0x558eb48d0800 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce5e3b700 1 -- 172.21.15.155:0/1723974869 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x558eb4bfb680 con 0x558eb48d0800 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce663c700 1 -- 172.21.15.155:0/1723974869 >> v1:172.21.15.76:6789/0 conn(0x558eb48d0800 legacy=0x558eb49bc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce663c700 1 -- 172.21.15.155:0/1723974869 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eb48f9d40 con 0x558eb48d0c00 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce663c700 1 --2- 172.21.15.155:0/1723974869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0c00 0x558eb4bb8580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x558eb4bb3890 tx=0x558eb49c1980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fa56e8ccd9c23a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce5e3b700 1 -- 172.21.15.155:0/1723974869 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb49894a0 con 0x558eb48d0c00 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce5e3b700 1 -- 172.21.15.155:0/1723974869 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558eb4bfb500 con 0x558eb48d0c00 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.656+0000 7f9ce5e3b700 1 -- 172.21.15.155:0/1723974869 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb4989600 con 0x558eb48d0c00 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.657+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/1723974869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0c00 msgr2=0x558eb4bb8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.657+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/1723974869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0c00 0x558eb4bb8580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x558eb4bb3890 tx=0x558eb49c1980 comp rx=0 tx=0).stop 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.657+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/1723974869 shutdown_connections 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.657+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/1723974869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0c00 0x558eb4bb8580 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.657+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/1723974869 >> 172.21.15.155:0/1723974869 conn(0x558eb48d0400 msgr2=0x558eb49bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.657+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/1723974869 shutdown_connections 2024-04-19T23:45:40.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.657+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/1723974869 wait complete. 2024-04-19T23:45:40.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.658+0000 7f9ce8e93a80 1 Processor -- start 2024-04-19T23:45:40.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.658+0000 7f9ce8e93a80 1 -- start start 2024-04-19T23:45:40.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.658+0000 7f9ce8e93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.658+0000 7f9ce8e93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb4972500 con 0x558eb48d0800 2024-04-19T23:45:40.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.658+0000 7f9ce6e3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.658+0000 7f9ce6e3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35884/0 (socket says 172.21.15.155:35884) 2024-04-19T23:45:40.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.658+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/2863943842 learned_addr learned my addr 172.21.15.155:0/2863943842 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.659+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/2863943842 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eb48f9ba0 con 0x558eb48d0800 2024-04-19T23:45:40.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.660+0000 7f9ce6e3d700 1 --2- 172.21.15.155:0/2863943842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x558eb56a1770 tx=0x558eb49c1b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2569dc87fc77982 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.660+0000 7f9ce563a700 1 -- 172.21.15.155:0/2863943842 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb49891e0 con 0x558eb48d0800 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.660+0000 7f9ce563a700 1 -- 172.21.15.155:0/2863943842 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558eb4bfbb00 con 0x558eb48d0800 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.660+0000 7f9ce563a700 1 -- 172.21.15.155:0/2863943842 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb49894a0 con 0x558eb48d0800 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.660+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2863943842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 msgr2=0x558eb4bb8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.660+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/2863943842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x558eb56a1770 tx=0x558eb49c1b60 comp rx=0 tx=0).stop 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.660+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2863943842 shutdown_connections 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.660+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/2863943842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.660+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2863943842 >> 172.21.15.155:0/2863943842 conn(0x558eb48d0400 msgr2=0x558eb49bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.660+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2863943842 shutdown_connections 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.660+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2863943842 wait complete. 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.661+0000 7f9ce8e93a80 1 Processor -- start 2024-04-19T23:45:40.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.661+0000 7f9ce8e93a80 1 -- start start 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.661+0000 7f9ce8e93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.661+0000 7f9ce8e93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb49723c0 con 0x558eb48d0800 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.661+0000 7f9ce6e3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.661+0000 7f9ce6e3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35898/0 (socket says 172.21.15.155:35898) 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.661+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/2467053915 learned_addr learned my addr 172.21.15.155:0/2467053915 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.661+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/2467053915 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eb48f9a00 con 0x558eb48d0800 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.661+0000 7f9ce6e3d700 1 --2- 172.21.15.155:0/2467053915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x558eb56a1e30 tx=0x558eb49c1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.661+0000 7f9ce3e37700 1 -- 172.21.15.155:0/2467053915 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb4989600 con 0x558eb48d0800 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce3e37700 1 -- 172.21.15.155:0/2467053915 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558eb4971c80 con 0x558eb48d0800 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2467053915 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558eb48f9860 con 0x558eb48d0800 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce3e37700 1 -- 172.21.15.155:0/2467053915 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb49891e0 con 0x558eb48d0800 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2467053915 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558eb48f96c0 con 0x558eb48d0800 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce8e93a80 1 Processor -- start 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce3e37700 1 -- 172.21.15.155:0/2467053915 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558eb5672b00 con 0x558eb48d0800 2024-04-19T23:45:40.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce8e93a80 1 -- start start 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce3e37700 1 --2- 172.21.15.155:0/2467053915 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb48d1400 0x558eb4bb9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce3e37700 1 -- 172.21.15.155:0/2467053915 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558eb494b180 con 0x558eb48d0800 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce8e93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 0x558eb4bb8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce8e93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb490c640 con 0x558eb48d1800 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.662+0000 7f9ce763e700 1 --2- 172.21.15.155:0/2467053915 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb48d1400 0x558eb4bb9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.663+0000 7f9ce6e3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 0x558eb4bb8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.663+0000 7f9ce6e3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 0x558eb4bb8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35908/0 (socket says 172.21.15.155:35908) 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.663+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/2253305528 learned_addr learned my addr 172.21.15.155:0/2253305528 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.663+0000 7f9ce763e700 1 --2- 172.21.15.155:0/2467053915 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb48d1400 0x558eb4bb9080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x558eb56a1f20 tx=0x558eb4c22060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.663+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/2253305528 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eb48f8000 con 0x558eb48d1800 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.664+0000 7f9ce6e3d700 1 --2- 172.21.15.155:0/2253305528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 0x558eb4bb8b00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x558eb5760330 tx=0x558eb4c22240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a489968bf7e768f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.664+0000 7f9ce1632700 1 -- 172.21.15.155:0/2253305528 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb49894a0 con 0x558eb48d1800 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.664+0000 7f9ce1632700 1 -- 172.21.15.155:0/2253305528 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558eb4971e00 con 0x558eb48d1800 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.664+0000 7f9ce1632700 1 -- 172.21.15.155:0/2253305528 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb49898c0 con 0x558eb48d1800 2024-04-19T23:45:40.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.664+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2253305528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 msgr2=0x558eb4bb8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.664+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/2253305528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 0x558eb4bb8b00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x558eb5760330 tx=0x558eb4c22240 comp rx=0 tx=0).stop 2024-04-19T23:45:40.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.664+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2253305528 shutdown_connections 2024-04-19T23:45:40.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.664+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/2253305528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 0x558eb4bb8b00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.664+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2253305528 >> 172.21.15.155:0/2253305528 conn(0x558eb48d0c00 msgr2=0x558eb49bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.665+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2253305528 shutdown_connections 2024-04-19T23:45:40.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.665+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2253305528 wait complete. 2024-04-19T23:45:40.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.665+0000 7f9ce8e93a80 1 Processor -- start 2024-04-19T23:45:40.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.665+0000 7f9ce8e93a80 1 -- start start 2024-04-19T23:45:40.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.665+0000 7f9ce8e93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 0x558eb4bb8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.665+0000 7f9ce8e93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb490c8c0 con 0x558eb48d1800 2024-04-19T23:45:40.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.666+0000 7f9ce6e3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 0x558eb4bb8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.666+0000 7f9ce6e3d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 0x558eb4bb8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35922/0 (socket says 172.21.15.155:35922) 2024-04-19T23:45:40.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.666+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 learned_addr learned my addr 172.21.15.155:0/427461379 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.667+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eb48f8ea0 con 0x558eb48d1800 2024-04-19T23:45:40.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.667+0000 7f9ce6e3d700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 0x558eb4bb8b00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x558eb4c6ec30 tx=0x558eb4c228a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.667+0000 7f9cdfe2f700 1 -- 172.21.15.155:0/427461379 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb49894a0 con 0x558eb48d1800 2024-04-19T23:45:40.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.667+0000 7f9cdfe2f700 1 -- 172.21.15.155:0/427461379 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558eb4c76000 con 0x558eb48d1800 2024-04-19T23:45:40.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.667+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558eb48f8820 con 0x558eb48d1800 2024-04-19T23:45:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.667+0000 7f9cdfe2f700 1 -- 172.21.15.155:0/427461379 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb49898c0 con 0x558eb48d1800 2024-04-19T23:45:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.667+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558eb48f89c0 con 0x558eb48d1800 2024-04-19T23:45:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.668+0000 7f9cdfe2f700 1 -- 172.21.15.155:0/427461379 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558eb5672dc0 con 0x558eb48d1800 2024-04-19T23:45:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.668+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.668+0000 7f9cdfe2f700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb4c72c00 0x558eb4bb9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.668+0000 7f9cdfe2f700 1 -- 172.21.15.155:0/427461379 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558eb494b340 con 0x558eb48d1800 2024-04-19T23:45:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.668+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558eb48d1c00 0x558eb4bb9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.668+0000 7f9ce663c700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb4c72c00 0x558eb4bb9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.668+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c73000 con 0x558eb48d1c00 2024-04-19T23:45:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce763e700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558eb48d1c00 0x558eb4bb9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce663c700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb4c72c00 0x558eb4bb9600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x558eb4bb3890 tx=0x558eb49c1800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce763e700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558eb48d1c00 0x558eb4bb9b80 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce8e93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce8e93a80 20 realm 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c73400 con 0x558eb48d1c00 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce8e93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce8e93a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c73800 con 0x558eb48d1c00 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce8e93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.669+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c73c00 con 0x558eb48d1c00 2024-04-19T23:45:40.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.670+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.670+0000 7f9ce8e93a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.670+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.670+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c73000 con 0x558eb48d1c00 2024-04-19T23:45:40.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.670+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.670+0000 7f9ce8e93a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:40.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.670+0000 7f9ce8e93a80 20 searching for the correct realm 2024-04-19T23:45:40.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.670+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558eb4c73400 0x558eb4bba100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.670+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c73800 con 0x558eb4c73400 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.670+0000 7f9ce6e3d700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558eb4c73400 0x558eb4bba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.670+0000 7f9ce6e3d700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558eb4c73400 0x558eb4bba100 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.671+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.671+0000 7f9ce6e3d700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558eb4c73800 0x558eb4bbac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.671+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c72400 con 0x558eb4c73800 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.671+0000 7f9ce663c700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558eb4c73800 0x558eb4bbac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.671+0000 7f9ce663c700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558eb4c73800 0x558eb4bbac00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.671+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.671+0000 7f9ce663c700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558eb4c72400 0x558eb4bbb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.671+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c72400 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.672+0000 7f9ce763e700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558eb4c72400 0x558eb4bbb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.672+0000 7f9ce763e700 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558eb4c72400 0x558eb4bbb180 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.672+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.672+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb48d1c00 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.673+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.673+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb48d1c00 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.673+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.673+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c72400 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.673+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.673+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c72400 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.673+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.673+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73800 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.673+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.673+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73400 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.674+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.674+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb48d1c00 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.674+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.674+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c72400 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.674+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.674+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb48d1c00 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.674+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.674+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73800 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.675+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.675+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73400 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.675+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.675+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73400 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.675+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.675+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c72400 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.675+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.675+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73400 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.675+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.675+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73400 2024-04-19T23:45:40.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.676+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.676+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb48d1c00 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.676+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.676+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb48d1c00 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.676+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.676+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c72400 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.676+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.676+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73400 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.676+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.676+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73800 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.677+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.677+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb48d1c00 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.677+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.677+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c72400 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.677+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.677+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73400 2024-04-19T23:45:40.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.677+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.677+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c72400 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.678+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.678+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73800 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.678+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.678+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73400 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.678+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.678+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c72400 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.678+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.678+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb48d1c00 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.678+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.678+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73800 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:40.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:40.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:40.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:40.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c73c00 con 0x558eb48d1c00 2024-04-19T23:45:40.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c73000 con 0x558eb48d1c00 2024-04-19T23:45:40.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.695 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa400 con 0x558eb4c73800 2024-04-19T23:45:40.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:40.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 zone default found 2024-04-19T23:45:40.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 4 Realm: () 2024-04-19T23:45:40.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:40.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:40.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:40.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 zonegroup default 2024-04-19T23:45:40.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.679+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa800 con 0x558eb4c72400 2024-04-19T23:45:40.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce8e93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfac00 con 0x558eb4c73400 2024-04-19T23:45:40.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce8e93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfb000 con 0x558eb4c73400 2024-04-19T23:45:40.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce8e93a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce8e93a80 20 started sync module instance, tier type = 2024-04-19T23:45:40.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce8e93a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:40.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.680+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfb400 con 0x558eb4c73800 2024-04-19T23:45:40.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.681+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.681+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94071405869824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfb800 con 0x558eb4c73800 2024-04-19T23:45:40.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.681+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfbc00 con 0x558eb48d1c00 2024-04-19T23:45:40.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.682+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94071405869824] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.683+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.683+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94071405870976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa800 con 0x558eb48d1c00 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.683+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfbc00 con 0x558eb4c73400 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.684+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.684+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94071405872128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c73400 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.684+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa400 con 0x558eb4c73800 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.684+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94071405870976] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.685+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.685+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94071405873280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfb400 con 0x558eb4c73800 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.685+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c73c00 con 0x558eb48d1c00 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.685+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94071405872128] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.685+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94071405873280] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.686+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.686+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94071405874432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c73000 con 0x558eb48d1c00 2024-04-19T23:45:40.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.686+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfac00 con 0x558eb4c72400 2024-04-19T23:45:40.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.687+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.687+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94071405875584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfb000 con 0x558eb4c72400 2024-04-19T23:45:40.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.687+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfbc00 con 0x558eb4c72400 2024-04-19T23:45:40.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.688+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94071405874432] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.688+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94071405875584] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.688+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.688+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94071405876736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4c72400 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.688+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa800 con 0x558eb4c72400 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.689+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.689+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94071405877888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfac00 con 0x558eb4c72400 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.689+0000 7f9ce8e93a80 20 add_watcher() i=0 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.689+0000 7f9ce8e93a80 20 add_watcher() i=1 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.689+0000 7f9ce8e93a80 20 add_watcher() i=2 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.689+0000 7f9ce8e93a80 20 add_watcher() i=3 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.689+0000 7f9ce8e93a80 20 add_watcher() i=4 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.689+0000 7f9ce8e93a80 20 add_watcher() i=5 2024-04-19T23:45:40.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.690+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94071405876736] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.690+0000 7f9ce8e93a80 20 add_watcher() i=6 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.690+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94071405877888] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.691+0000 7f9ce8e93a80 20 add_watcher() i=7 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.691+0000 7f9ce8e93a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.691+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfb000 con 0x558eb48d1c00 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.691+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.691+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94071407280128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4c73c00 con 0x558eb48d1c00 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.692+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94071407280128] v30'113 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.692+0000 7f9ccde0b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.692+0000 7f9ce8e93a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.692+0000 7f9ce8e93a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.692+0000 7f9ce8e93a80 1 Processor -- start 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.692+0000 7f9ce8e93a80 1 -- start start 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.692+0000 7f9ce8e93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 0x558eb4bba680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.692+0000 7f9ce8e93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb49723c0 con 0x558eb4c73c00 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.693+0000 7f9ce663c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 0x558eb4bba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.693+0000 7f9ce663c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 0x558eb4bba680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35926/0 (socket says 172.21.15.155:35926) 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.693+0000 7f9ce663c700 1 -- 172.21.15.155:0/916446601 learned_addr learned my addr 172.21.15.155:0/916446601 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.693+0000 7f9ce663c700 1 -- 172.21.15.155:0/916446601 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eb48f8b60 con 0x558eb4c73c00 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.693+0000 7f9ce663c700 1 --2- 172.21.15.155:0/916446601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 0x558eb4bba680 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x558eb4c934d0 tx=0x558eb4c221e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92897914b4e0fad server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.693+0000 7f9ccd60a700 1 -- 172.21.15.155:0/916446601 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb4989760 con 0x558eb4c73c00 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.693+0000 7f9ccd60a700 1 -- 172.21.15.155:0/916446601 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558eb4c76600 con 0x558eb4c73c00 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.693+0000 7f9ccd60a700 1 -- 172.21.15.155:0/916446601 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb4d06160 con 0x558eb4c73c00 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/916446601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 msgr2=0x558eb4bba680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/916446601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 0x558eb4bba680 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x558eb4c934d0 tx=0x558eb4c221e0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/916446601 shutdown_connections 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/916446601 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 0x558eb4bba680 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/916446601 >> 172.21.15.155:0/916446601 conn(0x558eb4c73000 msgr2=0x558eb49be000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/916446601 shutdown_connections 2024-04-19T23:45:40.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/916446601 wait complete. 2024-04-19T23:45:40.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce8e93a80 1 Processor -- start 2024-04-19T23:45:40.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce8e93a80 1 -- start start 2024-04-19T23:45:40.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce8e93a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 0x558eb4bba680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce8e93a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb4972500 con 0x558eb4c73c00 2024-04-19T23:45:40.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.694+0000 7f9ce663c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 0x558eb4bba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.695+0000 7f9ce663c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 0x558eb4bba680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35934/0 (socket says 172.21.15.155:35934) 2024-04-19T23:45:40.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.695+0000 7f9ce663c700 1 -- 172.21.15.155:0/3270338733 learned_addr learned my addr 172.21.15.155:0/3270338733 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.695+0000 7f9ce663c700 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eb48f8d00 con 0x558eb4c73c00 2024-04-19T23:45:40.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.695+0000 7f9ce663c700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 0x558eb4bba680 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x558eb4d181e0 tx=0x558eb4c23740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.695+0000 7f9ccbe07700 1 -- 172.21.15.155:0/3270338733 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb4d062c0 con 0x558eb4c73c00 2024-04-19T23:45:40.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.695+0000 7f9ccbe07700 1 -- 172.21.15.155:0/3270338733 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558eb4c76780 con 0x558eb4c73c00 2024-04-19T23:45:40.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.695+0000 7f9ccbe07700 1 -- 172.21.15.155:0/3270338733 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558eb4d06420 con 0x558eb4c73c00 2024-04-19T23:45:40.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.695+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558eb48f8340 con 0x558eb4c73c00 2024-04-19T23:45:40.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.695+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558eb48f9d40 con 0x558eb4c73c00 2024-04-19T23:45:40.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.696+0000 7f9ccbe07700 1 -- 172.21.15.155:0/3270338733 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558eb5673b80 con 0x558eb4c73c00 2024-04-19T23:45:40.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.696+0000 7f9ccbe07700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb4d9c000 0x558eb4bbb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.696+0000 7f9ccbe07700 1 -- 172.21.15.155:0/3270338733 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558eb494b6c0 con 0x558eb4c73c00 2024-04-19T23:45:40.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.696+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558eb4cfbc00 0x558eb4db0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.696+0000 7f9ce763e700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb4d9c000 0x558eb4bbb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.696+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4cfbc00 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.696+0000 7f9ce6e3d700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558eb4cfbc00 0x558eb4db0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.696+0000 7f9ce763e700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb4d9c000 0x558eb4bbb700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x558eb4d19ad0 tx=0x558eb4c22900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.696+0000 7f9ce6e3d700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558eb4cfbc00 0x558eb4db0000 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.697+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4cfbc00 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.697+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558eb4cfa800 0x558eb4db0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.697+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfac00 con 0x558eb4cfa800 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.697+0000 7f9ce663c700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558eb4cfa800 0x558eb4db0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.698+0000 7f9ce663c700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558eb4cfa800 0x558eb4db0580 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.699+0000 7f9ce663c700 1 -- 172.21.15.155:0/3270338733 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4cfa800 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.699+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558eb4cfb000 0x558eb4db0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.699+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9c400 con 0x558eb4cfb000 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.699+0000 7f9ce763e700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558eb4cfb000 0x558eb4db0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.699+0000 7f9ce763e700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558eb4cfb000 0x558eb4db0b00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.700+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.700+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9c800 con 0x558eb4cfbc00 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.701+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'114 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4cfbc00 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.701+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558eb4d9cc00 0x558eb4db1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.701+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9d000 con 0x558eb4d9cc00 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.701+0000 7f9ce6e3d700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558eb4d9cc00 0x558eb4db1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.701+0000 7f9ce6e3d700 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558eb4d9cc00 0x558eb4db1080 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.702+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4d9cc00 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.702+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9d400 con 0x558eb4cfb000 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.703+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'21 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.703+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9d800 con 0x558eb4cfbc00 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.704+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4cfbc00 2024-04-19T23:45:40.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.704+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9dc00 con 0x558eb4cfa800 2024-04-19T23:45:40.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.705+0000 7f9ce663c700 1 -- 172.21.15.155:0/3270338733 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'21 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4cfa800 2024-04-19T23:45:40.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.705+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9dc00 con 0x558eb4d9cc00 2024-04-19T23:45:40.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.706+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4d9cc00 2024-04-19T23:45:40.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.706+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfb800 con 0x558eb4cfb000 2024-04-19T23:45:40.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.707+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.707+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa400 con 0x558eb4d9cc00 2024-04-19T23:45:40.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.708+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4d9cc00 2024-04-19T23:45:40.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.708+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfac00 con 0x558eb4cfa800 2024-04-19T23:45:40.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.709+0000 7f9ce663c700 1 -- 172.21.15.155:0/3270338733 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4cfa800 2024-04-19T23:45:40.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.709+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9c800 con 0x558eb4d9cc00 2024-04-19T23:45:40.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.710+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4d9cc00 2024-04-19T23:45:40.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.710+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9d000 con 0x558eb4cfa800 2024-04-19T23:45:40.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.711+0000 7f9ce663c700 1 -- 172.21.15.155:0/3270338733 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'30 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4cfa800 2024-04-19T23:45:40.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.711+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9d800 con 0x558eb4cfbc00 2024-04-19T23:45:40.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.712+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'115 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4cfbc00 2024-04-19T23:45:40.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.712+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9dc00 con 0x558eb4cfb000 2024-04-19T23:45:40.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.713+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'29 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.713+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa000 con 0x558eb4d9cc00 2024-04-19T23:45:40.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.714+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'34 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4d9cc00 2024-04-19T23:45:40.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.714+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4dea000 con 0x558eb4cfb000 2024-04-19T23:45:40.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.714+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.714+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4dea400 con 0x558eb4cfbc00 2024-04-19T23:45:40.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.716+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4cfbc00 2024-04-19T23:45:40.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.716+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4dea800 con 0x558eb4cfbc00 2024-04-19T23:45:40.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.716+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'116 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4cfbc00 2024-04-19T23:45:40.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.716+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4deac00 con 0x558eb4cfb000 2024-04-19T23:45:40.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.718+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.718+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4deb000 con 0x558eb4d9cc00 2024-04-19T23:45:40.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.718+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4d9cc00 2024-04-19T23:45:40.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.718+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4deb400 con 0x558eb4cfb000 2024-04-19T23:45:40.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.719+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.719+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4deb800 con 0x558eb4cfb000 2024-04-19T23:45:40.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.720+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.720+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4debc00 con 0x558eb4cfb000 2024-04-19T23:45:40.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.721+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.721+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4dea000 con 0x558eb4cfb000 2024-04-19T23:45:40.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.722+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.722+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4deac00 con 0x558eb4cfa800 2024-04-19T23:45:40.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.723+0000 7f9ce663c700 1 -- 172.21.15.155:0/3270338733 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4cfa800 2024-04-19T23:45:40.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.723+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4deb400 con 0x558eb4cfb000 2024-04-19T23:45:40.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.724+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.724+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4dea400 con 0x558eb4cfa800 2024-04-19T23:45:40.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.725+0000 7f9ce663c700 1 -- 172.21.15.155:0/3270338733 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4cfa800 2024-04-19T23:45:40.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.725+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4dea800 con 0x558eb4cfb000 2024-04-19T23:45:40.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.726+0000 7f9ce763e700 1 -- 172.21.15.155:0/3270338733 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'31 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4cfb000 2024-04-19T23:45:40.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.726+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfb800 con 0x558eb4cfa800 2024-04-19T23:45:40.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.728+0000 7f9ce663c700 1 -- 172.21.15.155:0/3270338733 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4cfa800 2024-04-19T23:45:40.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.728+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfa400 con 0x558eb4d9cc00 2024-04-19T23:45:40.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.729+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4d9cc00 2024-04-19T23:45:40.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.730+0000 7f9cc9602700 20 reqs_thread_entry: start 2024-04-19T23:45:40.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.730+0000 7f9ce8e93a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:40.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.730+0000 7f9ce8e93a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:40.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.730+0000 7f9cc75fe700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:10 2024 2024-04-19T23:45:40.732 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:40.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.730+0000 7f9cc6ddc700 20 reqs_thread_entry: start 2024-04-19T23:45:40.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.730+0000 7f9ce8e93a80 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-19T23:45:40.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.730+0000 7f9ce8e93a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.730+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9c400 con 0x558eb4c72400 2024-04-19T23:45:40.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.731+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.731+0000 7f9ce8e93a80 20 rados_obj.operate() r=0 bl.length=346 2024-04-19T23:45:40.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.731+0000 7f9ce8e93a80 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-19T23:45:40.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.731+0000 7f9ce8e93a80 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:45:40.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.731+0000 7f9ce8e93a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:40.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.731+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9d400 con 0x558eb4c72400 2024-04-19T23:45:40.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.731+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(63 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.733 INFO:teuthology.orchestra.run.smithi155.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-19T23:45:40.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.732+0000 7f9ccde0b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.732+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94071407280128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9dc00 con 0x558eb48d1c00 2024-04-19T23:45:40.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.733+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94071407280128] v30'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.733+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94071405869824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9c800 con 0x558eb4c73800 2024-04-19T23:45:40.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.734+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94071405869824] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.734+0000 7f9ce8e93a80 20 remove_watcher() i=0 2024-04-19T23:45:40.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.734+0000 7f9ce8e93a80 2 removed watcher, disabling cache 2024-04-19T23:45:40.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.734+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94071405870976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4d9d800 con 0x558eb48d1c00 2024-04-19T23:45:40.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.735+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94071405870976] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.735+0000 7f9ce8e93a80 20 remove_watcher() i=1 2024-04-19T23:45:40.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.735+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94071405872128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfac00 con 0x558eb4c73400 2024-04-19T23:45:40.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.736+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/427461379 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94071405872128] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce1200 con 0x558eb4c73400 2024-04-19T23:45:40.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.736+0000 7f9ce8e93a80 20 remove_watcher() i=2 2024-04-19T23:45:40.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.736+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94071405873280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4cfb800 con 0x558eb4c73800 2024-04-19T23:45:40.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.737+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94071405873280] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce1440 con 0x558eb4c73800 2024-04-19T23:45:40.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.737+0000 7f9ce8e93a80 20 remove_watcher() i=3 2024-04-19T23:45:40.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.737+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94071405874432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4deb800 con 0x558eb48d1c00 2024-04-19T23:45:40.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.740+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94071405874432] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb48d1c00 2024-04-19T23:45:40.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.740+0000 7f9ce8e93a80 20 remove_watcher() i=4 2024-04-19T23:45:40.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.740+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94071405875584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4debc00 con 0x558eb4c72400 2024-04-19T23:45:40.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.741+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94071405875584] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.741+0000 7f9ce8e93a80 20 remove_watcher() i=5 2024-04-19T23:45:40.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.741+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94071405876736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4dea000 con 0x558eb4c72400 2024-04-19T23:45:40.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.742+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94071405876736] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.742+0000 7f9ce8e93a80 20 remove_watcher() i=6 2024-04-19T23:45:40.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.742+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94071405877888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558eb4deb400 con 0x558eb4c72400 2024-04-19T23:45:40.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce763e700 1 -- 172.21.15.155:0/427461379 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94071405877888] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558eb4ce0b40 con 0x558eb4c72400 2024-04-19T23:45:40.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 20 remove_watcher() i=7 2024-04-19T23:45:40.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558eb4c72400 msgr2=0x558eb4bbb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558eb4c72400 0x558eb4bbb180 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558eb48d1c00 msgr2=0x558eb4bb9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558eb48d1c00 0x558eb4bb9b80 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558eb4c73800 msgr2=0x558eb4bbac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558eb4c73800 0x558eb4bbac00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558eb4c73400 msgr2=0x558eb4bba100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558eb4c73400 0x558eb4bba100 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb4c72c00 msgr2=0x558eb4bb9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb4c72c00 0x558eb4bb9600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x558eb4bb3890 tx=0x558eb49c1800 comp rx=0 tx=0).stop 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 msgr2=0x558eb4bb8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/427461379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d1800 0x558eb4bb8b00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x558eb4c6ec30 tx=0x558eb4c228a0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 reap_dead start 2024-04-19T23:45:40.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce663c700 1 -- 172.21.15.155:0/427461379 reap_dead start 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 shutdown_connections 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 >> 172.21.15.155:0/427461379 conn(0x558eb48d0c00 msgr2=0x558eb49bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 shutdown_connections 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.743+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/427461379 wait complete. 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558eb4cfa800 msgr2=0x558eb4db0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558eb4cfa800 0x558eb4db0580 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558eb4cfbc00 msgr2=0x558eb4db0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558eb4cfbc00 0x558eb4db0000 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558eb4d9cc00 msgr2=0x558eb4db1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558eb4d9cc00 0x558eb4db1080 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558eb4cfb000 msgr2=0x558eb4db0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558eb4cfb000 0x558eb4db0b00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb4d9c000 msgr2=0x558eb4bbb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb4d9c000 0x558eb4bbb700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x558eb4d19ad0 tx=0x558eb4c22900 comp rx=0 tx=0).stop 2024-04-19T23:45:40.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 msgr2=0x558eb4bba680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/3270338733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb4c73c00 0x558eb4bba680 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x558eb4d181e0 tx=0x558eb4c23740 comp rx=0 tx=0).stop 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce6e3d700 1 -- 172.21.15.155:0/3270338733 reap_dead start 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 shutdown_connections 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 >> 172.21.15.155:0/3270338733 conn(0x558eb4c73000 msgr2=0x558eb49be000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 shutdown_connections 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/3270338733 wait complete. 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2467053915 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb48d1400 msgr2=0x558eb4bb9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/2467053915 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb48d1400 0x558eb4bb9080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x558eb56a1f20 tx=0x558eb4c22060 comp rx=0 tx=0).stop 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2467053915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 msgr2=0x558eb4bb8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/2467053915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x558eb56a1e30 tx=0x558eb49c1920 comp rx=0 tx=0).stop 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2467053915 shutdown_connections 2024-04-19T23:45:40.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/2467053915 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558eb48d1400 0x558eb4bb9080 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 --2- 172.21.15.155:0/2467053915 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558eb48d0800 0x558eb4bb8580 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2467053915 >> 172.21.15.155:0/2467053915 conn(0x558eb48d0400 msgr2=0x558eb49bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2467053915 shutdown_connections 2024-04-19T23:45:40.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.744+0000 7f9ce8e93a80 1 -- 172.21.15.155:0/2467053915 wait complete. 2024-04-19T23:45:40.749 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-19T23:45:40.750 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-19T23:45:40.750 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-19T23:45:40.750 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-04-19T23:45:40.797 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:40.797 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.797+0000 7fa878e37a80 1 Processor -- start 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.797+0000 7fa878e37a80 1 -- start start 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.797+0000 7fa878e37a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x560c755cac00 0x560c758b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.797+0000 7fa878e37a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560c758f5500 con 0x560c755ca800 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.797+0000 7fa878e37a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x560c7566ca00 con 0x560c755cac00 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.798+0000 7fa8765e0700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x560c755cac00 0x560c758b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.798+0000 7fa876de1700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x560c755ca800 0x560c756b6800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46772/0 (socket says 172.21.15.155:46772) 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.798+0000 7fa8765e0700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x560c755cac00 0x560c758b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35944/0 (socket says 172.21.15.155:35944) 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.798+0000 7fa876de1700 1 -- 172.21.15.155:0/3956648112 learned_addr learned my addr 172.21.15.155:0/3956648112 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.798+0000 7fa8765e0700 1 -- 172.21.15.155:0/3956648112 >> v1:172.21.15.76:6789/0 conn(0x560c755ca800 legacy=0x560c756b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.798+0000 7fa8765e0700 1 -- 172.21.15.155:0/3956648112 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c755f3d40 con 0x560c755cac00 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.798+0000 7fa875ddf700 1 -- 172.21.15.155:0/3956648112 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516733483 0 0) 0x560c76398000 con 0x560c755ca800 2024-04-19T23:45:40.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.798+0000 7fa8765e0700 1 --2- 172.21.15.155:0/3956648112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cac00 0x560c758b2580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x560c758ad890 tx=0x560c756bb920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a2ef9783b68cb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.799+0000 7fa875ddf700 1 -- 172.21.15.155:0/3956648112 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c756834a0 con 0x560c755cac00 2024-04-19T23:45:40.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.799+0000 7fa875ddf700 1 -- 172.21.15.155:0/3956648112 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560c758f5800 con 0x560c755cac00 2024-04-19T23:45:40.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.799+0000 7fa875ddf700 1 -- 172.21.15.155:0/3956648112 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c75683600 con 0x560c755cac00 2024-04-19T23:45:40.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.799+0000 7fa878e37a80 1 -- 172.21.15.155:0/3956648112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cac00 msgr2=0x560c758b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.799+0000 7fa878e37a80 1 --2- 172.21.15.155:0/3956648112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cac00 0x560c758b2580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x560c758ad890 tx=0x560c756bb920 comp rx=0 tx=0).stop 2024-04-19T23:45:40.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.799+0000 7fa878e37a80 1 -- 172.21.15.155:0/3956648112 shutdown_connections 2024-04-19T23:45:40.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.799+0000 7fa878e37a80 1 --2- 172.21.15.155:0/3956648112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cac00 0x560c758b2580 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.799+0000 7fa878e37a80 1 -- 172.21.15.155:0/3956648112 >> 172.21.15.155:0/3956648112 conn(0x560c755ca400 msgr2=0x560c756b6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.799+0000 7fa878e37a80 1 -- 172.21.15.155:0/3956648112 shutdown_connections 2024-04-19T23:45:40.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.799+0000 7fa878e37a80 1 -- 172.21.15.155:0/3956648112 wait complete. 2024-04-19T23:45:40.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.800+0000 7fa878e37a80 1 Processor -- start 2024-04-19T23:45:40.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.800+0000 7fa878e37a80 1 -- start start 2024-04-19T23:45:40.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.800+0000 7fa878e37a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.800+0000 7fa878e37a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7566c500 con 0x560c755ca800 2024-04-19T23:45:40.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.800+0000 7fa876de1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.800+0000 7fa876de1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35954/0 (socket says 172.21.15.155:35954) 2024-04-19T23:45:40.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.800+0000 7fa876de1700 1 -- 172.21.15.155:0/2605571867 learned_addr learned my addr 172.21.15.155:0/2605571867 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.800+0000 7fa876de1700 1 -- 172.21.15.155:0/2605571867 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c755f3ba0 con 0x560c755ca800 2024-04-19T23:45:40.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.800+0000 7fa876de1700 1 --2- 172.21.15.155:0/2605571867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x560c7639b770 tx=0x560c756bbb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f00c2c359e3bf0f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa8755de700 1 -- 172.21.15.155:0/2605571867 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c756834a0 con 0x560c755ca800 2024-04-19T23:45:40.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa8755de700 1 -- 172.21.15.155:0/2605571867 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560c758f5b00 con 0x560c755ca800 2024-04-19T23:45:40.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa8755de700 1 -- 172.21.15.155:0/2605571867 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c75683600 con 0x560c755ca800 2024-04-19T23:45:40.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa878e37a80 1 -- 172.21.15.155:0/2605571867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 msgr2=0x560c758b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa878e37a80 1 --2- 172.21.15.155:0/2605571867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x560c7639b770 tx=0x560c756bbb60 comp rx=0 tx=0).stop 2024-04-19T23:45:40.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa878e37a80 1 -- 172.21.15.155:0/2605571867 shutdown_connections 2024-04-19T23:45:40.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa878e37a80 1 --2- 172.21.15.155:0/2605571867 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa878e37a80 1 -- 172.21.15.155:0/2605571867 >> 172.21.15.155:0/2605571867 conn(0x560c755ca400 msgr2=0x560c756b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa878e37a80 1 -- 172.21.15.155:0/2605571867 shutdown_connections 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa878e37a80 1 -- 172.21.15.155:0/2605571867 wait complete. 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa878e37a80 1 Processor -- start 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.801+0000 7fa878e37a80 1 -- start start 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa878e37a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa878e37a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7566c3c0 con 0x560c755ca800 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa876de1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa876de1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35958/0 (socket says 172.21.15.155:35958) 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa876de1700 1 -- 172.21.15.155:0/2714107045 learned_addr learned my addr 172.21.15.155:0/2714107045 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa876de1700 1 -- 172.21.15.155:0/2714107045 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c755f3a00 con 0x560c755ca800 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa876de1700 1 --2- 172.21.15.155:0/2714107045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x560c7639b800 tx=0x560c756bba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa873ddb700 1 -- 172.21.15.155:0/2714107045 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c756838c0 con 0x560c755ca800 2024-04-19T23:45:40.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa873ddb700 1 -- 172.21.15.155:0/2714107045 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560c7566bc80 con 0x560c755ca800 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa878e37a80 1 -- 172.21.15.155:0/2714107045 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c755f3860 con 0x560c755ca800 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa873ddb700 1 -- 172.21.15.155:0/2714107045 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c756834a0 con 0x560c755ca800 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.802+0000 7fa878e37a80 1 -- 172.21.15.155:0/2714107045 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c755f36c0 con 0x560c755ca800 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.803+0000 7fa878e37a80 1 Processor -- start 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.803+0000 7fa873ddb700 1 -- 172.21.15.155:0/2714107045 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x560c7636cb00 con 0x560c755ca800 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.803+0000 7fa878e37a80 1 -- start start 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.803+0000 7fa873ddb700 1 --2- 172.21.15.155:0/2714107045 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c755cb400 0x560c758b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.803+0000 7fa878e37a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 0x560c758b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.803+0000 7fa873ddb700 1 -- 172.21.15.155:0/2714107045 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x560c75645180 con 0x560c755ca800 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.803+0000 7fa878e37a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c75606640 con 0x560c755cb800 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.803+0000 7fa8775e2700 1 --2- 172.21.15.155:0/2714107045 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c755cb400 0x560c758b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.803+0000 7fa876de1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 0x560c758b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.803+0000 7fa876de1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 0x560c758b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35964/0 (socket says 172.21.15.155:35964) 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.803+0000 7fa876de1700 1 -- 172.21.15.155:0/3646049072 learned_addr learned my addr 172.21.15.155:0/3646049072 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.804+0000 7fa8775e2700 1 --2- 172.21.15.155:0/2714107045 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c755cb400 0x560c758b3080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x560c7639bf20 tx=0x560c75916060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.804+0000 7fa876de1700 1 -- 172.21.15.155:0/3646049072 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c755f2000 con 0x560c755cb800 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.804+0000 7fa876de1700 1 --2- 172.21.15.155:0/3646049072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 0x560c758b2b00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x560c7645c330 tx=0x560c75916240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00f936adcf3a31 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.804+0000 7fa8715d6700 1 -- 172.21.15.155:0/3646049072 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c75683600 con 0x560c755cb800 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.804+0000 7fa8715d6700 1 -- 172.21.15.155:0/3646049072 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560c758f4300 con 0x560c755cb800 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.804+0000 7fa8715d6700 1 -- 172.21.15.155:0/3646049072 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c75683a20 con 0x560c755cb800 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.804+0000 7fa878e37a80 1 -- 172.21.15.155:0/3646049072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 msgr2=0x560c758b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.804+0000 7fa878e37a80 1 --2- 172.21.15.155:0/3646049072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 0x560c758b2b00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x560c7645c330 tx=0x560c75916240 comp rx=0 tx=0).stop 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.804+0000 7fa878e37a80 1 -- 172.21.15.155:0/3646049072 shutdown_connections 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.804+0000 7fa878e37a80 1 --2- 172.21.15.155:0/3646049072 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 0x560c758b2b00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.804+0000 7fa878e37a80 1 -- 172.21.15.155:0/3646049072 >> 172.21.15.155:0/3646049072 conn(0x560c755cac00 msgr2=0x560c756b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.805+0000 7fa878e37a80 1 -- 172.21.15.155:0/3646049072 shutdown_connections 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.805+0000 7fa878e37a80 1 -- 172.21.15.155:0/3646049072 wait complete. 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.805+0000 7fa878e37a80 1 Processor -- start 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.805+0000 7fa878e37a80 1 -- start start 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.805+0000 7fa878e37a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 0x560c758b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.805+0000 7fa878e37a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c756068c0 con 0x560c755cb800 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.805+0000 7fa876de1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 0x560c758b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.805+0000 7fa876de1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 0x560c758b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35976/0 (socket says 172.21.15.155:35976) 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.805+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 learned_addr learned my addr 172.21.15.155:0/636740433 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.805+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c755f2ea0 con 0x560c755cb800 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.806+0000 7fa876de1700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 0x560c758b2b00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x560c75968c30 tx=0x560c759168a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.806+0000 7fa86fdd3700 1 -- 172.21.15.155:0/636740433 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c75683600 con 0x560c755cb800 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.806+0000 7fa86fdd3700 1 -- 172.21.15.155:0/636740433 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560c7566be00 con 0x560c755cb800 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.806+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c755f2820 con 0x560c755cb800 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.806+0000 7fa86fdd3700 1 -- 172.21.15.155:0/636740433 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c75683a20 con 0x560c755cb800 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.806+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c755f29c0 con 0x560c755cb800 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.807+0000 7fa86fdd3700 1 -- 172.21.15.155:0/636740433 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x560c7636cdc0 con 0x560c755cb800 2024-04-19T23:45:40.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.807+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.807+0000 7fa86fdd3700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c7596cc00 0x560c758b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.807+0000 7fa86fdd3700 1 -- 172.21.15.155:0/636740433 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x560c75645340 con 0x560c755cb800 2024-04-19T23:45:40.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.807+0000 7fa8765e0700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c7596cc00 0x560c758b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.807+0000 7fa878e37a80 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x560c755cbc00 0x560c758b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.807+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596d000 con 0x560c755cbc00 2024-04-19T23:45:40.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.807+0000 7fa8775e2700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x560c755cbc00 0x560c758b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.807+0000 7fa8765e0700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c7596cc00 0x560c758b3600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x560c758ad890 tx=0x560c756bb800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.807+0000 7fa8775e2700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x560c755cbc00 0x560c758b3b80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 20 realm 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596d400 con 0x560c755cbc00 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596d800 con 0x560c755cbc00 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596dc00 con 0x560c755cbc00 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.808+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596d000 con 0x560c755cbc00 2024-04-19T23:45:40.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.809+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.809+0000 7fa878e37a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:40.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.809+0000 7fa878e37a80 20 searching for the correct realm 2024-04-19T23:45:40.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.809+0000 7fa878e37a80 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x560c7596d400 0x560c758b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.809+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596d800 con 0x560c7596d400 2024-04-19T23:45:40.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.809+0000 7fa876de1700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x560c7596d400 0x560c758b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.809+0000 7fa876de1700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x560c7596d400 0x560c758b4100 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.810+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.810+0000 7fa876de1700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x560c7596d800 0x560c758b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.810+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596c400 con 0x560c7596d800 2024-04-19T23:45:40.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.810+0000 7fa8765e0700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x560c7596d800 0x560c758b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.810+0000 7fa8765e0700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x560c7596d800 0x560c758b4c00 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.810+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.810+0000 7fa8765e0700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x560c7596c400 0x560c758b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.810+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.811+0000 7fa8775e2700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x560c7596c400 0x560c758b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.811+0000 7fa8775e2700 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x560c7596c400 0x560c758b5180 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.812+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.812+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c755cbc00 2024-04-19T23:45:40.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.812+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.812+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c755cbc00 2024-04-19T23:45:40.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.812+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.812+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.812+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.812+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.812+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.812+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d800 2024-04-19T23:45:40.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.813+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.813+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d400 2024-04-19T23:45:40.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.813+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.813+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c755cbc00 2024-04-19T23:45:40.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.813+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.813+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.813+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.813+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c755cbc00 2024-04-19T23:45:40.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.813+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.813+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d800 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.814+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.814+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d400 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.814+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.814+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d400 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.814+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.814+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.814+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.814+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d400 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.815+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.815+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d400 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.815+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.815+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c755cbc00 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.815+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.815+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c755cbc00 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.815+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.815+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.816+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.816+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d400 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.816+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.816+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d800 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.816+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.816+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c755cbc00 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.816+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.816+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.816+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.816+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d400 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.817+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.817+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.817+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.817+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d800 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.817+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.817+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d400 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.817+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.817+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c755cbc00 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d800 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa878e37a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:40.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa878e37a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:40.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa878e37a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:40.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa878e37a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:40.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596dc00 con 0x560c755cbc00 2024-04-19T23:45:40.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa878e37a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.818+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596d000 con 0x560c755cbc00 2024-04-19T23:45:40.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6400 con 0x560c7596d800 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 20 zone default found 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 4 Realm: () 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 20 zonegroup default 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6800 con 0x560c7596c400 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6c00 con 0x560c7596d400 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.819+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.820+0000 7fa878e37a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.820+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.820+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f7000 con 0x560c7596d400 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.820+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.820+0000 7fa878e37a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.820+0000 7fa878e37a80 20 started sync module instance, tier type = 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.820+0000 7fa878e37a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.820+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f7400 con 0x560c7596d800 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.821+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.821+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94611511614208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f7800 con 0x560c7596d800 2024-04-19T23:45:40.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.821+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f7c00 con 0x560c755cbc00 2024-04-19T23:45:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.822+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94611511614208] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.822+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.822+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94611511615360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6800 con 0x560c755cbc00 2024-04-19T23:45:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.822+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f7c00 con 0x560c7596d400 2024-04-19T23:45:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.823+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.823+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94611511616512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596d400 2024-04-19T23:45:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.823+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6400 con 0x560c7596d800 2024-04-19T23:45:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.824+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94611511615360] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.824+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.824+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94611511617664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f7400 con 0x560c7596d800 2024-04-19T23:45:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.824+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596dc00 con 0x560c755cbc00 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.825+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94611511617664] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.827+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94611511616512] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.827+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.827+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94611511618816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596d000 con 0x560c755cbc00 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.827+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6c00 con 0x560c7596c400 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.828+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.828+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94611511619968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f7000 con 0x560c7596c400 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.828+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f7c00 con 0x560c7596c400 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.828+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94611511618816] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.829+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94611511619968] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.829+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.829+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94611511621120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.829+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6800 con 0x560c7596c400 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.830+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.830+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94611511621120] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.830+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94611511622272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6c00 con 0x560c7596c400 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.830+0000 7fa878e37a80 20 add_watcher() i=0 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.830+0000 7fa878e37a80 20 add_watcher() i=1 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.830+0000 7fa878e37a80 20 add_watcher() i=2 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.830+0000 7fa878e37a80 20 add_watcher() i=3 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.830+0000 7fa878e37a80 20 add_watcher() i=4 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.830+0000 7fa878e37a80 20 add_watcher() i=5 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.830+0000 7fa878e37a80 20 add_watcher() i=6 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.831+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94611511622272] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.831+0000 7fa878e37a80 20 add_watcher() i=7 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.831+0000 7fa878e37a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.831+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f7000 con 0x560c755cbc00 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.831+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.831+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94611513032704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c7596dc00 con 0x560c755cbc00 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.832+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94611513032704] v30'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.832+0000 7fa85ddaf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.832+0000 7fa878e37a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.832+0000 7fa878e37a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.833+0000 7fa878e37a80 1 Processor -- start 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.833+0000 7fa878e37a80 1 -- start start 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.833+0000 7fa878e37a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.833+0000 7fa878e37a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7566c3c0 con 0x560c7596dc00 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.833+0000 7fa8765e0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.833+0000 7fa8765e0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35984/0 (socket says 172.21.15.155:35984) 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.833+0000 7fa8765e0700 1 -- 172.21.15.155:0/1117463148 learned_addr learned my addr 172.21.15.155:0/1117463148 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.833+0000 7fa8765e0700 1 -- 172.21.15.155:0/1117463148 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c755f2b60 con 0x560c7596dc00 2024-04-19T23:45:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.833+0000 7fa8765e0700 1 --2- 172.21.15.155:0/1117463148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x560c7598b4d0 tx=0x560c759161e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d6e14985677cdd server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.834+0000 7fa85d5ae700 1 -- 172.21.15.155:0/1117463148 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c75683760 con 0x560c7596dc00 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.834+0000 7fa85d5ae700 1 -- 172.21.15.155:0/1117463148 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560c75a1c000 con 0x560c7596dc00 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.834+0000 7fa85d5ae700 1 -- 172.21.15.155:0/1117463148 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c75a02160 con 0x560c7596dc00 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.834+0000 7fa878e37a80 1 -- 172.21.15.155:0/1117463148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 msgr2=0x560c758b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.834+0000 7fa878e37a80 1 --2- 172.21.15.155:0/1117463148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x560c7598b4d0 tx=0x560c759161e0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.834+0000 7fa878e37a80 1 -- 172.21.15.155:0/1117463148 shutdown_connections 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.834+0000 7fa878e37a80 1 --2- 172.21.15.155:0/1117463148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.834+0000 7fa878e37a80 1 -- 172.21.15.155:0/1117463148 >> 172.21.15.155:0/1117463148 conn(0x560c7596d000 msgr2=0x560c756b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.834+0000 7fa878e37a80 1 -- 172.21.15.155:0/1117463148 shutdown_connections 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.834+0000 7fa878e37a80 1 -- 172.21.15.155:0/1117463148 wait complete. 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.835+0000 7fa878e37a80 1 Processor -- start 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.835+0000 7fa878e37a80 1 -- start start 2024-04-19T23:45:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.835+0000 7fa878e37a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.835+0000 7fa878e37a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7566c500 con 0x560c7596dc00 2024-04-19T23:45:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.835+0000 7fa8765e0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.835+0000 7fa8765e0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35988/0 (socket says 172.21.15.155:35988) 2024-04-19T23:45:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.835+0000 7fa8765e0700 1 -- 172.21.15.155:0/1447312832 learned_addr learned my addr 172.21.15.155:0/1447312832 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.835+0000 7fa8765e0700 1 -- 172.21.15.155:0/1447312832 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c755f2d00 con 0x560c7596dc00 2024-04-19T23:45:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.835+0000 7fa8765e0700 1 --2- 172.21.15.155:0/1447312832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x560c75a141e0 tx=0x560c75917740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.835+0000 7fa85bdab700 1 -- 172.21.15.155:0/1447312832 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c75a022c0 con 0x560c7596dc00 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.836+0000 7fa85bdab700 1 -- 172.21.15.155:0/1447312832 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560c75a1c180 con 0x560c7596dc00 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.836+0000 7fa85bdab700 1 -- 172.21.15.155:0/1447312832 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560c75a02420 con 0x560c7596dc00 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.836+0000 7fa878e37a80 1 -- 172.21.15.155:0/1447312832 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c755f2340 con 0x560c7596dc00 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.836+0000 7fa878e37a80 1 -- 172.21.15.155:0/1447312832 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c755f3d40 con 0x560c7596dc00 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.836+0000 7fa85bdab700 1 -- 172.21.15.155:0/1447312832 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x560c7636db80 con 0x560c7596dc00 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.836+0000 7fa85bdab700 1 --2- 172.21.15.155:0/1447312832 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c75a9e000 0x560c758b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.836+0000 7fa85bdab700 1 -- 172.21.15.155:0/1447312832 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x560c756456c0 con 0x560c7596dc00 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.836+0000 7fa878e37a80 5 note: GC not initialized 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.836+0000 7fa8775e2700 1 --2- 172.21.15.155:0/1447312832 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c75a9e000 0x560c758b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.837+0000 7fa8775e2700 1 --2- 172.21.15.155:0/1447312832 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c75a9e000 0x560c758b5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x560c75a15ad0 tx=0x560c75916900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.837+0000 7fa8595a6700 20 reqs_thread_entry: start 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.837+0000 7fa878e37a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.837+0000 7fa878e37a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa8575a2700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:11 2024 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa856d80700 20 reqs_thread_entry: start 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa878e37a80 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa878e37a80 20 rados_obj.operate() r=0 bl.length=346 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa878e37a80 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa878e37a80 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa878e37a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa878e37a80 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.838+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6800 con 0x560c7596d800 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 : miss 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6c00 con 0x560c755cbc00 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(64 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.839+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f7000 con 0x560c7596c400 2024-04-19T23:45:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.840+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(65 fud.buckets [call] v30'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.840+0000 7fa878e37a80 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-19T23:45:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.840+0000 7fa878e37a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.840+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c75a9e400 con 0x560c7596d800 2024-04-19T23:45:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.841+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.841+0000 7fa878e37a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.841+0000 7fa878e37a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-19T23:45:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.841+0000 7fa878e37a80 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.841+0000 7fa878e37a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.841+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c75a9ec00 con 0x560c7596d800 2024-04-19T23:45:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.842+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.842+0000 7fa878e37a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-19T23:45:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.842+0000 7fa878e37a80 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.842+0000 7fa878e37a80 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-19T23:45:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.842+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94611513035008 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c75a9f000 con 0x560c7596c400 2024-04-19T23:45:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.842+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== watch-notify(notify (1) cookie 94611511621120 notify 128849018893 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x560c75a0c000 con 0x560c7596c400 2024-04-19T23:45:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.842+0000 7fa8715d6700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94611511621120 notifier 4549 bl.length()=338 2024-04-19T23:45:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.842+0000 7fa8715d6700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-19T23:45:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.842+0000 7fa8715d6700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.842+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(68 notify.6 [notify cookie 94611513035008 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.842+0000 7fa8715d6700 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f7800 con 0x560c7596c400 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.843+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.843+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== watch-notify(notify_complete (2) cookie 94611513035008 notify 128849018893 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560c75a0c1a0 con 0x560c7596c400 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.843+0000 7fa85ddaf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.843+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94611513032704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c75a9f400 con 0x560c755cbc00 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.844+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94611513032704] v30'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.844+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94611511614208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c75a9f800 con 0x560c7596d800 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.845+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94611511614208] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.845+0000 7fa878e37a80 20 remove_watcher() i=0 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.845+0000 7fa878e37a80 2 removed watcher, disabling cache 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.845+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94611511615360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c75a9fc00 con 0x560c755cbc00 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.846+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94611511615360] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.846+0000 7fa878e37a80 20 remove_watcher() i=1 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.846+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94611511616512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c75a9e400 con 0x560c7596d400 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.847+0000 7fa876de1700 1 -- 172.21.15.155:0/636740433 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94611511616512] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759df200 con 0x560c7596d400 2024-04-19T23:45:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.847+0000 7fa878e37a80 20 remove_watcher() i=2 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.847+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94611511617664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6800 con 0x560c7596d800 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.848+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94611511617664] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759df440 con 0x560c7596d800 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.848+0000 7fa878e37a80 20 remove_watcher() i=3 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.848+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94611511618816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c75a9f000 con 0x560c755cbc00 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.849+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94611511618816] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c755cbc00 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.849+0000 7fa878e37a80 20 remove_watcher() i=4 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.849+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94611511619968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c75a9f400 con 0x560c7596c400 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.850+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94611511619968] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.850+0000 7fa878e37a80 20 remove_watcher() i=5 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.850+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94611511621120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c75a9fc00 con 0x560c7596c400 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.851+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94611511621120] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.851+0000 7fa878e37a80 20 remove_watcher() i=6 2024-04-19T23:45:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.851+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94611511622272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560c759f6000 con 0x560c7596c400 2024-04-19T23:45:40.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.852+0000 7fa8775e2700 1 -- 172.21.15.155:0/636740433 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94611511622272] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560c759deb40 con 0x560c7596c400 2024-04-19T23:45:40.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.852+0000 7fa878e37a80 20 remove_watcher() i=7 2024-04-19T23:45:40.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.852+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x560c7596c400 msgr2=0x560c758b5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.852+0000 7fa878e37a80 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x560c7596c400 0x560c758b5180 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.852+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x560c755cbc00 msgr2=0x560c758b3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.852+0000 7fa878e37a80 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x560c755cbc00 0x560c758b3b80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.852+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x560c7596d800 msgr2=0x560c758b4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.852+0000 7fa878e37a80 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x560c7596d800 0x560c758b4c00 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.852+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x560c7596d400 msgr2=0x560c758b4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.852+0000 7fa878e37a80 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x560c7596d400 0x560c758b4100 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c7596cc00 msgr2=0x560c758b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c7596cc00 0x560c758b3600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x560c758ad890 tx=0x560c756bb800 comp rx=0 tx=0).stop 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 msgr2=0x560c758b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 --2- 172.21.15.155:0/636740433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755cb800 0x560c758b2b00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x560c75968c30 tx=0x560c759168a0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 reap_dead start 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa8765e0700 1 -- 172.21.15.155:0/636740433 reap_dead start 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 shutdown_connections 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 >> 172.21.15.155:0/636740433 conn(0x560c755cac00 msgr2=0x560c756b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 shutdown_connections 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/636740433 wait complete. 2024-04-19T23:45:40.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/1447312832 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c75a9e000 msgr2=0x560c758b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 --2- 172.21.15.155:0/1447312832 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c75a9e000 0x560c758b5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x560c75a15ad0 tx=0x560c75916900 comp rx=0 tx=0).stop 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/1447312832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 msgr2=0x560c758b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 --2- 172.21.15.155:0/1447312832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x560c75a141e0 tx=0x560c75917740 comp rx=0 tx=0).stop 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/1447312832 shutdown_connections 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 --2- 172.21.15.155:0/1447312832 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c75a9e000 0x560c758b5700 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 --2- 172.21.15.155:0/1447312832 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c7596dc00 0x560c758b4680 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/1447312832 >> 172.21.15.155:0/1447312832 conn(0x560c7596d000 msgr2=0x560c756b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/1447312832 shutdown_connections 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.853+0000 7fa878e37a80 1 -- 172.21.15.155:0/1447312832 wait complete. 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.854+0000 7fa878e37a80 1 -- 172.21.15.155:0/2714107045 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c755cb400 msgr2=0x560c758b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.854+0000 7fa878e37a80 1 --2- 172.21.15.155:0/2714107045 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c755cb400 0x560c758b3080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x560c7639bf20 tx=0x560c75916060 comp rx=0 tx=0).stop 2024-04-19T23:45:40.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.854+0000 7fa878e37a80 1 -- 172.21.15.155:0/2714107045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 msgr2=0x560c758b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.854+0000 7fa878e37a80 1 --2- 172.21.15.155:0/2714107045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x560c7639b800 tx=0x560c756bba40 comp rx=0 tx=0).stop 2024-04-19T23:45:40.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.854+0000 7fa878e37a80 1 -- 172.21.15.155:0/2714107045 shutdown_connections 2024-04-19T23:45:40.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.854+0000 7fa878e37a80 1 --2- 172.21.15.155:0/2714107045 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x560c755cb400 0x560c758b3080 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.854+0000 7fa878e37a80 1 --2- 172.21.15.155:0/2714107045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x560c755ca800 0x560c758b2580 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.854+0000 7fa878e37a80 1 -- 172.21.15.155:0/2714107045 >> 172.21.15.155:0/2714107045 conn(0x560c755ca400 msgr2=0x560c756b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.854+0000 7fa878e37a80 1 -- 172.21.15.155:0/2714107045 shutdown_connections 2024-04-19T23:45:40.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.854+0000 7fa878e37a80 1 -- 172.21.15.155:0/2714107045 wait complete. 2024-04-19T23:45:40.873 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1'] 2024-04-19T23:45:40.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1'] 2024-04-19T23:45:40.873 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:40.923 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:40.923 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:40.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.923+0000 7f2397dd0a80 1 Processor -- start 2024-04-19T23:45:40.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.924+0000 7f2397dd0a80 1 -- start start 2024-04-19T23:45:40.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.924+0000 7f2397dd0a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5568c1fc4c00 0x5568c22ac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.924+0000 7f2397dd0a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5568c22ef500 con 0x5568c1fc4800 2024-04-19T23:45:40.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.924+0000 7f2397dd0a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5568c2066a00 con 0x5568c1fc4c00 2024-04-19T23:45:40.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.924+0000 7f2395579700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5568c1fc4c00 0x5568c22ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.924+0000 7f2395d7a700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5568c1fc4800 0x5568c20b0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46778/0 (socket says 172.21.15.155:46778) 2024-04-19T23:45:40.947 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.924+0000 7f2395d7a700 1 -- 172.21.15.155:0/1798131648 learned_addr learned my addr 172.21.15.155:0/1798131648 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.924+0000 7f2394d78700 1 -- 172.21.15.155:0/1798131648 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403917853 0 0) 0x5568c2d92000 con 0x5568c1fc4800 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.924+0000 7f2394d78700 1 -- 172.21.15.155:0/1798131648 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5568c22ef680 con 0x5568c1fc4800 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.924+0000 7f2395579700 1 -- 172.21.15.155:0/1798131648 >> v1:172.21.15.76:6789/0 conn(0x5568c1fc4800 legacy=0x5568c20b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.924+0000 7f2395579700 1 -- 172.21.15.155:0/1798131648 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c1fedd40 con 0x5568c1fc4c00 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.925+0000 7f2395579700 1 --2- 172.21.15.155:0/1798131648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22ac580 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5568c22a7890 tx=0x5568c20b5980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa567ce37eeb402d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.925+0000 7f2394d78700 1 -- 172.21.15.155:0/1798131648 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c207d4a0 con 0x5568c1fc4c00 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.925+0000 7f2394d78700 1 -- 172.21.15.155:0/1798131648 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c22ef500 con 0x5568c1fc4c00 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.925+0000 7f2394d78700 1 -- 172.21.15.155:0/1798131648 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c207d600 con 0x5568c1fc4c00 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.925+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1798131648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 msgr2=0x5568c22ac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.925+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/1798131648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22ac580 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5568c22a7890 tx=0x5568c20b5980 comp rx=0 tx=0).stop 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.925+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1798131648 shutdown_connections 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.925+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/1798131648 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22ac580 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.925+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1798131648 >> 172.21.15.155:0/1798131648 conn(0x5568c1fc4400 msgr2=0x5568c20b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.925+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1798131648 shutdown_connections 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.925+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1798131648 wait complete. 2024-04-19T23:45:40.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.926+0000 7f2397dd0a80 1 Processor -- start 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.926+0000 7f2397dd0a80 1 -- start start 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.926+0000 7f2397dd0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.926+0000 7f2397dd0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c2066500 con 0x5568c1fc4800 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.926+0000 7f2395d7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.926+0000 7f2395d7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36008/0 (socket says 172.21.15.155:36008) 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.926+0000 7f2395d7a700 1 -- 172.21.15.155:0/1508594694 learned_addr learned my addr 172.21.15.155:0/1508594694 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.926+0000 7f2395d7a700 1 -- 172.21.15.155:0/1508594694 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c1fedba0 con 0x5568c1fc4800 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2395d7a700 1 --2- 172.21.15.155:0/1508594694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x5568c2d95d70 tx=0x5568c20b5b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3b19c3b1472b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2394577700 1 -- 172.21.15.155:0/1508594694 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c207d4a0 con 0x5568c1fc4800 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2394577700 1 -- 172.21.15.155:0/1508594694 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c22efb00 con 0x5568c1fc4800 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2394577700 1 -- 172.21.15.155:0/1508594694 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c207d600 con 0x5568c1fc4800 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1508594694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 msgr2=0x5568c22acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/1508594694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x5568c2d95d70 tx=0x5568c20b5b60 comp rx=0 tx=0).stop 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1508594694 shutdown_connections 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/1508594694 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1508594694 >> 172.21.15.155:0/1508594694 conn(0x5568c1fc4400 msgr2=0x5568c20b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1508594694 shutdown_connections 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1508594694 wait complete. 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.927+0000 7f2397dd0a80 1 Processor -- start 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2397dd0a80 1 -- start start 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2397dd0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2397dd0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c20663c0 con 0x5568c1fc4800 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2395d7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2395d7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36020/0 (socket says 172.21.15.155:36020) 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2395d7a700 1 -- 172.21.15.155:0/2669564950 learned_addr learned my addr 172.21.15.155:0/2669564950 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2395d7a700 1 -- 172.21.15.155:0/2669564950 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c1feda00 con 0x5568c1fc4800 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2395d7a700 1 --2- 172.21.15.155:0/2669564950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x5568c2d95e00 tx=0x5568c20b5920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2392d74700 1 -- 172.21.15.155:0/2669564950 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c207d8c0 con 0x5568c1fc4800 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2392d74700 1 -- 172.21.15.155:0/2669564950 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c2065c80 con 0x5568c1fc4800 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2669564950 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5568c1fed860 con 0x5568c1fc4800 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.928+0000 7f2392d74700 1 -- 172.21.15.155:0/2669564950 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c207d4a0 con 0x5568c1fc4800 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.929+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2669564950 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568c1fed6c0 con 0x5568c1fc4800 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.929+0000 7f2397dd0a80 1 Processor -- start 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.929+0000 7f2392d74700 1 -- 172.21.15.155:0/2669564950 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5568c2d66b00 con 0x5568c1fc4800 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.929+0000 7f2397dd0a80 1 -- start start 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.929+0000 7f2392d74700 1 --2- 172.21.15.155:0/2669564950 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c2348000 0x5568c22ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.929+0000 7f2397dd0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.929+0000 7f2397dd0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c2000640 con 0x5568c1fc5800 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.929+0000 7f2392d74700 1 -- 172.21.15.155:0/2669564950 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5568c203f180 con 0x5568c1fc4800 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.929+0000 7f239657b700 1 --2- 172.21.15.155:0/2669564950 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c2348000 0x5568c22ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f2395d7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f2395d7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36034/0 (socket says 172.21.15.155:36034) 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f2395d7a700 1 -- 172.21.15.155:0/3504018661 learned_addr learned my addr 172.21.15.155:0/3504018661 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f2395d7a700 1 -- 172.21.15.155:0/3504018661 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c1fec000 con 0x5568c1fc5800 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f239657b700 1 --2- 172.21.15.155:0/2669564950 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c2348000 0x5568c22ad080 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5568c2e4eae0 tx=0x5568c230e060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f2395d7a700 1 --2- 172.21.15.155:0/3504018661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5568c2e4e1e0 tx=0x5568c230e240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68604d46f3635ed5 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f239056f700 1 -- 172.21.15.155:0/3504018661 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c207d600 con 0x5568c1fc5800 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f239056f700 1 -- 172.21.15.155:0/3504018661 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c2065e00 con 0x5568c1fc5800 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f239056f700 1 -- 172.21.15.155:0/3504018661 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c207da20 con 0x5568c1fc5800 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f2397dd0a80 1 -- 172.21.15.155:0/3504018661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 msgr2=0x5568c22ad600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/3504018661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5568c2e4e1e0 tx=0x5568c230e240 comp rx=0 tx=0).stop 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f2397dd0a80 1 -- 172.21.15.155:0/3504018661 shutdown_connections 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/3504018661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.930+0000 7f2397dd0a80 1 -- 172.21.15.155:0/3504018661 >> 172.21.15.155:0/3504018661 conn(0x5568c1fc5400 msgr2=0x5568c20b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.931+0000 7f2397dd0a80 1 -- 172.21.15.155:0/3504018661 shutdown_connections 2024-04-19T23:45:40.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.931+0000 7f2397dd0a80 1 -- 172.21.15.155:0/3504018661 wait complete. 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.931+0000 7f2397dd0a80 1 Processor -- start 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.931+0000 7f2397dd0a80 1 -- start start 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.931+0000 7f2397dd0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.931+0000 7f2397dd0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c20008c0 con 0x5568c1fc5800 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.931+0000 7f2395d7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.931+0000 7f2395d7a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36046/0 (socket says 172.21.15.155:36046) 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.931+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 learned_addr learned my addr 172.21.15.155:0/4269700174 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.931+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c1fecea0 con 0x5568c1fc5800 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.931+0000 7f2395d7a700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x5568c232ea80 tx=0x5568c230e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.932+0000 7f238ed6c700 1 -- 172.21.15.155:0/4269700174 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c207d600 con 0x5568c1fc5800 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.932+0000 7f238ed6c700 1 -- 172.21.15.155:0/4269700174 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c2372000 con 0x5568c1fc5800 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.932+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5568c1fec820 con 0x5568c1fc5800 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.932+0000 7f238ed6c700 1 -- 172.21.15.155:0/4269700174 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c207da20 con 0x5568c1fc5800 2024-04-19T23:45:40.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.932+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568c1fec9c0 con 0x5568c1fc5800 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.932+0000 7f238ed6c700 1 -- 172.21.15.155:0/4269700174 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5568c2d66dc0 con 0x5568c1fc5800 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.932+0000 7f238ed6c700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c2349000 0x5568c22ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f238ed6c700 1 -- 172.21.15.155:0/4269700174 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5568c203f340 con 0x5568c1fc5800 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f2395579700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c2349000 0x5568c22ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5568c1fc5c00 0x5568c22adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2349400 con 0x5568c1fc5c00 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f239657b700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5568c1fc5c00 0x5568c22adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f2395579700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c2349000 0x5568c22ae680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5568c22a7a40 tx=0x5568c20b5800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f239657b700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5568c1fc5c00 0x5568c22adb80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f2397dd0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f2397dd0a80 20 realm 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.933+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2349800 con 0x5568c1fc5c00 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2349c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2349400 con 0x5568c1fc5c00 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2349800 con 0x5568c1fc5c00 2024-04-19T23:45:40.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 20 searching for the correct realm 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5568c2349c00 0x5568c22ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2349400 con 0x5568c2349c00 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.934+0000 7f2395d7a700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5568c2349c00 0x5568c22ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.935+0000 7f2395d7a700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5568c2349c00 0x5568c22ae100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.935+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.935+0000 7f2395d7a700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5568c2349400 0x5568c22aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.935+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2348800 con 0x5568c2349400 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.935+0000 7f2395579700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5568c2349400 0x5568c22aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.935+0000 7f2395579700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5568c2349400 0x5568c22aec00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.936+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.936+0000 7f2395579700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5568c2348800 0x5568c22ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.936+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2348800 2024-04-19T23:45:40.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.936+0000 7f239657b700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5568c2348800 0x5568c22ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.936+0000 7f239657b700 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5568c2348800 0x5568c22ac580 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.937+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.937+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.937+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.937+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.937+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.937+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2348800 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.937+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.937+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2348800 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.937+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.937+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349400 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.938+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.938+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349c00 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.938+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.938+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.938+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.938+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2348800 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.938+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.938+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.938+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.938+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349400 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.939+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.939+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349c00 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.939+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.939+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349c00 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.939+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.939+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2348800 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.939+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.939+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349c00 2024-04-19T23:45:40.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.940+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.940+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349c00 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.940+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.940+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.940+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.940+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.940+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.940+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2348800 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.941+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.941+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349c00 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.941+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.941+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349400 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.941+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.941+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.941+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.941+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2348800 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.941+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.941+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349c00 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.942+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.942+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2348800 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.942+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.942+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349400 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.942+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.942+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349c00 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.942+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.942+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2348800 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c2349400 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f2397dd0a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:40.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f2397dd0a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:40.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f2397dd0a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:40.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f2397dd0a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:40.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2349800 con 0x5568c1fc5c00 2024-04-19T23:45:40.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f2397dd0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.943+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4000 con 0x5568c1fc5c00 2024-04-19T23:45:40.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:40.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4400 con 0x5568c2349400 2024-04-19T23:45:40.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:40.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 20 zone default found 2024-04-19T23:45:40.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 4 Realm: () 2024-04-19T23:45:40.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:40.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:40.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:40.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 20 zonegroup default 2024-04-19T23:45:40.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4800 con 0x5568c2348800 2024-04-19T23:45:40.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.944+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4c00 con 0x5568c2349c00 2024-04-19T23:45:40.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.945+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.945+0000 7f2397dd0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.945+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.945+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5000 con 0x5568c2349c00 2024-04-19T23:45:40.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.945+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.945+0000 7f2397dd0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:40.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.945+0000 7f2397dd0a80 20 started sync module instance, tier type = 2024-04-19T23:45:40.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.945+0000 7f2397dd0a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:40.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.945+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5400 con 0x5568c2349400 2024-04-19T23:45:40.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.946+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.946+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93908422507264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5800 con 0x5568c2349400 2024-04-19T23:45:40.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.946+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.947+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93908422507264] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.947+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.947+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93908422508416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4000 con 0x5568c1fc5c00 2024-04-19T23:45:40.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.947+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4800 con 0x5568c2349c00 2024-04-19T23:45:40.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.948+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93908422508416] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.948+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.948+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93908422509568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5c00 con 0x5568c2349c00 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.948+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4400 con 0x5568c2349400 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.949+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.949+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93908422510720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5400 con 0x5568c2349400 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.949+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5800 con 0x5568c1fc5c00 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.949+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93908422509568] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.950+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.951+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93908422511872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c1fc4c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.951+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93908422510720] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.951+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2349800 con 0x5568c2348800 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.952+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.952+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93908422513024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4c00 con 0x5568c2348800 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.952+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93908422511872] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.952+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5000 con 0x5568c2348800 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.953+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.953+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93908422514176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4800 con 0x5568c2348800 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.953+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5c00 con 0x5568c2348800 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.953+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93908422513024] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.953+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93908422514176] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93908422515328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4000 con 0x5568c2348800 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f2397dd0a80 20 add_watcher() i=0 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f2397dd0a80 20 add_watcher() i=1 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f2397dd0a80 20 add_watcher() i=2 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f2397dd0a80 20 add_watcher() i=3 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f2397dd0a80 20 add_watcher() i=4 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f2397dd0a80 20 add_watcher() i=5 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f2397dd0a80 20 add_watcher() i=6 2024-04-19T23:45:40.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93908422515328] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f2397dd0a80 20 add_watcher() i=7 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f2397dd0a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.954+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5800 con 0x5568c1fc5c00 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.955+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.955+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93908423925760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.956+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93908423925760] v30'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.956+0000 7f237cd48700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.956+0000 7f2397dd0a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.956+0000 7f2397dd0a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.956+0000 7f2397dd0a80 1 Processor -- start 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.956+0000 7f2397dd0a80 1 -- start start 2024-04-19T23:45:40.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.956+0000 7f2397dd0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.956+0000 7f2397dd0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c20663c0 con 0x5568c1fc4c00 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.957+0000 7f2395579700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.957+0000 7f2395579700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36058/0 (socket says 172.21.15.155:36058) 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.957+0000 7f2395579700 1 -- 172.21.15.155:0/1302699784 learned_addr learned my addr 172.21.15.155:0/1302699784 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.957+0000 7f2395579700 1 -- 172.21.15.155:0/1302699784 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c1fecb60 con 0x5568c1fc4c00 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.957+0000 7f2395579700 1 --2- 172.21.15.155:0/1302699784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x5568c238d7a0 tx=0x5568c230e1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea7c25f34f675cc server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.957+0000 7f237c547700 1 -- 172.21.15.155:0/1302699784 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c207d760 con 0x5568c1fc4c00 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.957+0000 7f237c547700 1 -- 172.21.15.155:0/1302699784 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c2372600 con 0x5568c1fc4c00 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.957+0000 7f237c547700 1 -- 172.21.15.155:0/1302699784 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c23fc160 con 0x5568c1fc4c00 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.958+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1302699784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 msgr2=0x5568c22af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.958+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/1302699784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x5568c238d7a0 tx=0x5568c230e1e0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.958+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1302699784 shutdown_connections 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.958+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/1302699784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.958+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1302699784 >> 172.21.15.155:0/1302699784 conn(0x5568c2349800 msgr2=0x5568c20b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.958+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1302699784 shutdown_connections 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.958+0000 7f2397dd0a80 1 -- 172.21.15.155:0/1302699784 wait complete. 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.958+0000 7f2397dd0a80 1 Processor -- start 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.958+0000 7f2397dd0a80 1 -- start start 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.958+0000 7f2397dd0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.958+0000 7f2397dd0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c2066500 con 0x5568c1fc4c00 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.959+0000 7f2395579700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.959+0000 7f2395579700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36068/0 (socket says 172.21.15.155:36068) 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.959+0000 7f2395579700 1 -- 172.21.15.155:0/2603334936 learned_addr learned my addr 172.21.15.155:0/2603334936 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.959+0000 7f2395579700 1 -- 172.21.15.155:0/2603334936 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c1fecd00 con 0x5568c1fc4c00 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.959+0000 7f2395579700 1 --2- 172.21.15.155:0/2603334936 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x5568c24061b0 tx=0x5568c230f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.959+0000 7f237ad44700 1 -- 172.21.15.155:0/2603334936 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c23fc2c0 con 0x5568c1fc4c00 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.959+0000 7f237ad44700 1 -- 172.21.15.155:0/2603334936 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c2372780 con 0x5568c1fc4c00 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.959+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2603334936 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5568c1fec340 con 0x5568c1fc4c00 2024-04-19T23:45:40.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.959+0000 7f237ad44700 1 -- 172.21.15.155:0/2603334936 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c23fc420 con 0x5568c1fc4c00 2024-04-19T23:45:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.959+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2603334936 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568c1fedd40 con 0x5568c1fc4c00 2024-04-19T23:45:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.960+0000 7f237ad44700 1 -- 172.21.15.155:0/2603334936 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5568c2d67b80 con 0x5568c1fc4c00 2024-04-19T23:45:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.960+0000 7f237ad44700 1 --2- 172.21.15.155:0/2603334936 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c23f5000 0x5568c2494000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.960+0000 7f237ad44700 1 -- 172.21.15.155:0/2603334936 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5568c203f6c0 con 0x5568c1fc4c00 2024-04-19T23:45:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.960+0000 7f2397dd0a80 5 note: GC not initialized 2024-04-19T23:45:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.960+0000 7f239657b700 1 --2- 172.21.15.155:0/2603334936 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c23f5000 0x5568c2494000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.960+0000 7f239657b700 1 --2- 172.21.15.155:0/2603334936 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c23f5000 0x5568c2494000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5568c2407e30 tx=0x5568c230e900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.961+0000 7f237853f700 20 reqs_thread_entry: start 2024-04-19T23:45:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.961+0000 7f2397dd0a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:40.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.961+0000 7f2397dd0a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.961+0000 7f237653b700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:11 2024 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.961+0000 7f2375d19700 20 reqs_thread_entry: start 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.961+0000 7f2397dd0a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.961+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.961+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5c00 con 0x5568c1fc5c00 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4000 con 0x5568c2349400 2024-04-19T23:45:40.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 : miss 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.962+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5800 con 0x5568c1fc5c00 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.963+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.963+0000 7f2397dd0a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.963+0000 7f2397dd0a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.963+0000 7f2397dd0a80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.963+0000 7f2397dd0a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.963+0000 7f2397dd0a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.963+0000 7f2397dd0a80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.963+0000 7f2397dd0a80 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.963+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f4c00 con 0x5568c2348800 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.964+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(65 fud.buckets [call] v30'3 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.964+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2500400 con 0x5568c1fc5c00 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(66 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'3 uv3 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f2397dd0a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f2397dd0a80 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f2397dd0a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f2397dd0a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1, ofs0, ns] 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93908423928064 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2500c00 con 0x5568c2349c00 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 93908422509568 notify 128849018885 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x5568c2388b60 con 0x5568c2349c00 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f239056f700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 93908422509568 notifier 4557 bl.length()=725 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f239056f700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f239056f700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f239056f700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f239056f700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c250e000 con 0x5568c2349c00 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.965+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(67 notify.2 [notify cookie 93908423928064 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.966+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.966+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== watch-notify(notify_complete (2) cookie 93908423928064 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5568c2388d00 con 0x5568c2349c00 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.966+0000 7f2397dd0a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_sources= new_sources= 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.966+0000 7f2397dd0a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential sources added=[] removed=[] 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.966+0000 7f2397dd0a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_dests= new_dests= 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.966+0000 7f2397dd0a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential dests added=[] removed=[] 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.966+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2501000 con 0x5568c2349400 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.967+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(69 foo.buckets [call] v30'22 uv22 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.967+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2501400 con 0x5568c2349400 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.968+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.968+0000 7f2397dd0a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.968+0000 7f2397dd0a80 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.968+0000 7f2397dd0a80 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.968+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93908423928064 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2501800 con 0x5568c2348800 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.969+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== watch-notify(notify (1) cookie 93908422514176 notify 128849018894 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x5568c24ff6c0 con 0x5568c2348800 2024-04-19T23:45:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.969+0000 7f238fd6e700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 93908422514176 notifier 4557 bl.length()=314 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.969+0000 7f238fd6e700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.969+0000 7f238fd6e700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.969+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.6 [notify cookie 93908423928064 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.969+0000 7f238fd6e700 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c23f5c00 con 0x5568c2348800 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.969+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.969+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== watch-notify(notify_complete (2) cookie 93908423928064 notify 128849018894 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5568c24ff860 con 0x5568c2348800 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.970+0000 7f237cd48700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.970+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93908423925760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c250e800 con 0x5568c1fc5c00 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.971+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93908423925760] v30'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.971+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93908422507264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c250ec00 con 0x5568c2349400 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.972+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93908422507264] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.972+0000 7f2397dd0a80 20 remove_watcher() i=0 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.972+0000 7f2397dd0a80 2 removed watcher, disabling cache 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.972+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93908422508416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c250f000 con 0x5568c1fc5c00 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.973+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93908422508416] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.973+0000 7f2397dd0a80 20 remove_watcher() i=1 2024-04-19T23:45:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.973+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93908422509568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c250f400 con 0x5568c2349c00 2024-04-19T23:45:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.974+0000 7f2395d7a700 1 -- 172.21.15.155:0/4269700174 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93908422509568] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e5200 con 0x5568c2349c00 2024-04-19T23:45:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.974+0000 7f2397dd0a80 20 remove_watcher() i=2 2024-04-19T23:45:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.974+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93908422510720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c250f800 con 0x5568c2349400 2024-04-19T23:45:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.975+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93908422510720] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e5440 con 0x5568c2349400 2024-04-19T23:45:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.975+0000 7f2397dd0a80 20 remove_watcher() i=3 2024-04-19T23:45:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.975+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93908422511872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c250fc00 con 0x5568c1fc5c00 2024-04-19T23:45:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.976+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93908422511872] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c1fc5c00 2024-04-19T23:45:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.976+0000 7f2397dd0a80 20 remove_watcher() i=4 2024-04-19T23:45:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.976+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93908422513024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2501c00 con 0x5568c2348800 2024-04-19T23:45:40.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.977+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93908422513024] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.977+0000 7f2397dd0a80 20 remove_watcher() i=5 2024-04-19T23:45:40.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.977+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93908422514176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2500800 con 0x5568c2348800 2024-04-19T23:45:40.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.978+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93908422514176] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.978+0000 7f2397dd0a80 20 remove_watcher() i=6 2024-04-19T23:45:40.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.978+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93908422515328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5568c2500000 con 0x5568c2348800 2024-04-19T23:45:40.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f239657b700 1 -- 172.21.15.155:0/4269700174 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93908422515328] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5568c23e4b40 con 0x5568c2348800 2024-04-19T23:45:40.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 20 remove_watcher() i=7 2024-04-19T23:45:40.992 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5568c2348800 msgr2=0x5568c22ac580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5568c2348800 0x5568c22ac580 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5568c1fc5c00 msgr2=0x5568c22adb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5568c1fc5c00 0x5568c22adb80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5568c2349400 msgr2=0x5568c22aec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5568c2349400 0x5568c22aec00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5568c2349c00 msgr2=0x5568c22ae100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5568c2349c00 0x5568c22ae100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c2349000 msgr2=0x5568c22ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c2349000 0x5568c22ae680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5568c22a7a40 tx=0x5568c20b5800 comp rx=0 tx=0).stop 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 msgr2=0x5568c22ad600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x5568c232ea80 tx=0x5568c230e8a0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2395579700 1 -- 172.21.15.155:0/4269700174 reap_dead start 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 shutdown_connections 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/4269700174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc5800 0x5568c22ad600 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 >> 172.21.15.155:0/4269700174 conn(0x5568c1fc5400 msgr2=0x5568c20b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 shutdown_connections 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.979+0000 7f2397dd0a80 1 -- 172.21.15.155:0/4269700174 wait complete. 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2603334936 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c23f5000 msgr2=0x5568c2494000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/2603334936 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c23f5000 0x5568c2494000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5568c2407e30 tx=0x5568c230e900 comp rx=0 tx=0).stop 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2603334936 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 msgr2=0x5568c22af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/2603334936 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x5568c24061b0 tx=0x5568c230f740 comp rx=0 tx=0).stop 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2603334936 shutdown_connections 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/2603334936 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c23f5000 0x5568c2494000 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/2603334936 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4c00 0x5568c22af180 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2603334936 >> 172.21.15.155:0/2603334936 conn(0x5568c2349800 msgr2=0x5568c20b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2603334936 shutdown_connections 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2603334936 wait complete. 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2669564950 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c2348000 msgr2=0x5568c22ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/2669564950 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c2348000 0x5568c22ad080 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5568c2e4eae0 tx=0x5568c230e060 comp rx=0 tx=0).stop 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2669564950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 msgr2=0x5568c22acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:40.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/2669564950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x5568c2d95e00 tx=0x5568c20b5920 comp rx=0 tx=0).stop 2024-04-19T23:45:40.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2669564950 shutdown_connections 2024-04-19T23:45:40.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/2669564950 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5568c2348000 0x5568c22ad080 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 --2- 172.21.15.155:0/2669564950 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5568c1fc4800 0x5568c22acb00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:40.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2669564950 >> 172.21.15.155:0/2669564950 conn(0x5568c1fc4400 msgr2=0x5568c20b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:40.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2669564950 shutdown_connections 2024-04-19T23:45:40.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:40.980+0000 7f2397dd0a80 1 -- 172.21.15.155:0/2669564950 wait complete. 2024-04-19T23:45:40.995 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-19T23:45:40.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-19T23:45:40.995 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-19T23:45:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:41.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.041+0000 7fd331d6ca80 1 Processor -- start 2024-04-19T23:45:41.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.041+0000 7fd331d6ca80 1 -- start start 2024-04-19T23:45:41.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd331d6ca80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55696b450c00 0x55696b738580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd331d6ca80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55696b77b500 con 0x55696b450800 2024-04-19T23:45:41.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd331d6ca80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55696b4f2a00 con 0x55696b450c00 2024-04-19T23:45:41.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd32fd16700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55696b450800 0x55696b53c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46792/0 (socket says 172.21.15.155:46792) 2024-04-19T23:45:41.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd32fd16700 1 -- 172.21.15.155:0/2058839712 learned_addr learned my addr 172.21.15.155:0/2058839712 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:41.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd32f515700 1 --2- 172.21.15.155:0/2058839712 >> v2:172.21.15.76:3300/0 conn(0x55696b450c00 0x55696b738580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd32ed14700 1 -- 172.21.15.155:0/2058839712 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131960789 0 0) 0x55696c21e000 con 0x55696b450800 2024-04-19T23:45:41.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd32ed14700 1 -- 172.21.15.155:0/2058839712 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55696b77b680 con 0x55696b450800 2024-04-19T23:45:41.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd32f515700 1 -- 172.21.15.155:0/2058839712 >> v1:172.21.15.76:6789/0 conn(0x55696b450800 legacy=0x55696b53c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd32f515700 1 -- 172.21.15.155:0/2058839712 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55696b479d40 con 0x55696b450c00 2024-04-19T23:45:41.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd32f515700 1 --2- 172.21.15.155:0/2058839712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450c00 0x55696b738580 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55696b733890 tx=0x55696b541980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db370cc8897f2ca server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd32ed14700 1 -- 172.21.15.155:0/2058839712 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b5094a0 con 0x55696b450c00 2024-04-19T23:45:41.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd32ed14700 1 -- 172.21.15.155:0/2058839712 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55696b77b680 con 0x55696b450c00 2024-04-19T23:45:41.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.042+0000 7fd32ed14700 1 -- 172.21.15.155:0/2058839712 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b509600 con 0x55696b450c00 2024-04-19T23:45:41.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.043+0000 7fd331d6ca80 1 -- 172.21.15.155:0/2058839712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450c00 msgr2=0x55696b738580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.043+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/2058839712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450c00 0x55696b738580 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55696b733890 tx=0x55696b541980 comp rx=0 tx=0).stop 2024-04-19T23:45:41.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.043+0000 7fd331d6ca80 1 -- 172.21.15.155:0/2058839712 shutdown_connections 2024-04-19T23:45:41.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.043+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/2058839712 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450c00 0x55696b738580 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.043+0000 7fd331d6ca80 1 -- 172.21.15.155:0/2058839712 >> 172.21.15.155:0/2058839712 conn(0x55696b450400 msgr2=0x55696b53c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.043+0000 7fd331d6ca80 1 -- 172.21.15.155:0/2058839712 shutdown_connections 2024-04-19T23:45:41.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.043+0000 7fd331d6ca80 1 -- 172.21.15.155:0/2058839712 wait complete. 2024-04-19T23:45:41.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.044+0000 7fd331d6ca80 1 Processor -- start 2024-04-19T23:45:41.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.044+0000 7fd331d6ca80 1 -- start start 2024-04-19T23:45:41.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.044+0000 7fd331d6ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.044+0000 7fd331d6ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55696b4f2500 con 0x55696b450800 2024-04-19T23:45:41.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.044+0000 7fd32fd16700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.044+0000 7fd32fd16700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36074/0 (socket says 172.21.15.155:36074) 2024-04-19T23:45:41.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.044+0000 7fd32fd16700 1 -- 172.21.15.155:0/1335801138 learned_addr learned my addr 172.21.15.155:0/1335801138 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.044+0000 7fd32fd16700 1 -- 172.21.15.155:0/1335801138 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55696b479ba0 con 0x55696b450800 2024-04-19T23:45:41.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd32fd16700 1 --2- 172.21.15.155:0/1335801138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55696c221770 tx=0x55696b541b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb69504d308bfe65 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd32e513700 1 -- 172.21.15.155:0/1335801138 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b5094a0 con 0x55696b450800 2024-04-19T23:45:41.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd32e513700 1 -- 172.21.15.155:0/1335801138 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55696b77bb00 con 0x55696b450800 2024-04-19T23:45:41.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd32e513700 1 -- 172.21.15.155:0/1335801138 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b509600 con 0x55696b450800 2024-04-19T23:45:41.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1335801138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 msgr2=0x55696b738580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/1335801138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55696c221770 tx=0x55696b541b60 comp rx=0 tx=0).stop 2024-04-19T23:45:41.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1335801138 shutdown_connections 2024-04-19T23:45:41.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/1335801138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1335801138 >> 172.21.15.155:0/1335801138 conn(0x55696b450400 msgr2=0x55696b53d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1335801138 shutdown_connections 2024-04-19T23:45:41.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1335801138 wait complete. 2024-04-19T23:45:41.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.045+0000 7fd331d6ca80 1 Processor -- start 2024-04-19T23:45:41.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.046+0000 7fd331d6ca80 1 -- start start 2024-04-19T23:45:41.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.046+0000 7fd331d6ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.046+0000 7fd331d6ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55696b4f23c0 con 0x55696b450800 2024-04-19T23:45:41.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.046+0000 7fd32fd16700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.046+0000 7fd32fd16700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36088/0 (socket says 172.21.15.155:36088) 2024-04-19T23:45:41.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.046+0000 7fd32fd16700 1 -- 172.21.15.155:0/1526708023 learned_addr learned my addr 172.21.15.155:0/1526708023 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.046+0000 7fd32fd16700 1 -- 172.21.15.155:0/1526708023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55696b479a00 con 0x55696b450800 2024-04-19T23:45:41.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.046+0000 7fd32fd16700 1 --2- 172.21.15.155:0/1526708023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55696c221e30 tx=0x55696b541920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.046+0000 7fd32cd10700 1 -- 172.21.15.155:0/1526708023 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b5098c0 con 0x55696b450800 2024-04-19T23:45:41.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.046+0000 7fd32cd10700 1 -- 172.21.15.155:0/1526708023 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55696b4f1c80 con 0x55696b450800 2024-04-19T23:45:41.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.046+0000 7fd32cd10700 1 -- 172.21.15.155:0/1526708023 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b5094a0 con 0x55696b450800 2024-04-19T23:45:41.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1526708023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55696b479860 con 0x55696b450800 2024-04-19T23:45:41.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1526708023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55696b4796c0 con 0x55696b450800 2024-04-19T23:45:41.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd331d6ca80 1 Processor -- start 2024-04-19T23:45:41.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd331d6ca80 1 -- start start 2024-04-19T23:45:41.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd32cd10700 1 -- 172.21.15.155:0/1526708023 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55696c1f2b00 con 0x55696b450800 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd331d6ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 0x55696b738b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd331d6ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55696b48c640 con 0x55696b451400 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd32cd10700 1 --2- 172.21.15.155:0/1526708023 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b7d2000 0x55696b739080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd32cd10700 1 -- 172.21.15.155:0/1526708023 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55696b4cb180 con 0x55696b450800 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd330517700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 0x55696b738b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd330517700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 0x55696b738b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36104/0 (socket says 172.21.15.155:36104) 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.047+0000 7fd330517700 1 -- 172.21.15.155:0/1185628049 learned_addr learned my addr 172.21.15.155:0/1185628049 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.048+0000 7fd32fd16700 1 --2- 172.21.15.155:0/1526708023 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b7d2000 0x55696b739080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.048+0000 7fd330517700 1 -- 172.21.15.155:0/1185628049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55696b478000 con 0x55696b451400 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.048+0000 7fd32fd16700 1 --2- 172.21.15.155:0/1526708023 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b7d2000 0x55696b739080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55696c2def00 tx=0x55696b79a240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.048+0000 7fd330517700 1 --2- 172.21.15.155:0/1185628049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 0x55696b738b00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55696c221e90 tx=0x55696b79a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c84c81a90f0bd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.048+0000 7fd32a50b700 1 -- 172.21.15.155:0/1185628049 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b5098c0 con 0x55696b451400 2024-04-19T23:45:41.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.048+0000 7fd32a50b700 1 -- 172.21.15.155:0/1185628049 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55696b77a480 con 0x55696b451400 2024-04-19T23:45:41.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.048+0000 7fd32a50b700 1 -- 172.21.15.155:0/1185628049 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b5094a0 con 0x55696b451400 2024-04-19T23:45:41.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1185628049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 msgr2=0x55696b738b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/1185628049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 0x55696b738b00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55696c221e90 tx=0x55696b79a9c0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1185628049 shutdown_connections 2024-04-19T23:45:41.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/1185628049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 0x55696b738b00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1185628049 >> 172.21.15.155:0/1185628049 conn(0x55696b450c00 msgr2=0x55696b53d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1185628049 shutdown_connections 2024-04-19T23:45:41.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1185628049 wait complete. 2024-04-19T23:45:41.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd331d6ca80 1 Processor -- start 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd331d6ca80 1 -- start start 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd331d6ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 0x55696b738b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd331d6ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55696b48c8c0 con 0x55696b451400 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd330517700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 0x55696b738b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd330517700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 0x55696b738b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36118/0 (socket says 172.21.15.155:36118) 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.049+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 learned_addr learned my addr 172.21.15.155:0/3653508949 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.050+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55696b478ea0 con 0x55696b451400 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.050+0000 7fd330517700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 0x55696b738b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55696c2de450 tx=0x55696b541f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.050+0000 7fd328d08700 1 -- 172.21.15.155:0/3653508949 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b509b80 con 0x55696b451400 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.050+0000 7fd328d08700 1 -- 172.21.15.155:0/3653508949 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55696b77a180 con 0x55696b451400 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.050+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55696b478820 con 0x55696b451400 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.050+0000 7fd328d08700 1 -- 172.21.15.155:0/3653508949 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b5098c0 con 0x55696b451400 2024-04-19T23:45:41.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.050+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55696b4789c0 con 0x55696b451400 2024-04-19T23:45:41.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.051+0000 7fd328d08700 1 -- 172.21.15.155:0/3653508949 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55696c1f2dc0 con 0x55696b451400 2024-04-19T23:45:41.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.051+0000 7fd328d08700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b7d2c00 0x55696b739600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.051+0000 7fd328d08700 1 -- 172.21.15.155:0/3653508949 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55696b4cb340 con 0x55696b451400 2024-04-19T23:45:41.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.051+0000 7fd32f515700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b7d2c00 0x55696b739600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.051+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.051+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55696b451800 0x55696b739b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.051+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b451c00 con 0x55696b451800 2024-04-19T23:45:41.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.051+0000 7fd330517700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55696b451800 0x55696b739b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.051+0000 7fd32f515700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b7d2c00 0x55696b739600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55696b733890 tx=0x55696b541800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.051+0000 7fd330517700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55696b451800 0x55696b739b80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 20 realm 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3000 con 0x55696b451800 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3400 con 0x55696b451800 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3800 con 0x55696b451800 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.052+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3c00 con 0x55696b451800 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.053+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.053+0000 7fd331d6ca80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.053+0000 7fd331d6ca80 20 searching for the correct realm 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.053+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55696b7d3000 0x55696b73a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.053+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3400 con 0x55696b7d3000 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.053+0000 7fd32fd16700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55696b7d3000 0x55696b73a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.053+0000 7fd32fd16700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55696b7d3000 0x55696b73a100 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.054+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.054+0000 7fd32fd16700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55696b7d3400 0x55696b73ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.054+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898000 con 0x55696b7d3400 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.054+0000 7fd32f515700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55696b7d3400 0x55696b73ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.054+0000 7fd32f515700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55696b7d3400 0x55696b73ac00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.054+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.054+0000 7fd32f515700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55696b898000 0x55696b73b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.054+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b898000 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.055+0000 7fd330517700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55696b898000 0x55696b73b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.055+0000 7fd330517700 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55696b898000 0x55696b73b180 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.055+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.055+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b451800 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.055+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.055+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b451800 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.056+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.056+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b898000 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.056+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.056+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b898000 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.056+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.056+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3400 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.056+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.056+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3000 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.057+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.057+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b451800 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.057+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.057+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b898000 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.057+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.057+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b451800 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.057+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.057+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3400 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.058+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.058+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3000 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.058+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.058+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3000 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.058+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.058+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b898000 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.058+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.058+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3000 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.059+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.059+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3000 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.059+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.059+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b451800 2024-04-19T23:45:41.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.059+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.059+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b451800 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.059+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.059+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b898000 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.060+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.060+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3000 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.060+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.060+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3400 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.060+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.060+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b451800 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.060+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.060+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b898000 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.061+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.061+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3000 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.061+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.061+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b898000 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.061+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.061+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3400 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.061+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.061+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3000 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.061+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.061+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b898000 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.062+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.062+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b451800 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.062+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.062+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3400 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.062+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.062+0000 7fd331d6ca80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:41.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.062+0000 7fd331d6ca80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.062+0000 7fd331d6ca80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.062+0000 7fd331d6ca80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.062+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.062+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b451c00 con 0x55696b451800 2024-04-19T23:45:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898c00 con 0x55696b451800 2024-04-19T23:45:41.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899000 con 0x55696b7d3400 2024-04-19T23:45:41.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 20 zone default found 2024-04-19T23:45:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 4 Realm: () 2024-04-19T23:45:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 20 zonegroup default 2024-04-19T23:45:41.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.063+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899400 con 0x55696b898000 2024-04-19T23:45:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd331d6ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899800 con 0x55696b7d3000 2024-04-19T23:45:41.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd331d6ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899c00 con 0x55696b7d3000 2024-04-19T23:45:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd331d6ca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd331d6ca80 20 started sync module instance, tier type = 2024-04-19T23:45:41.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd331d6ca80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:41.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.064+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898c00 con 0x55696b7d3400 2024-04-19T23:45:41.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.065+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.065+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93911262624512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b451c00 con 0x55696b7d3400 2024-04-19T23:45:41.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.065+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3800 con 0x55696b451800 2024-04-19T23:45:41.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.066+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93911262624512] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.066+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.067+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93911262625664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3c00 con 0x55696b451800 2024-04-19T23:45:41.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.067+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b7d3000 2024-04-19T23:45:41.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.067+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93911262625664] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.068+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.068+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93911262626816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899000 con 0x55696b7d3000 2024-04-19T23:45:41.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.068+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898c00 con 0x55696b7d3400 2024-04-19T23:45:41.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.069+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93911262626816] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.069+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.069+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93911262627968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898400 con 0x55696b7d3400 2024-04-19T23:45:41.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.069+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899800 con 0x55696b451800 2024-04-19T23:45:41.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.070+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93911262627968] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.070+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.070+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93911262629120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899c00 con 0x55696b451800 2024-04-19T23:45:41.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.070+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898800 con 0x55696b898000 2024-04-19T23:45:41.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.071+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93911262629120] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.071+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.071+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93911262630272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899400 con 0x55696b898000 2024-04-19T23:45:41.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.071+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899800 con 0x55696b898000 2024-04-19T23:45:41.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.072+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.072+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93911262631424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899c00 con 0x55696b898000 2024-04-19T23:45:41.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.072+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3800 con 0x55696b898000 2024-04-19T23:45:41.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.072+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93911262630272] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93911262632576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3c00 con 0x55696b898000 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd331d6ca80 20 add_watcher() i=0 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd331d6ca80 20 add_watcher() i=1 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd331d6ca80 20 add_watcher() i=2 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd331d6ca80 20 add_watcher() i=3 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd331d6ca80 20 add_watcher() i=4 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd331d6ca80 20 add_watcher() i=5 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93911262631424] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd331d6ca80 20 add_watcher() i=6 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93911262632576] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd331d6ca80 20 add_watcher() i=7 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd331d6ca80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.074+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3800 con 0x55696b451800 2024-04-19T23:45:41.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.075+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.075+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93911264149504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3c00 con 0x55696b451800 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.076+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93911264149504] v30'122 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.076+0000 7fd316ce4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.076+0000 7fd331d6ca80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.076+0000 7fd331d6ca80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.076+0000 7fd331d6ca80 1 Processor -- start 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.076+0000 7fd331d6ca80 1 -- start start 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.076+0000 7fd331d6ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.076+0000 7fd331d6ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55696b4f23c0 con 0x55696b899400 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.077+0000 7fd32f515700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.077+0000 7fd32f515700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36128/0 (socket says 172.21.15.155:36128) 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.077+0000 7fd32f515700 1 -- 172.21.15.155:0/515232173 learned_addr learned my addr 172.21.15.155:0/515232173 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.077+0000 7fd32f515700 1 -- 172.21.15.155:0/515232173 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55696b478b60 con 0x55696b899400 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.077+0000 7fd32f515700 1 --2- 172.21.15.155:0/515232173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x55696b83b800 tx=0x55696b79b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b11d2be11fed466 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.077+0000 7fd3164e3700 1 -- 172.21.15.155:0/515232173 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b509760 con 0x55696b899400 2024-04-19T23:45:41.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.077+0000 7fd3164e3700 1 -- 172.21.15.155:0/515232173 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55696b8bc000 con 0x55696b899400 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.077+0000 7fd3164e3700 1 -- 172.21.15.155:0/515232173 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b8be000 con 0x55696b899400 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd331d6ca80 1 -- 172.21.15.155:0/515232173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 msgr2=0x55696b73a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/515232173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x55696b83b800 tx=0x55696b79b6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd331d6ca80 1 -- 172.21.15.155:0/515232173 shutdown_connections 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/515232173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd331d6ca80 1 -- 172.21.15.155:0/515232173 >> 172.21.15.155:0/515232173 conn(0x55696b898800 msgr2=0x55696b53e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd331d6ca80 1 -- 172.21.15.155:0/515232173 shutdown_connections 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd331d6ca80 1 -- 172.21.15.155:0/515232173 wait complete. 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd331d6ca80 1 Processor -- start 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd331d6ca80 1 -- start start 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd331d6ca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd331d6ca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55696b4f2500 con 0x55696b899400 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd32f515700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd32f515700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36140/0 (socket says 172.21.15.155:36140) 2024-04-19T23:45:41.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.078+0000 7fd32f515700 1 -- 172.21.15.155:0/3803714656 learned_addr learned my addr 172.21.15.155:0/3803714656 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.079+0000 7fd32f515700 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55696b478d00 con 0x55696b899400 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.079+0000 7fd32f515700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x55696b8a9200 tx=0x55696b79b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.079+0000 7fd314ce0700 1 -- 172.21.15.155:0/3803714656 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b8be160 con 0x55696b899400 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.079+0000 7fd314ce0700 1 -- 172.21.15.155:0/3803714656 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55696b8bc180 con 0x55696b899400 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.079+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55696b478340 con 0x55696b899400 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.079+0000 7fd314ce0700 1 -- 172.21.15.155:0/3803714656 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55696b8be2c0 con 0x55696b899400 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.079+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55696b479d40 con 0x55696b899400 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.080+0000 7fd314ce0700 1 -- 172.21.15.155:0/3803714656 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55696c1f3b80 con 0x55696b899400 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.080+0000 7fd314ce0700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b938000 0x55696b73b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.080+0000 7fd314ce0700 1 -- 172.21.15.155:0/3803714656 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55696b4cb500 con 0x55696b899400 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.080+0000 7fd330517700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b938000 0x55696b73b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.080+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55696b899800 0x55696b94e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.080+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899c00 con 0x55696b899800 2024-04-19T23:45:41.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.080+0000 7fd32fd16700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55696b899800 0x55696b94e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.080+0000 7fd330517700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b938000 0x55696b73b700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55696b83bf50 tx=0x55696b79b5c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.080+0000 7fd32fd16700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55696b899800 0x55696b94e000 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.081+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b899800 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.081+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55696b938400 0x55696b94e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.082+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b938800 con 0x55696b938400 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.082+0000 7fd32f515700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55696b938400 0x55696b94e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.082+0000 7fd32f515700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55696b938400 0x55696b94e580 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.083+0000 7fd32f515700 1 -- 172.21.15.155:0/3803714656 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b938400 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.083+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55696b938c00 0x55696b94eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.083+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b939000 con 0x55696b938c00 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.083+0000 7fd330517700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55696b938c00 0x55696b94eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.083+0000 7fd330517700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55696b938c00 0x55696b94eb00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.084+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.084+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b939400 con 0x55696b899800 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.085+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'123 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b899800 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.085+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55696b939800 0x55696b94f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.085+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b939c00 con 0x55696b939800 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.085+0000 7fd32fd16700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55696b939800 0x55696b94f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.085+0000 7fd32fd16700 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55696b939800 0x55696b94f080 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.086+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b939800 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.086+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b939c00 con 0x55696b938c00 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.087+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'23 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.087+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b966000 con 0x55696b899800 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.088+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b899800 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.088+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b966400 con 0x55696b938400 2024-04-19T23:45:41.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.089+0000 7fd32f515700 1 -- 172.21.15.155:0/3803714656 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'23 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b938400 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.089+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b966800 con 0x55696b939800 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.090+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b939800 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.090+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b966c00 con 0x55696b938c00 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.091+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.091+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b967000 con 0x55696b939800 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.092+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b939800 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.092+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b967400 con 0x55696b938400 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.093+0000 7fd32f515700 1 -- 172.21.15.155:0/3803714656 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b938400 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.093+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b967800 con 0x55696b939800 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.094+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b939800 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.094+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b967c00 con 0x55696b938400 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.095+0000 7fd32f515700 1 -- 172.21.15.155:0/3803714656 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'32 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b938400 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.095+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b966000 con 0x55696b899800 2024-04-19T23:45:41.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.096+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'124 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b899800 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.096+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b966800 con 0x55696b938c00 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.097+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.097+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b966400 con 0x55696b939800 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.098+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'37 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b939800 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.098+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b939400 con 0x55696b938c00 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.099+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.099+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b938800 con 0x55696b899800 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.100+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b899800 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.101+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899000 con 0x55696b899800 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.101+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'125 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b899800 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.101+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899c00 con 0x55696b938c00 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.103+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.103+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b898c00 con 0x55696b939800 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.104+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b939800 2024-04-19T23:45:41.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.104+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b451c00 con 0x55696b938c00 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.104+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.104+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b966c00 con 0x55696b938c00 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.105+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.105+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b967000 con 0x55696b938c00 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.106+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.106+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b967800 con 0x55696b938c00 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.107+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.107+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b966000 con 0x55696b938400 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.108+0000 7fd32f515700 1 -- 172.21.15.155:0/3803714656 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b938400 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.108+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b966400 con 0x55696b938c00 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.109+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.109+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b966800 con 0x55696b938400 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.110+0000 7fd32f515700 1 -- 172.21.15.155:0/3803714656 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b938400 2024-04-19T23:45:41.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.110+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899c00 con 0x55696b938c00 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.111+0000 7fd330517700 1 -- 172.21.15.155:0/3803714656 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'34 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b938c00 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.111+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899000 con 0x55696b938400 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.112+0000 7fd32f515700 1 -- 172.21.15.155:0/3803714656 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'33 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b938400 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.112+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b939000 con 0x55696b939800 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.113+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b939800 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd3124db700 20 reqs_thread_entry: start 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd331d6ca80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd331d6ca80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd3104d7700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:11 2024 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd30fcb5700 20 reqs_thread_entry: start 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd331d6ca80 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd331d6ca80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b939400 con 0x55696b898000 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd331d6ca80 20 rados_obj.operate() r=0 bl.length=346 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd331d6ca80 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd331d6ca80 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd331d6ca80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.114+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b938800 con 0x55696b898000 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.115+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(63 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.115+0000 7fd331d6ca80 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.115+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3800 con 0x55696b898000 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(64 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd331d6ca80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 93911264152960 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b7d3c00 con 0x55696b7d3000 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 93911262626816 notify 128849018886 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55696b8fdba0 con 0x55696b7d3000 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd32a50b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 93911262626816 notifier 4565 bl.length()=170 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(65 notify.2 [notify cookie 93911264152960 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd32a50b700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b939400 con 0x55696b7d3000 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== watch-notify(notify_complete (2) cookie 93911264152960 notify 128849018886 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55696b8fdd40 con 0x55696b7d3000 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd331d6ca80 10 removing email index: 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd331d6ca80 10 removing user buckets index 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.116+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899c00 con 0x55696b898000 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.118+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(67 fud.buckets [delete] v30'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.118+0000 7fd331d6ca80 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.118+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93911264152960 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b899000 con 0x55696b898000 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.118+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== watch-notify(notify (1) cookie 93911262631424 notify 128849018895 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55696b8fba00 con 0x55696b898000 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.118+0000 7fd32a50b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 93911262631424 notifier 4565 bl.length()=160 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.118+0000 7fd32a50b700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b451c00 con 0x55696b898000 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.118+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(68 notify.6 [notify cookie 93911264152960 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.118+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.118+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== watch-notify(notify_complete (2) cookie 93911264152960 notify 128849018895 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55696b8f9040 con 0x55696b898000 2024-04-19T23:45:41.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.118+0000 7fd331d6ca80 10 removing user index: fud 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.118+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696b938800 con 0x55696b898000 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.119+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(70 fud [call,call,delete] v30'2 uv2 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.119+0000 7fd331d6ca80 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.119+0000 7fd331d6ca80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.119+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [notify cookie 93911264152960 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696ba02000 con 0x55696b898000 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.120+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== watch-notify(notify (1) cookie 93911262630272 notify 128849018896 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55696b8f9040 con 0x55696b898000 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.120+0000 7fd329d0a700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 93911262630272 notifier 4565 bl.length()=152 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.120+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(71 notify.5 [notify cookie 93911264152960 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.120+0000 7fd329d0a700 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696ba08000 con 0x55696b898000 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.120+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 28 ==== osd_op_reply(72 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.120+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 29 ==== watch-notify(notify_complete (2) cookie 93911264152960 notify 128849018896 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55696b8f91e0 con 0x55696b898000 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.121+0000 7fd316ce4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.121+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93911264149504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696ba03000 con 0x55696b451800 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.122+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93911264149504] v30'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.122+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93911262624512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696ba03400 con 0x55696b7d3400 2024-04-19T23:45:41.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.123+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93911262624512] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.123+0000 7fd331d6ca80 20 remove_watcher() i=0 2024-04-19T23:45:41.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.123+0000 7fd331d6ca80 2 removed watcher, disabling cache 2024-04-19T23:45:41.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.123+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93911262625664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696ba03800 con 0x55696b451800 2024-04-19T23:45:41.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.124+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93911262625664] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.124+0000 7fd331d6ca80 20 remove_watcher() i=1 2024-04-19T23:45:41.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.124+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93911262626816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696ba03c00 con 0x55696b7d3000 2024-04-19T23:45:41.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.124+0000 7fd32fd16700 1 -- 172.21.15.155:0/3653508949 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93911262626816] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b891200 con 0x55696b7d3000 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.124+0000 7fd331d6ca80 20 remove_watcher() i=2 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.125+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93911262627968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696ba02000 con 0x55696b7d3400 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.125+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93911262627968] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b891440 con 0x55696b7d3400 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.125+0000 7fd331d6ca80 20 remove_watcher() i=3 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.125+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93911262629120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696ba03000 con 0x55696b451800 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.126+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93911262629120] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b451800 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.127+0000 7fd331d6ca80 20 remove_watcher() i=4 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.127+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93911262630272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696ba03800 con 0x55696b898000 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.128+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 30 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93911262630272] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.128+0000 7fd331d6ca80 20 remove_watcher() i=5 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.128+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93911262631424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696ba02c00 con 0x55696b898000 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.129+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 31 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93911262631424] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.129+0000 7fd331d6ca80 20 remove_watcher() i=6 2024-04-19T23:45:41.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.129+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93911262632576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55696ba02800 con 0x55696b898000 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd330517700 1 -- 172.21.15.155:0/3653508949 <== osd.0 v2:172.21.15.76:6800/39408 32 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93911262632576] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55696b890b40 con 0x55696b898000 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 20 remove_watcher() i=7 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55696b898000 msgr2=0x55696b73b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55696b898000 0x55696b73b180 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55696b451800 msgr2=0x55696b739b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55696b451800 0x55696b739b80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55696b7d3400 msgr2=0x55696b73ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55696b7d3400 0x55696b73ac00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55696b7d3000 msgr2=0x55696b73a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55696b7d3000 0x55696b73a100 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b7d2c00 msgr2=0x55696b739600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b7d2c00 0x55696b739600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55696b733890 tx=0x55696b541800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 msgr2=0x55696b738b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3653508949 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b451400 0x55696b738b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55696c2de450 tx=0x55696b541f20 comp rx=0 tx=0).stop 2024-04-19T23:45:41.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 reap_dead start 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd32f515700 1 -- 172.21.15.155:0/3653508949 reap_dead start 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 shutdown_connections 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 >> 172.21.15.155:0/3653508949 conn(0x55696b450c00 msgr2=0x55696b53d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 shutdown_connections 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3653508949 wait complete. 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55696b938400 msgr2=0x55696b94e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55696b938400 0x55696b94e580 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55696b899800 msgr2=0x55696b94e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55696b899800 0x55696b94e000 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55696b939800 msgr2=0x55696b94f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55696b939800 0x55696b94f080 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55696b938c00 msgr2=0x55696b94eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55696b938c00 0x55696b94eb00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b938000 msgr2=0x55696b73b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b938000 0x55696b73b700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55696b83bf50 tx=0x55696b79b5c0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 msgr2=0x55696b73a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd32fd16700 1 -- 172.21.15.155:0/3803714656 reap_dead start 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.130+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x55696b8a9200 tx=0x55696b79b800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 shutdown_connections 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/3803714656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b899400 0x55696b73a680 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 >> 172.21.15.155:0/3803714656 conn(0x55696b898800 msgr2=0x55696b53e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 shutdown_connections 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 -- 172.21.15.155:0/3803714656 wait complete. 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1526708023 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b7d2000 msgr2=0x55696b739080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/1526708023 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b7d2000 0x55696b739080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55696c2def00 tx=0x55696b79a240 comp rx=0 tx=0).stop 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1526708023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 msgr2=0x55696b738580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/1526708023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55696c221e30 tx=0x55696b541920 comp rx=0 tx=0).stop 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1526708023 shutdown_connections 2024-04-19T23:45:41.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/1526708023 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55696b7d2000 0x55696b739080 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 --2- 172.21.15.155:0/1526708023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55696b450800 0x55696b738580 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1526708023 >> 172.21.15.155:0/1526708023 conn(0x55696b450400 msgr2=0x55696b53d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1526708023 shutdown_connections 2024-04-19T23:45:41.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.131+0000 7fd331d6ca80 1 -- 172.21.15.155:0/1526708023 wait complete. 2024-04-19T23:45:41.146 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-19T23:45:41.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-19T23:45:41.146 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-19T23:45:41.201 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:41.201 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:41.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.202+0000 7f5f788c5a80 1 Processor -- start 2024-04-19T23:45:41.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.202+0000 7f5f788c5a80 1 -- start start 2024-04-19T23:45:41.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.202+0000 7f5f788c5a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x564cac41cc00 0x564cac704580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.202+0000 7f5f788c5a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564cac747500 con 0x564cac41c800 2024-04-19T23:45:41.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.202+0000 7f5f788c5a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x564cac4bea00 con 0x564cac41cc00 2024-04-19T23:45:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.202+0000 7f5f7606e700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x564cac41cc00 0x564cac704580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.202+0000 7f5f7686f700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x564cac41c800 0x564cac508800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46796/0 (socket says 172.21.15.155:46796) 2024-04-19T23:45:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.202+0000 7f5f7686f700 1 -- 172.21.15.155:0/4074716246 learned_addr learned my addr 172.21.15.155:0/4074716246 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.203+0000 7f5f7606e700 1 -- 172.21.15.155:0/4074716246 >> v1:172.21.15.76:6789/0 conn(0x564cac41c800 legacy=0x564cac508800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.203+0000 7f5f7606e700 1 -- 172.21.15.155:0/4074716246 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cac445d40 con 0x564cac41cc00 2024-04-19T23:45:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.203+0000 7f5f7586d700 1 -- 172.21.15.155:0/4074716246 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184754867 0 0) 0x564cad1ea000 con 0x564cac41c800 2024-04-19T23:45:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.203+0000 7f5f7606e700 1 --2- 172.21.15.155:0/4074716246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41cc00 0x564cac704580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x564cac6ff890 tx=0x564cac50d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dac376d1427295f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.203+0000 7f5f7586d700 1 -- 172.21.15.155:0/4074716246 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac4d54a0 con 0x564cac41cc00 2024-04-19T23:45:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.203+0000 7f5f7586d700 1 -- 172.21.15.155:0/4074716246 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564cac747800 con 0x564cac41cc00 2024-04-19T23:45:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.203+0000 7f5f7586d700 1 -- 172.21.15.155:0/4074716246 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac4d5600 con 0x564cac41cc00 2024-04-19T23:45:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.203+0000 7f5f788c5a80 1 -- 172.21.15.155:0/4074716246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41cc00 msgr2=0x564cac704580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.203+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/4074716246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41cc00 0x564cac704580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x564cac6ff890 tx=0x564cac50d920 comp rx=0 tx=0).stop 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.204+0000 7f5f788c5a80 1 -- 172.21.15.155:0/4074716246 shutdown_connections 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.204+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/4074716246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41cc00 0x564cac704580 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.204+0000 7f5f788c5a80 1 -- 172.21.15.155:0/4074716246 >> 172.21.15.155:0/4074716246 conn(0x564cac41c400 msgr2=0x564cac508000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.204+0000 7f5f788c5a80 1 -- 172.21.15.155:0/4074716246 shutdown_connections 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.204+0000 7f5f788c5a80 1 -- 172.21.15.155:0/4074716246 wait complete. 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.204+0000 7f5f788c5a80 1 Processor -- start 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.204+0000 7f5f788c5a80 1 -- start start 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.204+0000 7f5f788c5a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.204+0000 7f5f788c5a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cac4be500 con 0x564cac41c800 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.205+0000 7f5f7686f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.205+0000 7f5f7686f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36164/0 (socket says 172.21.15.155:36164) 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.205+0000 7f5f7686f700 1 -- 172.21.15.155:0/1862563459 learned_addr learned my addr 172.21.15.155:0/1862563459 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.205+0000 7f5f7686f700 1 -- 172.21.15.155:0/1862563459 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cac445ba0 con 0x564cac41c800 2024-04-19T23:45:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.205+0000 7f5f7686f700 1 --2- 172.21.15.155:0/1862563459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x564cad1edd70 tx=0x564cac50db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35a5cdb75a5deb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.205+0000 7f5f7506c700 1 -- 172.21.15.155:0/1862563459 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac4d51e0 con 0x564cac41c800 2024-04-19T23:45:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.205+0000 7f5f7506c700 1 -- 172.21.15.155:0/1862563459 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564cac747b00 con 0x564cac41c800 2024-04-19T23:45:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.205+0000 7f5f7506c700 1 -- 172.21.15.155:0/1862563459 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac4d54a0 con 0x564cac41c800 2024-04-19T23:45:41.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f788c5a80 1 -- 172.21.15.155:0/1862563459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 msgr2=0x564cac704580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/1862563459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x564cad1edd70 tx=0x564cac50db60 comp rx=0 tx=0).stop 2024-04-19T23:45:41.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f788c5a80 1 -- 172.21.15.155:0/1862563459 shutdown_connections 2024-04-19T23:45:41.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/1862563459 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f788c5a80 1 -- 172.21.15.155:0/1862563459 >> 172.21.15.155:0/1862563459 conn(0x564cac41c400 msgr2=0x564cac509000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f788c5a80 1 -- 172.21.15.155:0/1862563459 shutdown_connections 2024-04-19T23:45:41.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f788c5a80 1 -- 172.21.15.155:0/1862563459 wait complete. 2024-04-19T23:45:41.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f788c5a80 1 Processor -- start 2024-04-19T23:45:41.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f788c5a80 1 -- start start 2024-04-19T23:45:41.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f788c5a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f788c5a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cac4be3c0 con 0x564cac41c800 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f7686f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f7686f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36166/0 (socket says 172.21.15.155:36166) 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.206+0000 7f5f7686f700 1 -- 172.21.15.155:0/2126733245 learned_addr learned my addr 172.21.15.155:0/2126733245 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.207+0000 7f5f7686f700 1 -- 172.21.15.155:0/2126733245 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cac445a00 con 0x564cac41c800 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.207+0000 7f5f7686f700 1 --2- 172.21.15.155:0/2126733245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x564cad1ede00 tx=0x564cac50da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.207+0000 7f5f73869700 1 -- 172.21.15.155:0/2126733245 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac4d5600 con 0x564cac41c800 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.207+0000 7f5f73869700 1 -- 172.21.15.155:0/2126733245 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564cac4bdc80 con 0x564cac41c800 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.207+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2126733245 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564cac445860 con 0x564cac41c800 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.207+0000 7f5f73869700 1 -- 172.21.15.155:0/2126733245 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac4d51e0 con 0x564cac41c800 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.207+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2126733245 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564cac4456c0 con 0x564cac41c800 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.207+0000 7f5f788c5a80 1 Processor -- start 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f788c5a80 1 -- start start 2024-04-19T23:45:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f788c5a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 0x564cac704b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f788c5a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cac458640 con 0x564cac41d400 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f73869700 1 -- 172.21.15.155:0/2126733245 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x564cad1beb00 con 0x564cac41c800 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f73869700 1 --2- 172.21.15.155:0/2126733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac7a6000 0x564cac705080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f77070700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 0x564cac704b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f73869700 1 -- 172.21.15.155:0/2126733245 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x564cac497180 con 0x564cac41c800 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f77070700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 0x564cac704b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36172/0 (socket says 172.21.15.155:36172) 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f77070700 1 -- 172.21.15.155:0/2743370859 learned_addr learned my addr 172.21.15.155:0/2743370859 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f7686f700 1 --2- 172.21.15.155:0/2126733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac7a6000 0x564cac705080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f77070700 1 -- 172.21.15.155:0/2743370859 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cac444000 con 0x564cac41d400 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f7686f700 1 --2- 172.21.15.155:0/2126733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac7a6000 0x564cac705080 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x564cad2b2f30 tx=0x564cac772240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.208+0000 7f5f77070700 1 --2- 172.21.15.155:0/2743370859 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 0x564cac704b00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x564cad1edf50 tx=0x564cac7720c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cfed11346ad396 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f71064700 1 -- 172.21.15.155:0/2743370859 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac4d5600 con 0x564cac41d400 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f71064700 1 -- 172.21.15.155:0/2743370859 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564cac746300 con 0x564cac41d400 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f71064700 1 -- 172.21.15.155:0/2743370859 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac4d51e0 con 0x564cac41d400 2024-04-19T23:45:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2743370859 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 msgr2=0x564cac704b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/2743370859 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 0x564cac704b00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x564cad1edf50 tx=0x564cac7720c0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2743370859 shutdown_connections 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/2743370859 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 0x564cac704b00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2743370859 >> 172.21.15.155:0/2743370859 conn(0x564cac41cc00 msgr2=0x564cac509800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2743370859 shutdown_connections 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2743370859 wait complete. 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f788c5a80 1 Processor -- start 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f788c5a80 1 -- start start 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f788c5a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 0x564cac704b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.209+0000 7f5f788c5a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cac4588c0 con 0x564cac41d400 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.210+0000 7f5f77070700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 0x564cac704b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.210+0000 7f5f77070700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 0x564cac704b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36176/0 (socket says 172.21.15.155:36176) 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.210+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 learned_addr learned my addr 172.21.15.155:0/3325043653 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.210+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cac444ea0 con 0x564cac41d400 2024-04-19T23:45:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.210+0000 7f5f77070700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 0x564cac704b00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x564cad2b2420 tx=0x564cac772840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.210+0000 7f5f6f861700 1 -- 172.21.15.155:0/3325043653 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac4d5a20 con 0x564cac41d400 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.210+0000 7f5f6f861700 1 -- 172.21.15.155:0/3325043653 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564cac4bdc80 con 0x564cac41d400 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.210+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564cac444820 con 0x564cac41d400 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.210+0000 7f5f6f861700 1 -- 172.21.15.155:0/3325043653 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac4d5600 con 0x564cac41d400 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.210+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564cac4449c0 con 0x564cac41d400 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.211+0000 7f5f6f861700 1 -- 172.21.15.155:0/3325043653 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x564cad1bedc0 con 0x564cac41d400 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.211+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.211+0000 7f5f6f861700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac7a6c00 0x564cac705600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.211+0000 7f5f6f861700 1 -- 172.21.15.155:0/3325043653 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x564cac497340 con 0x564cac41d400 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.211+0000 7f5f7606e700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac7a6c00 0x564cac705600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.211+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564cac41d800 0x564cac705b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.211+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac41dc00 con 0x564cac41d800 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f77070700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564cac41d800 0x564cac705b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f7606e700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac7a6c00 0x564cac705600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x564cac6ff890 tx=0x564cac50d800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f77070700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564cac41d800 0x564cac705b80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f788c5a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f788c5a80 20 realm 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac7a7000 con 0x564cac41d800 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f788c5a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f788c5a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac7a7400 con 0x564cac41d800 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.212+0000 7f5f788c5a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac7a7800 con 0x564cac41d800 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f788c5a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac7a7c00 con 0x564cac41d800 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f788c5a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f788c5a80 20 searching for the correct realm 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x564cac7a7000 0x564cac706100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac7a7400 con 0x564cac7a7000 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.213+0000 7f5f7686f700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x564cac7a7000 0x564cac706100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.214+0000 7f5f7686f700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x564cac7a7000 0x564cac706100 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.214+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.214+0000 7f5f7686f700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x564cac7a7400 0x564cac706c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.214+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864000 con 0x564cac7a7400 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.214+0000 7f5f7606e700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x564cac7a7400 0x564cac706c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.214+0000 7f5f7606e700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x564cac7a7400 0x564cac706c00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.215+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.215+0000 7f5f7606e700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564cac864000 0x564cac707180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.215+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac864000 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.215+0000 7f5f77070700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564cac864000 0x564cac707180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.215+0000 7f5f77070700 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564cac864000 0x564cac707180 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.215+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.215+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac41d800 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.216+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.216+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac41d800 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.216+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.216+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac864000 2024-04-19T23:45:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.216+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.216+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac864000 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.216+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.216+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7400 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.217+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.217+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7000 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.217+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.217+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac41d800 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.217+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.217+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac864000 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.217+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.217+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac41d800 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.217+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.217+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7400 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.218+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.218+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7000 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.218+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.218+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7000 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.218+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.218+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac864000 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.219+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.219+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7000 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.219+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.219+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7000 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.219+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.219+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac41d800 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.219+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.219+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac41d800 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.219+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.219+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac864000 2024-04-19T23:45:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.220+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.220+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7000 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.220+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.220+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7400 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.220+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.220+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac41d800 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.220+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.220+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac864000 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.221+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.221+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7000 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.221+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.221+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac864000 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.221+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.221+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7400 2024-04-19T23:45:41.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.221+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.221+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7000 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac864000 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac41d800 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7400 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f788c5a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f788c5a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f788c5a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f788c5a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.222+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac41dc00 con 0x564cac41d800 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864c00 con 0x564cac41d800 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac865000 con 0x564cac7a7400 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 20 zone default found 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 4 Realm: () 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 20 zonegroup default 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac865400 con 0x564cac864000 2024-04-19T23:45:41.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.223+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac865800 con 0x564cac7a7000 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.224+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.224+0000 7f5f788c5a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.224+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.224+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac865c00 con 0x564cac7a7000 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.224+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.224+0000 7f5f788c5a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.224+0000 7f5f788c5a80 20 started sync module instance, tier type = 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.224+0000 7f5f788c5a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.224+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864c00 con 0x564cac7a7400 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.225+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.225+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94887310506752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac41dc00 con 0x564cac7a7400 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.225+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac7a7800 con 0x564cac41d800 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.226+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94887310506752] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.226+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.226+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94887310507904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac7a7c00 con 0x564cac41d800 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.226+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac7a7000 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.227+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.227+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94887310509056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac865000 con 0x564cac7a7000 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.227+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864c00 con 0x564cac7a7400 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.227+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94887310507904] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.228+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94887310509056] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.229+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.229+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94887310510208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864400 con 0x564cac7a7400 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.229+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac865800 con 0x564cac41d800 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.230+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.230+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94887310511360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac865c00 con 0x564cac41d800 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.230+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac864800 con 0x564cac864000 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.230+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94887310510208] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.231+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94887310511360] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.231+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.231+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94887310512512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac865400 con 0x564cac864000 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.231+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac865800 con 0x564cac864000 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.232+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.232+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94887310513664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac865c00 con 0x564cac864000 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.232+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac7a7800 con 0x564cac864000 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.232+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94887310512512] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.233+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94887310513664] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.233+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.233+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94887310514816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac7a7c00 con 0x564cac864000 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.233+0000 7f5f788c5a80 20 add_watcher() i=0 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.233+0000 7f5f788c5a80 20 add_watcher() i=1 2024-04-19T23:45:41.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.233+0000 7f5f788c5a80 20 add_watcher() i=2 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.233+0000 7f5f788c5a80 20 add_watcher() i=3 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.233+0000 7f5f788c5a80 20 add_watcher() i=4 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.233+0000 7f5f788c5a80 20 add_watcher() i=5 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.233+0000 7f5f788c5a80 20 add_watcher() i=6 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.234+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94887310514816] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.234+0000 7f5f788c5a80 20 add_watcher() i=7 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.234+0000 7f5f788c5a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.234+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac7a7800 con 0x564cac41d800 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.234+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.234+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94887312048128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac7a7c00 con 0x564cac41d800 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.235+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94887312048128] v30'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.235+0000 7f5f5d83d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.235+0000 7f5f788c5a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.235+0000 7f5f788c5a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.235+0000 7f5f788c5a80 1 Processor -- start 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.236+0000 7f5f788c5a80 1 -- start start 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.236+0000 7f5f788c5a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.236+0000 7f5f788c5a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cac4be3c0 con 0x564cac865400 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.236+0000 7f5f7606e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.236+0000 7f5f7606e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36178/0 (socket says 172.21.15.155:36178) 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.236+0000 7f5f7606e700 1 -- 172.21.15.155:0/3062218744 learned_addr learned my addr 172.21.15.155:0/3062218744 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.236+0000 7f5f7606e700 1 -- 172.21.15.155:0/3062218744 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cac444b60 con 0x564cac865400 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.237+0000 7f5f7606e700 1 --2- 172.21.15.155:0/3062218744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x564cac7bb410 tx=0x564cac7736e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f695f3b603251c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.237+0000 7f5f5d03c700 1 -- 172.21.15.155:0/3062218744 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac4d5760 con 0x564cac865400 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.237+0000 7f5f5d03c700 1 -- 172.21.15.155:0/3062218744 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564cac88c000 con 0x564cac865400 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.237+0000 7f5f5d03c700 1 -- 172.21.15.155:0/3062218744 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac88e000 con 0x564cac865400 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.237+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3062218744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 msgr2=0x564cac706680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.237+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/3062218744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x564cac7bb410 tx=0x564cac7736e0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.237+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3062218744 shutdown_connections 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.237+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/3062218744 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.237+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3062218744 >> 172.21.15.155:0/3062218744 conn(0x564cac864800 msgr2=0x564cac50a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.237+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3062218744 shutdown_connections 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.238+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3062218744 wait complete. 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.238+0000 7f5f788c5a80 1 Processor -- start 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.238+0000 7f5f788c5a80 1 -- start start 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.238+0000 7f5f788c5a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.238+0000 7f5f788c5a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cac4be500 con 0x564cac865400 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.238+0000 7f5f7606e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.238+0000 7f5f7606e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36190/0 (socket says 172.21.15.155:36190) 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.238+0000 7f5f7606e700 1 -- 172.21.15.155:0/2915660337 learned_addr learned my addr 172.21.15.155:0/2915660337 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.238+0000 7f5f7606e700 1 -- 172.21.15.155:0/2915660337 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cac444d00 con 0x564cac865400 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.239+0000 7f5f7606e700 1 --2- 172.21.15.155:0/2915660337 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x564cac879800 tx=0x564cac773800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.239+0000 7f5f5b839700 1 -- 172.21.15.155:0/2915660337 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac88e160 con 0x564cac865400 2024-04-19T23:45:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.239+0000 7f5f5b839700 1 -- 172.21.15.155:0/2915660337 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564cac88c180 con 0x564cac865400 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.239+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2915660337 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564cac444340 con 0x564cac865400 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.239+0000 7f5f5b839700 1 -- 172.21.15.155:0/2915660337 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564cac88e2c0 con 0x564cac865400 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.239+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2915660337 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564cac445d40 con 0x564cac865400 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.239+0000 7f5f5b839700 1 -- 172.21.15.155:0/2915660337 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x564cad1bfb80 con 0x564cac865400 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.240+0000 7f5f5b839700 1 --2- 172.21.15.155:0/2915660337 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac908000 0x564cac707700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.240+0000 7f5f5b839700 1 -- 172.21.15.155:0/2915660337 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x564cac497500 con 0x564cac865400 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.240+0000 7f5f788c5a80 5 note: GC not initialized 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.240+0000 7f5f77070700 1 --2- 172.21.15.155:0/2915660337 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac908000 0x564cac707700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.240+0000 7f5f77070700 1 --2- 172.21.15.155:0/2915660337 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac908000 0x564cac707700 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x564cac80bf80 tx=0x564cac7735c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f59034700 20 reqs_thread_entry: start 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f57030700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:11 2024 2024-04-19T23:45:41.252 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f5680e700 20 reqs_thread_entry: start 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac865c00 con 0x564cac864000 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac908400 con 0x564cac864000 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.241+0000 7f5f788c5a80 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.242+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~385 in=385b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac908800 con 0x564cac864000 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~385] v30'5 uv5 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f788c5a80 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f788c5a80 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f788c5a80 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94887312050432 in=588b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac908c00 con 0x564cac7a7400 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== watch-notify(notify (1) cookie 94887310510208 notify 128849018892 ret 0) v3 ==== 618+0+0 (crc 0 0 0) 0x564cac8cdba0 con 0x564cac7a7400 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.3 [notify cookie 94887312050432 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f71064700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94887310510208 notifier 4573 bl.length()=576 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f71064700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-19T23:45:41.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f71064700 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-19T23:45:41.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f71064700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac974000 con 0x564cac7a7400 2024-04-19T23:45:41.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== watch-notify(notify_complete (2) cookie 94887312050432 notify 128849018892 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564cac8cdd40 con 0x564cac7a7400 2024-04-19T23:45:41.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.243+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac909000 con 0x564cac864000 2024-04-19T23:45:41.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f788c5a80 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-19T23:45:41.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f788c5a80 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:45:41.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f788c5a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-19T23:45:41.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94887312050432 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac909400 con 0x564cac7a7000 2024-04-19T23:45:41.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 94887310509056 notify 128849018887 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x564cac76dd40 con 0x564cac7a7000 2024-04-19T23:45:41.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f71064700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94887310509056 notifier 4573 bl.length()=192 2024-04-19T23:45:41.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f71064700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-19T23:45:41.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(68 notify.2 [notify cookie 94887312050432 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f71064700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:45:41.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f71064700 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac974400 con 0x564cac7a7000 2024-04-19T23:45:41.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.245+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== watch-notify(notify_complete (2) cookie 94887312050432 notify 128849018887 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564cac8cba00 con 0x564cac7a7000 2024-04-19T23:45:41.257 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:41.257 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "testx$tenanteduser", 2024-04-19T23:45:41.257 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "tenanted-user", 2024-04-19T23:45:41.257 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "", 2024-04-19T23:45:41.257 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:41.257 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 1, 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "testx$tenanteduser", 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:41.258 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:41.259 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:41.260 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:41.260 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.246+0000 7f5f5d83d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.246+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94887312048128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac909800 con 0x564cac41d800 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.247+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94887312048128] v30'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.247+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94887310506752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac909c00 con 0x564cac7a7400 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.248+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94887310506752] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.248+0000 7f5f788c5a80 20 remove_watcher() i=0 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.248+0000 7f5f788c5a80 2 removed watcher, disabling cache 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.248+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94887310507904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac974000 con 0x564cac41d800 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.249+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94887310507904] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.249+0000 7f5f788c5a80 20 remove_watcher() i=1 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.249+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94887310509056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac974800 con 0x564cac7a7000 2024-04-19T23:45:41.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.250+0000 7f5f7686f700 1 -- 172.21.15.155:0/3325043653 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94887310509056] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac857200 con 0x564cac7a7000 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.250+0000 7f5f788c5a80 20 remove_watcher() i=2 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.250+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94887310510208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac974c00 con 0x564cac7a7400 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.251+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94887310510208] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac857440 con 0x564cac7a7400 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.251+0000 7f5f788c5a80 20 remove_watcher() i=3 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.251+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94887310511360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac908400 con 0x564cac41d800 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.252+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94887310511360] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac41d800 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.252+0000 7f5f788c5a80 20 remove_watcher() i=4 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.252+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94887310512512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac908800 con 0x564cac864000 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.253+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94887310512512] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.253+0000 7f5f788c5a80 20 remove_watcher() i=5 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.253+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94887310513664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac909000 con 0x564cac864000 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.254+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94887310513664] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.254+0000 7f5f788c5a80 20 remove_watcher() i=6 2024-04-19T23:45:41.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.254+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94887310514816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564cac909800 con 0x564cac864000 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f77070700 1 -- 172.21.15.155:0/3325043653 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94887310514816] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564cac856b40 con 0x564cac864000 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 20 remove_watcher() i=7 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564cac864000 msgr2=0x564cac707180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564cac864000 0x564cac707180 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564cac41d800 msgr2=0x564cac705b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564cac41d800 0x564cac705b80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x564cac7a7400 msgr2=0x564cac706c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x564cac7a7400 0x564cac706c00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x564cac7a7000 msgr2=0x564cac706100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x564cac7a7000 0x564cac706100 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac7a6c00 msgr2=0x564cac705600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac7a6c00 0x564cac705600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x564cac6ff890 tx=0x564cac50d800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 msgr2=0x564cac704b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/3325043653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41d400 0x564cac704b00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x564cad2b2420 tx=0x564cac772840 comp rx=0 tx=0).stop 2024-04-19T23:45:41.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 reap_dead start 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f7606e700 1 -- 172.21.15.155:0/3325043653 reap_dead start 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 shutdown_connections 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 >> 172.21.15.155:0/3325043653 conn(0x564cac41cc00 msgr2=0x564cac509800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 shutdown_connections 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.255+0000 7f5f788c5a80 1 -- 172.21.15.155:0/3325043653 wait complete. 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2915660337 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac908000 msgr2=0x564cac707700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/2915660337 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac908000 0x564cac707700 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x564cac80bf80 tx=0x564cac7735c0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2915660337 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 msgr2=0x564cac706680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/2915660337 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x564cac879800 tx=0x564cac773800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2915660337 shutdown_connections 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/2915660337 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac908000 0x564cac707700 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/2915660337 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac865400 0x564cac706680 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2915660337 >> 172.21.15.155:0/2915660337 conn(0x564cac864800 msgr2=0x564cac50a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2915660337 shutdown_connections 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2915660337 wait complete. 2024-04-19T23:45:41.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2126733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac7a6000 msgr2=0x564cac705080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/2126733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac7a6000 0x564cac705080 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x564cad2b2f30 tx=0x564cac772240 comp rx=0 tx=0).stop 2024-04-19T23:45:41.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2126733245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 msgr2=0x564cac704580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/2126733245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x564cad1ede00 tx=0x564cac50da40 comp rx=0 tx=0).stop 2024-04-19T23:45:41.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2126733245 shutdown_connections 2024-04-19T23:45:41.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/2126733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564cac7a6000 0x564cac705080 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 --2- 172.21.15.155:0/2126733245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564cac41c800 0x564cac704580 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2126733245 >> 172.21.15.155:0/2126733245 conn(0x564cac41c400 msgr2=0x564cac509000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2126733245 shutdown_connections 2024-04-19T23:45:41.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.256+0000 7f5f788c5a80 1 -- 172.21.15.155:0/2126733245 wait complete. 2024-04-19T23:45:41.269 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:41.269 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-19T23:45:41.269 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-19T23:45:41.270 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-04-19T23:45:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.319+0000 7f82b6866a80 1 Processor -- start 2024-04-19T23:45:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.319+0000 7f82b6866a80 1 -- start start 2024-04-19T23:45:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b6866a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x562a97710c00 0x562a979f8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b6866a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562a97a3b500 con 0x562a97710800 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b6866a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x562a977b2a00 con 0x562a97710c00 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b4810700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x562a97710800 0x562a977fc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46798/0 (socket says 172.21.15.155:46798) 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b4810700 1 -- 172.21.15.155:0/3347696489 learned_addr learned my addr 172.21.15.155:0/3347696489 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b400f700 1 --2- 172.21.15.155:0/3347696489 >> v2:172.21.15.76:3300/0 conn(0x562a97710c00 0x562a979f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b380e700 1 -- 172.21.15.155:0/3347696489 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135914463 0 0) 0x562a984de000 con 0x562a97710800 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b380e700 1 -- 172.21.15.155:0/3347696489 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x562a97a3b680 con 0x562a97710800 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b400f700 1 -- 172.21.15.155:0/3347696489 >> v1:172.21.15.76:6789/0 conn(0x562a97710800 legacy=0x562a977fc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b400f700 1 -- 172.21.15.155:0/3347696489 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a97739d40 con 0x562a97710c00 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b400f700 1 --2- 172.21.15.155:0/3347696489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710c00 0x562a979f8580 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x562a979f3890 tx=0x562a97801980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de62f83eedcb5aa server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.320+0000 7f82b380e700 1 -- 172.21.15.155:0/3347696489 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a977c94a0 con 0x562a97710c00 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.321+0000 7f82b380e700 1 -- 172.21.15.155:0/3347696489 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a97a3b680 con 0x562a97710c00 2024-04-19T23:45:41.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.321+0000 7f82b380e700 1 -- 172.21.15.155:0/3347696489 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a977c9600 con 0x562a97710c00 2024-04-19T23:45:41.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.321+0000 7f82b6866a80 1 -- 172.21.15.155:0/3347696489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710c00 msgr2=0x562a979f8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.321+0000 7f82b6866a80 1 --2- 172.21.15.155:0/3347696489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710c00 0x562a979f8580 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x562a979f3890 tx=0x562a97801980 comp rx=0 tx=0).stop 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.321+0000 7f82b6866a80 1 -- 172.21.15.155:0/3347696489 shutdown_connections 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.321+0000 7f82b6866a80 1 --2- 172.21.15.155:0/3347696489 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710c00 0x562a979f8580 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.321+0000 7f82b6866a80 1 -- 172.21.15.155:0/3347696489 >> 172.21.15.155:0/3347696489 conn(0x562a97710400 msgr2=0x562a977fc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.321+0000 7f82b6866a80 1 -- 172.21.15.155:0/3347696489 shutdown_connections 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.321+0000 7f82b6866a80 1 -- 172.21.15.155:0/3347696489 wait complete. 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b6866a80 1 Processor -- start 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b6866a80 1 -- start start 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b6866a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b6866a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a977b2500 con 0x562a97710800 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b4810700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b4810700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36222/0 (socket says 172.21.15.155:36222) 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b4810700 1 -- 172.21.15.155:0/879561385 learned_addr learned my addr 172.21.15.155:0/879561385 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b4810700 1 -- 172.21.15.155:0/879561385 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a97739ba0 con 0x562a97710800 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b4810700 1 --2- 172.21.15.155:0/879561385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x562a984e1770 tx=0x562a97801b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff76faedbae3e9f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b300d700 1 -- 172.21.15.155:0/879561385 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a977c91e0 con 0x562a97710800 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b300d700 1 -- 172.21.15.155:0/879561385 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a97a3bb00 con 0x562a97710800 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.322+0000 7f82b300d700 1 -- 172.21.15.155:0/879561385 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a977c94a0 con 0x562a97710800 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.323+0000 7f82b6866a80 1 -- 172.21.15.155:0/879561385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 msgr2=0x562a979f8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.323+0000 7f82b6866a80 1 --2- 172.21.15.155:0/879561385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x562a984e1770 tx=0x562a97801b60 comp rx=0 tx=0).stop 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.323+0000 7f82b6866a80 1 -- 172.21.15.155:0/879561385 shutdown_connections 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.323+0000 7f82b6866a80 1 --2- 172.21.15.155:0/879561385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.323+0000 7f82b6866a80 1 -- 172.21.15.155:0/879561385 >> 172.21.15.155:0/879561385 conn(0x562a97710400 msgr2=0x562a977fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.323+0000 7f82b6866a80 1 -- 172.21.15.155:0/879561385 shutdown_connections 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.323+0000 7f82b6866a80 1 -- 172.21.15.155:0/879561385 wait complete. 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.323+0000 7f82b6866a80 1 Processor -- start 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.323+0000 7f82b6866a80 1 -- start start 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.323+0000 7f82b6866a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.323+0000 7f82b6866a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a977b23c0 con 0x562a97710800 2024-04-19T23:45:41.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.324+0000 7f82b4810700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.324+0000 7f82b4810700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36228/0 (socket says 172.21.15.155:36228) 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.324+0000 7f82b4810700 1 -- 172.21.15.155:0/889052683 learned_addr learned my addr 172.21.15.155:0/889052683 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.324+0000 7f82b4810700 1 -- 172.21.15.155:0/889052683 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a97739a00 con 0x562a97710800 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.324+0000 7f82b4810700 1 --2- 172.21.15.155:0/889052683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x562a984e1e30 tx=0x562a97801920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.324+0000 7f82b180a700 1 -- 172.21.15.155:0/889052683 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a977c9600 con 0x562a97710800 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.324+0000 7f82b180a700 1 -- 172.21.15.155:0/889052683 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a977b1c80 con 0x562a97710800 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.324+0000 7f82b180a700 1 -- 172.21.15.155:0/889052683 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a977c91e0 con 0x562a97710800 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.324+0000 7f82b6866a80 1 -- 172.21.15.155:0/889052683 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a97739860 con 0x562a97710800 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.324+0000 7f82b6866a80 1 -- 172.21.15.155:0/889052683 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a977396c0 con 0x562a97710800 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b6866a80 1 Processor -- start 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b6866a80 1 -- start start 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b180a700 1 -- 172.21.15.155:0/889052683 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562a984b2b00 con 0x562a97710800 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b6866a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 0x562a979f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b6866a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a9774c640 con 0x562a97711400 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b180a700 1 --2- 172.21.15.155:0/889052683 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97a9a000 0x562a979f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b180a700 1 -- 172.21.15.155:0/889052683 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x562a9778b180 con 0x562a97710800 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b5011700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 0x562a979f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b5011700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 0x562a979f8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36242/0 (socket says 172.21.15.155:36242) 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b5011700 1 -- 172.21.15.155:0/3548703645 learned_addr learned my addr 172.21.15.155:0/3548703645 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b4810700 1 --2- 172.21.15.155:0/889052683 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97a9a000 0x562a979f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.325+0000 7f82b5011700 1 -- 172.21.15.155:0/3548703645 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a97738000 con 0x562a97711400 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82b4810700 1 --2- 172.21.15.155:0/889052683 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97a9a000 0x562a979f9080 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x562a985a4f00 tx=0x562a97a60240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82b5011700 1 --2- 172.21.15.155:0/3548703645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 0x562a979f8b00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x562a984e1e90 tx=0x562a97a60060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e6de2ce470a9db server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82af005700 1 -- 172.21.15.155:0/3548703645 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a977c9600 con 0x562a97711400 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82af005700 1 -- 172.21.15.155:0/3548703645 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a97a3a480 con 0x562a97711400 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82af005700 1 -- 172.21.15.155:0/3548703645 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a977c91e0 con 0x562a97711400 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82b6866a80 1 -- 172.21.15.155:0/3548703645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 msgr2=0x562a979f8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82b6866a80 1 --2- 172.21.15.155:0/3548703645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 0x562a979f8b00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x562a984e1e90 tx=0x562a97a60060 comp rx=0 tx=0).stop 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82b6866a80 1 -- 172.21.15.155:0/3548703645 shutdown_connections 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82b6866a80 1 --2- 172.21.15.155:0/3548703645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 0x562a979f8b00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82b6866a80 1 -- 172.21.15.155:0/3548703645 >> 172.21.15.155:0/3548703645 conn(0x562a97710c00 msgr2=0x562a977fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82b6866a80 1 -- 172.21.15.155:0/3548703645 shutdown_connections 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82b6866a80 1 -- 172.21.15.155:0/3548703645 wait complete. 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82b6866a80 1 Processor -- start 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.326+0000 7f82b6866a80 1 -- start start 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.327+0000 7f82b6866a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 0x562a979f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.327+0000 7f82b6866a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a9774c8c0 con 0x562a97711400 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.327+0000 7f82b5011700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 0x562a979f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.327+0000 7f82b5011700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 0x562a979f8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36248/0 (socket says 172.21.15.155:36248) 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.327+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 learned_addr learned my addr 172.21.15.155:0/1692427246 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.327+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a97738ea0 con 0x562a97711400 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.327+0000 7f82b5011700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 0x562a979f8b00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x562a985a4450 tx=0x562a97801f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.327+0000 7f82ad802700 1 -- 172.21.15.155:0/1692427246 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a977c9a20 con 0x562a97711400 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.328+0000 7f82ad802700 1 -- 172.21.15.155:0/1692427246 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a97a3a180 con 0x562a97711400 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.328+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a97738820 con 0x562a97711400 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.328+0000 7f82ad802700 1 -- 172.21.15.155:0/1692427246 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a977c9600 con 0x562a97711400 2024-04-19T23:45:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.328+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a977389c0 con 0x562a97711400 2024-04-19T23:45:41.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.328+0000 7f82ad802700 1 -- 172.21.15.155:0/1692427246 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562a984b2dc0 con 0x562a97711400 2024-04-19T23:45:41.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.329+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.329+0000 7f82ad802700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97a9ac00 0x562a979f9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.329+0000 7f82ad802700 1 -- 172.21.15.155:0/1692427246 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x562a9778b340 con 0x562a97711400 2024-04-19T23:45:41.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.329+0000 7f82b400f700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97a9ac00 0x562a979f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.329+0000 7f82b6866a80 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562a97711800 0x562a979f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.329+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97711c00 con 0x562a97711800 2024-04-19T23:45:41.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.329+0000 7f82b5011700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562a97711800 0x562a979f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.329+0000 7f82b400f700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97a9ac00 0x562a979f9600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x562a979f3890 tx=0x562a97801800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.329+0000 7f82b5011700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562a97711800 0x562a979f9b80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 20 realm 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9b000 con 0x562a97711800 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9b400 con 0x562a97711800 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9b800 con 0x562a97711800 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.330+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9bc00 con 0x562a97711800 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.331+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.331+0000 7f82b6866a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.331+0000 7f82b6866a80 20 searching for the correct realm 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.331+0000 7f82b6866a80 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562a97a9b000 0x562a979fa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.331+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9b400 con 0x562a97a9b000 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.331+0000 7f82b4810700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562a97a9b000 0x562a979fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.331+0000 7f82b4810700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562a97a9b000 0x562a979fa100 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.331+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.331+0000 7f82b4810700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562a97a9b400 0x562a979fac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.332+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58000 con 0x562a97a9b400 2024-04-19T23:45:41.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.332+0000 7f82b400f700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562a97a9b400 0x562a979fac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.332+0000 7f82b400f700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562a97a9b400 0x562a979fac00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.332+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.332+0000 7f82b400f700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562a97b58000 0x562a979fb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.332+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97b58000 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.332+0000 7f82b5011700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562a97b58000 0x562a979fb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.333+0000 7f82b5011700 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562a97b58000 0x562a979fb180 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.333+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.333+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97711800 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.333+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.333+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97711800 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.333+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.333+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97b58000 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.334+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.334+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97b58000 2024-04-19T23:45:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.334+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.334+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b400 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.334+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.334+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b000 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.334+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.334+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97711800 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.334+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.334+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97b58000 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.335+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.335+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97711800 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.335+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.335+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b400 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.335+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.335+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b000 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.335+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.335+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b000 2024-04-19T23:45:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.336+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.336+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97b58000 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.336+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.336+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b000 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.336+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.336+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b000 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.336+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.336+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97711800 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.336+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.336+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97711800 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.337+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.337+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97b58000 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.337+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.337+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b000 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.337+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.337+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b400 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.337+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.337+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97711800 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.338+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.338+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97b58000 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.338+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.338+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b000 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.338+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.338+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97b58000 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.338+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.338+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b400 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.338+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.338+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b000 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97b58000 2024-04-19T23:45:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97711800 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b400 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b6866a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b6866a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b6866a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b6866a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.339+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97711c00 con 0x562a97711800 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58c00 con 0x562a97711800 2024-04-19T23:45:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59000 con 0x562a97a9b400 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 20 zone default found 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 4 Realm: () 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 20 zonegroup default 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.340+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59400 con 0x562a97b58000 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b6866a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59800 con 0x562a97a9b000 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b6866a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59c00 con 0x562a97a9b000 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b6866a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b6866a80 20 started sync module instance, tier type = 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b6866a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.341+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58c00 con 0x562a97a9b400 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.342+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.342+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94740932393728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97711c00 con 0x562a97a9b400 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.342+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9b800 con 0x562a97711800 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.343+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94740932393728] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.344+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.344+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94740932394880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9bc00 con 0x562a97711800 2024-04-19T23:45:41.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.344+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97a9b000 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.344+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94740932394880] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.345+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.345+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94740932396032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59000 con 0x562a97a9b000 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.345+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58c00 con 0x562a97a9b400 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.346+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94740932396032] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.346+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.346+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94740932397184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58400 con 0x562a97a9b400 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.346+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59800 con 0x562a97711800 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.347+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.347+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94740932398336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59c00 con 0x562a97711800 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.347+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58800 con 0x562a97b58000 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.347+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94740932397184] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.349+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94740932398336] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.350+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.350+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94740932399488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59400 con 0x562a97b58000 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.350+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59800 con 0x562a97b58000 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.350+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94740932399488] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.351+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.351+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94740932400640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59c00 con 0x562a97b58000 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.351+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9b800 con 0x562a97b58000 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.352+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.352+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94740932401792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9bc00 con 0x562a97b58000 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.352+0000 7f82b6866a80 20 add_watcher() i=0 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.352+0000 7f82b6866a80 20 add_watcher() i=1 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.352+0000 7f82b6866a80 20 add_watcher() i=2 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.352+0000 7f82b6866a80 20 add_watcher() i=3 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.352+0000 7f82b6866a80 20 add_watcher() i=4 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.352+0000 7f82b6866a80 20 add_watcher() i=5 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.352+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94740932400640] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.352+0000 7f82b6866a80 20 add_watcher() i=6 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.353+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94740932401792] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.353+0000 7f82b6866a80 20 add_watcher() i=7 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.353+0000 7f82b6866a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.353+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9b800 con 0x562a97711800 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.353+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.353+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94740933918720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9bc00 con 0x562a97711800 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.354+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94740933918720] v30'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.354+0000 7f829b7de700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.354+0000 7f82b6866a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.354+0000 7f82b6866a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.354+0000 7f82b6866a80 1 Processor -- start 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.354+0000 7f82b6866a80 1 -- start start 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.355+0000 7f82b6866a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.355+0000 7f82b6866a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a977b23c0 con 0x562a97b59400 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.355+0000 7f82b400f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.355+0000 7f82b400f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36254/0 (socket says 172.21.15.155:36254) 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.355+0000 7f82b400f700 1 -- 172.21.15.155:0/2087033760 learned_addr learned my addr 172.21.15.155:0/2087033760 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.355+0000 7f82b400f700 1 -- 172.21.15.155:0/2087033760 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a97738b60 con 0x562a97b59400 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.355+0000 7f82b400f700 1 --2- 172.21.15.155:0/2087033760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x562a97a99440 tx=0x562a97a616e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20e53e94d1781d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.355+0000 7f829afdd700 1 -- 172.21.15.155:0/2087033760 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a977c9760 con 0x562a97b59400 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.355+0000 7f829afdd700 1 -- 172.21.15.155:0/2087033760 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a97b76000 con 0x562a97b59400 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.355+0000 7f829afdd700 1 -- 172.21.15.155:0/2087033760 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a97b78000 con 0x562a97b59400 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.356+0000 7f82b6866a80 1 -- 172.21.15.155:0/2087033760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 msgr2=0x562a979fa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.356+0000 7f82b6866a80 1 --2- 172.21.15.155:0/2087033760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x562a97a99440 tx=0x562a97a616e0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.356+0000 7f82b6866a80 1 -- 172.21.15.155:0/2087033760 shutdown_connections 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.356+0000 7f82b6866a80 1 --2- 172.21.15.155:0/2087033760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.356+0000 7f82b6866a80 1 -- 172.21.15.155:0/2087033760 >> 172.21.15.155:0/2087033760 conn(0x562a97b58800 msgr2=0x562a977fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.356+0000 7f82b6866a80 1 -- 172.21.15.155:0/2087033760 shutdown_connections 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.356+0000 7f82b6866a80 1 -- 172.21.15.155:0/2087033760 wait complete. 2024-04-19T23:45:41.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.356+0000 7f82b6866a80 1 Processor -- start 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.356+0000 7f82b6866a80 1 -- start start 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82b6866a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82b6866a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a977b2500 con 0x562a97b59400 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82b400f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82b400f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36260/0 (socket says 172.21.15.155:36260) 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82b400f700 1 -- 172.21.15.155:0/837294617 learned_addr learned my addr 172.21.15.155:0/837294617 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82b400f700 1 -- 172.21.15.155:0/837294617 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a97738d00 con 0x562a97b59400 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82b400f700 1 --2- 172.21.15.155:0/837294617 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x562a97b69200 tx=0x562a97a61800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82997da700 1 -- 172.21.15.155:0/837294617 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a97b78160 con 0x562a97b59400 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82b6866a80 1 -- 172.21.15.155:0/837294617 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a97738340 con 0x562a97b59400 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82997da700 1 -- 172.21.15.155:0/837294617 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a97b76180 con 0x562a97b59400 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82997da700 1 -- 172.21.15.155:0/837294617 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562a97b782c0 con 0x562a97b59400 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.357+0000 7f82b6866a80 1 -- 172.21.15.155:0/837294617 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a97739d40 con 0x562a97b59400 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.358+0000 7f82997da700 1 -- 172.21.15.155:0/837294617 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562a984b3b80 con 0x562a97b59400 2024-04-19T23:45:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.358+0000 7f82997da700 1 --2- 172.21.15.155:0/837294617 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97bf8000 0x562a979fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.358+0000 7f82997da700 1 -- 172.21.15.155:0/837294617 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x562a9778b500 con 0x562a97b59400 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.358+0000 7f82b5011700 1 --2- 172.21.15.155:0/837294617 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97bf8000 0x562a979fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.358+0000 7f82b6866a80 5 note: GC not initialized 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.359+0000 7f82b5011700 1 --2- 172.21.15.155:0/837294617 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97bf8000 0x562a979fb700 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x562a97afdf50 tx=0x562a97a615c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.359+0000 7f8296fd5700 20 reqs_thread_entry: start 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.359+0000 7f82b6866a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b6866a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f8294fd1700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:11 2024 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82947af700 20 reqs_thread_entry: start 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b6866a80 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59c00 con 0x562a97b58000 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b6866a80 20 rados_obj.operate() r=0 bl.length=385 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b6866a80 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b6866a80 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b6866a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b6866a80 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.360+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf8400 con 0x562a97a9b400 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 : miss 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf8800 con 0x562a97711800 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(64 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:41.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:41.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:41.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:41.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:41.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.361+0000 7f82b6866a80 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-04-19T23:45:41.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.362+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf8c00 con 0x562a97a9b400 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.363+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 foo.buckets [call] v30'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.363+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 8.18 8:1f1bad56:root::.bucket.meta.testx%3amyfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf9000 con 0x562a97711800 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [create,call,writefull 0~371,setxattr (203)] v30'12 uv12 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82b6866a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x7 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82b6866a80 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82b6866a80 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82b6866a80 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1, ofs0, ns] 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94740933921024 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf9400 con 0x562a97711800 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94740932394880 notify 128849018891 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x562a97affd40 con 0x562a97711800 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82af005700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94740932394880 notifier 4581 bl.length()=806 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(67 notify.1 [notify cookie 94740933921024 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82af005700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x7 2024-04-19T23:45:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82af005700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82af005700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82af005700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58c00 con 0x562a97711800 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.364+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.365+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 94740933921024 notify 128849018891 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562a97bbfba0 con 0x562a97711800 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.365+0000 7f82b6866a80 20 handle_bi_update(): bucket=testx:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_sources= new_sources= 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.365+0000 7f82b6866a80 20 handle_bi_update(): bucket=testx:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential sources added=[] removed=[] 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.365+0000 7f82b6866a80 20 handle_bi_update(): bucket=testx:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_dests= new_dests= 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.365+0000 7f82b6866a80 20 handle_bi_update(): bucket=testx:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential dests added=[] removed=[] 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.365+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf9800 con 0x562a97711800 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.366+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'1 uv1 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.366+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf9c00 con 0x562a97711800 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.367+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.367+0000 7f82b6866a80 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.367+0000 7f82b6866a80 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-19T23:45:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.367+0000 7f82b6866a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.367+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94740933921024 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf8800 con 0x562a97711800 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.367+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== watch-notify(notify (1) cookie 94740932398336 notify 128849018892 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x562a97bbfba0 con 0x562a97711800 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.367+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(71 notify.4 [notify cookie 94740933921024 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.367+0000 7f82af005700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94740932398336 notifier 4581 bl.length()=348 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.367+0000 7f82af005700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.367+0000 7f82af005700 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.367+0000 7f82af005700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97711c00 con 0x562a97711800 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.368+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== watch-notify(notify_complete (2) cookie 94740933921024 notify 128849018892 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562a97bbfd40 con 0x562a97711800 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.368+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 33 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.368+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf9000 con 0x562a97a9b400 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.369+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(73 myfoo [call,delete] v30'25 uv25 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.369+0000 7f82b6866a80 10 removing default.rgw.meta+root+myfoo from cache 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.369+0000 7f82b6866a80 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.369+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94740933921024 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf9800 con 0x562a97b58000 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.369+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== watch-notify(notify (1) cookie 94740932400640 notify 128849018897 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x562a97bbfd40 con 0x562a97b58000 2024-04-19T23:45:41.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.369+0000 7f82af005700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94740932400640 notifier 4581 bl.length()=149 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.369+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(74 notify.6 [notify cookie 94740933921024 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.369+0000 7f82af005700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b6e000 con 0x562a97b58000 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.369+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== watch-notify(notify_complete (2) cookie 94740933921024 notify 128849018897 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562a97bbe340 con 0x562a97b58000 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.369+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.369+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:76 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf8400 con 0x562a97711800 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.370+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 34 ==== osd_op_reply(76 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call,delete] v30'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.370+0000 7f82b6866a80 10 removing default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 from cache 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.370+0000 7f82b6866a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1, ofs0, ns] 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.370+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 94740933921024 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf8c00 con 0x562a97a9b000 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.371+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 94740932396032 notify 128849018888 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x562a97a5dd40 con 0x562a97a9b000 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.371+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(77 notify.2 [notify cookie 94740933921024 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.371+0000 7f82ae804700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94740932396032 notifier 4581 bl.length()=206 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.371+0000 7f82ae804700 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b6ec00 con 0x562a97a9b000 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.371+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== watch-notify(notify_complete (2) cookie 94740933921024 notify 128849018888 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562a97bbda00 con 0x562a97a9b000 2024-04-19T23:45:41.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.371+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.372+0000 7f829b7de700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.372+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94740933918720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b59c00 con 0x562a97711800 2024-04-19T23:45:41.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.373+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 35 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94740933918720] v30'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.373+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94740932393728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b58c00 con 0x562a97a9b400 2024-04-19T23:45:41.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.374+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94740932393728] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.374+0000 7f82b6866a80 20 remove_watcher() i=0 2024-04-19T23:45:41.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.374+0000 7f82b6866a80 2 removed watcher, disabling cache 2024-04-19T23:45:41.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.374+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94740932394880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97bf9400 con 0x562a97711800 2024-04-19T23:45:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.375+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 36 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94740932394880] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.375+0000 7f82b6866a80 20 remove_watcher() i=1 2024-04-19T23:45:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.375+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94740932396032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9b800 con 0x562a97a9b000 2024-04-19T23:45:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.376+0000 7f82b4810700 1 -- 172.21.15.155:0/1692427246 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94740932396032] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4d200 con 0x562a97a9b000 2024-04-19T23:45:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.376+0000 7f82b6866a80 20 remove_watcher() i=2 2024-04-19T23:45:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.376+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94740932397184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97a9bc00 con 0x562a97a9b400 2024-04-19T23:45:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.377+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94740932397184] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4d440 con 0x562a97a9b400 2024-04-19T23:45:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.377+0000 7f82b6866a80 20 remove_watcher() i=3 2024-04-19T23:45:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.377+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94740932398336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b6e000 con 0x562a97711800 2024-04-19T23:45:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.378+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.1 v2:172.21.15.155:6800/41833 37 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94740932398336] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97711800 2024-04-19T23:45:41.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.378+0000 7f82b6866a80 20 remove_watcher() i=4 2024-04-19T23:45:41.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.378+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94740932399488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b6f000 con 0x562a97b58000 2024-04-19T23:45:41.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.379+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94740932399488] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.379+0000 7f82b6866a80 20 remove_watcher() i=5 2024-04-19T23:45:41.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.379+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94740932400640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b6f400 con 0x562a97b58000 2024-04-19T23:45:41.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.380+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94740932400640] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.380+0000 7f82b6866a80 20 remove_watcher() i=6 2024-04-19T23:45:41.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.380+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94740932401792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562a97b6f800 con 0x562a97b58000 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b5011700 1 -- 172.21.15.155:0/1692427246 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94740932401792] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x562a97b4cb40 con 0x562a97b58000 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 20 remove_watcher() i=7 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562a97b58000 msgr2=0x562a979fb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562a97b58000 0x562a979fb180 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562a97711800 msgr2=0x562a979f9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x562a97711800 0x562a979f9b80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562a97a9b400 msgr2=0x562a979fac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562a97a9b400 0x562a979fac00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562a97a9b000 msgr2=0x562a979fa100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562a97a9b000 0x562a979fa100 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97a9ac00 msgr2=0x562a979f9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97a9ac00 0x562a979f9600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x562a979f3890 tx=0x562a97801800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 msgr2=0x562a979f8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 --2- 172.21.15.155:0/1692427246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97711400 0x562a979f8b00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x562a985a4450 tx=0x562a97801f20 comp rx=0 tx=0).stop 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 reap_dead start 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b400f700 1 -- 172.21.15.155:0/1692427246 reap_dead start 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 shutdown_connections 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.381+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 >> 172.21.15.155:0/1692427246 conn(0x562a97710c00 msgr2=0x562a977fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 shutdown_connections 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/1692427246 wait complete. 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/837294617 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97bf8000 msgr2=0x562a979fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 --2- 172.21.15.155:0/837294617 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97bf8000 0x562a979fb700 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x562a97afdf50 tx=0x562a97a615c0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/837294617 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 msgr2=0x562a979fa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 --2- 172.21.15.155:0/837294617 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x562a97b69200 tx=0x562a97a61800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/837294617 shutdown_connections 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 --2- 172.21.15.155:0/837294617 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97bf8000 0x562a979fb700 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 --2- 172.21.15.155:0/837294617 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97b59400 0x562a979fa680 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/837294617 >> 172.21.15.155:0/837294617 conn(0x562a97b58800 msgr2=0x562a977fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/837294617 shutdown_connections 2024-04-19T23:45:41.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/837294617 wait complete. 2024-04-19T23:45:41.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/889052683 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97a9a000 msgr2=0x562a979f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 --2- 172.21.15.155:0/889052683 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97a9a000 0x562a979f9080 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x562a985a4f00 tx=0x562a97a60240 comp rx=0 tx=0).stop 2024-04-19T23:45:41.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/889052683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 msgr2=0x562a979f8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 --2- 172.21.15.155:0/889052683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x562a984e1e30 tx=0x562a97801920 comp rx=0 tx=0).stop 2024-04-19T23:45:41.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/889052683 shutdown_connections 2024-04-19T23:45:41.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 --2- 172.21.15.155:0/889052683 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562a97a9a000 0x562a979f9080 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 --2- 172.21.15.155:0/889052683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a97710800 0x562a979f8580 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/889052683 >> 172.21.15.155:0/889052683 conn(0x562a97710400 msgr2=0x562a977fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/889052683 shutdown_connections 2024-04-19T23:45:41.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.382+0000 7f82b6866a80 1 -- 172.21.15.155:0/889052683 wait complete. 2024-04-19T23:45:41.387 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-04-19T23:45:41.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-04-19T23:45:41.387 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-04-19T23:45:41.431 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:41.431 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:41.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.431+0000 7f3fabc8aa80 1 Processor -- start 2024-04-19T23:45:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fabc8aa80 1 -- start start 2024-04-19T23:45:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fabc8aa80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x565349172c00 0x56534945a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fabc8aa80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56534949d500 con 0x565349172800 2024-04-19T23:45:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fabc8aa80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x565349214a00 con 0x565349172c00 2024-04-19T23:45:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fa9c34700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x565349172800 0x56534925e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46812/0 (socket says 172.21.15.155:46812) 2024-04-19T23:45:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1373743594 learned_addr learned my addr 172.21.15.155:0/1373743594 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fa9433700 1 --2- 172.21.15.155:0/1373743594 >> v2:172.21.15.76:3300/0 conn(0x565349172c00 0x56534945a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fa8c32700 1 -- 172.21.15.155:0/1373743594 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517683859 0 0) 0x565349f40000 con 0x565349172800 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fa8c32700 1 -- 172.21.15.155:0/1373743594 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x56534949d680 con 0x565349172800 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fa9433700 1 -- 172.21.15.155:0/1373743594 >> v1:172.21.15.76:6789/0 conn(0x565349172800 legacy=0x56534925e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fa9433700 1 -- 172.21.15.155:0/1373743594 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56534919bd40 con 0x565349172c00 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.432+0000 7f3fa9433700 1 --2- 172.21.15.155:0/1373743594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172c00 0x56534945a580 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x565349455890 tx=0x565349263980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81454d4bd4ca0a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.433+0000 7f3fa8c32700 1 -- 172.21.15.155:0/1373743594 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56534922b4a0 con 0x565349172c00 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.433+0000 7f3fa8c32700 1 -- 172.21.15.155:0/1373743594 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56534949d500 con 0x565349172c00 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.433+0000 7f3fa8c32700 1 -- 172.21.15.155:0/1373743594 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56534922b600 con 0x565349172c00 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.433+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1373743594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172c00 msgr2=0x56534945a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.433+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1373743594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172c00 0x56534945a580 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x565349455890 tx=0x565349263980 comp rx=0 tx=0).stop 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.433+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1373743594 shutdown_connections 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.433+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1373743594 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172c00 0x56534945a580 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.433+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1373743594 >> 172.21.15.155:0/1373743594 conn(0x565349172400 msgr2=0x56534925e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.433+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1373743594 shutdown_connections 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.433+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1373743594 wait complete. 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.434+0000 7f3fabc8aa80 1 Processor -- start 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.434+0000 7f3fabc8aa80 1 -- start start 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.434+0000 7f3fabc8aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.434+0000 7f3fabc8aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x565349214500 con 0x565349172800 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.434+0000 7f3fa9c34700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.434+0000 7f3fa9c34700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36278/0 (socket says 172.21.15.155:36278) 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.434+0000 7f3fa9c34700 1 -- 172.21.15.155:0/3010084229 learned_addr learned my addr 172.21.15.155:0/3010084229 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.434+0000 7f3fa9c34700 1 -- 172.21.15.155:0/3010084229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56534919bba0 con 0x565349172800 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fa9c34700 1 --2- 172.21.15.155:0/3010084229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x565349f43770 tx=0x565349263b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b14267063ba277 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fa8431700 1 -- 172.21.15.155:0/3010084229 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56534922b1e0 con 0x565349172800 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fa8431700 1 -- 172.21.15.155:0/3010084229 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56534949db00 con 0x565349172800 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fa8431700 1 -- 172.21.15.155:0/3010084229 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56534922b4a0 con 0x565349172800 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/3010084229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 msgr2=0x56534945a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/3010084229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x565349f43770 tx=0x565349263b60 comp rx=0 tx=0).stop 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/3010084229 shutdown_connections 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/3010084229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/3010084229 >> 172.21.15.155:0/3010084229 conn(0x565349172400 msgr2=0x56534925f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/3010084229 shutdown_connections 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/3010084229 wait complete. 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fabc8aa80 1 Processor -- start 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.435+0000 7f3fabc8aa80 1 -- start start 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fabc8aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fabc8aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653492143c0 con 0x565349172800 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fa9c34700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fa9c34700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36290/0 (socket says 172.21.15.155:36290) 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fa9c34700 1 -- 172.21.15.155:0/807614138 learned_addr learned my addr 172.21.15.155:0/807614138 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fa9c34700 1 -- 172.21.15.155:0/807614138 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56534919ba00 con 0x565349172800 2024-04-19T23:45:41.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fa9c34700 1 --2- 172.21.15.155:0/807614138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x565349f43e30 tx=0x565349263920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fa6c2e700 1 -- 172.21.15.155:0/807614138 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56534922b600 con 0x565349172800 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fa6c2e700 1 -- 172.21.15.155:0/807614138 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565349213c80 con 0x565349172800 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/807614138 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56534919b860 con 0x565349172800 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fa6c2e700 1 -- 172.21.15.155:0/807614138 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56534922b1e0 con 0x565349172800 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.436+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/807614138 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56534919b6c0 con 0x565349172800 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.437+0000 7f3fabc8aa80 1 Processor -- start 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.437+0000 7f3fabc8aa80 1 -- start start 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.437+0000 7f3fabc8aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 0x56534945ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.437+0000 7f3fabc8aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x565349214000 con 0x565349173400 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.437+0000 7f3fa6c2e700 1 -- 172.21.15.155:0/807614138 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x565349f14b00 con 0x565349172800 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.437+0000 7f3fa6c2e700 1 --2- 172.21.15.155:0/807614138 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5653494f6000 0x56534945b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.437+0000 7f3faa435700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 0x56534945ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.437+0000 7f3fa6c2e700 1 -- 172.21.15.155:0/807614138 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5653491ed180 con 0x565349172800 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.437+0000 7f3faa435700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 0x56534945ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36302/0 (socket says 172.21.15.155:36302) 2024-04-19T23:45:41.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.437+0000 7f3faa435700 1 -- 172.21.15.155:0/327074933 learned_addr learned my addr 172.21.15.155:0/327074933 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.437+0000 7f3fa9c34700 1 --2- 172.21.15.155:0/807614138 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5653494f6000 0x56534945b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3faa435700 1 -- 172.21.15.155:0/327074933 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56534919a000 con 0x565349173400 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3faa435700 1 --2- 172.21.15.155:0/327074933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 0x56534945ab00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x565349f43e90 tx=0x5653494be0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959213a4fc4981a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3fa9c34700 1 --2- 172.21.15.155:0/807614138 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5653494f6000 0x56534945b080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x56534a000f30 tx=0x5653494be240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3fa4429700 1 -- 172.21.15.155:0/327074933 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56534922b600 con 0x565349173400 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3fa4429700 1 -- 172.21.15.155:0/327074933 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56534949c480 con 0x565349173400 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3fa4429700 1 -- 172.21.15.155:0/327074933 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56534922b1e0 con 0x565349173400 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/327074933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 msgr2=0x56534945ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/327074933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 0x56534945ab00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x565349f43e90 tx=0x5653494be0c0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/327074933 shutdown_connections 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/327074933 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 0x56534945ab00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/327074933 >> 172.21.15.155:0/327074933 conn(0x565349172c00 msgr2=0x56534925f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/327074933 shutdown_connections 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.438+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/327074933 wait complete. 2024-04-19T23:45:41.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.439+0000 7f3fabc8aa80 1 Processor -- start 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.439+0000 7f3fabc8aa80 1 -- start start 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.439+0000 7f3fabc8aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 0x56534945ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.439+0000 7f3fabc8aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653491ae640 con 0x565349173400 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.439+0000 7f3faa435700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 0x56534945ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.439+0000 7f3faa435700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 0x56534945ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36314/0 (socket says 172.21.15.155:36314) 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.439+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 learned_addr learned my addr 172.21.15.155:0/1187363886 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.439+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56534919aea0 con 0x565349173400 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.439+0000 7f3faa435700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 0x56534945ab00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x56534a000450 tx=0x5653494be840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.439+0000 7f3fa2c26700 1 -- 172.21.15.155:0/1187363886 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56534922ba20 con 0x565349173400 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.440+0000 7f3fa2c26700 1 -- 172.21.15.155:0/1187363886 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56534949c180 con 0x565349173400 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.440+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56534919a820 con 0x565349173400 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.440+0000 7f3fa2c26700 1 -- 172.21.15.155:0/1187363886 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56534922b600 con 0x565349173400 2024-04-19T23:45:41.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.440+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56534919a9c0 con 0x565349173400 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.440+0000 7f3fa2c26700 1 -- 172.21.15.155:0/1187363886 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x565349f14dc0 con 0x565349173400 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.440+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3fa2c26700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5653494f6c00 0x56534945b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3fa2c26700 1 -- 172.21.15.155:0/1187363886 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5653491ed340 con 0x565349173400 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3fa9433700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5653494f6c00 0x56534945b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x565349173800 0x56534945bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565349173c00 con 0x565349173800 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3faa435700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x565349173800 0x56534945bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3fa9433700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5653494f6c00 0x56534945b600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x565349455890 tx=0x565349263800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3faa435700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x565349173800 0x56534945bb80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3fabc8aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3fabc8aa80 20 realm 2024-04-19T23:45:41.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.441+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653494f7000 con 0x565349173800 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653494f7400 con 0x565349173800 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653494f7800 con 0x565349173800 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653494f7c00 con 0x565349173800 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 20 searching for the correct realm 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5653494f7000 0x56534945c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.442+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653494f7400 con 0x5653494f7000 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.443+0000 7f3fa9c34700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5653494f7000 0x56534945c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.443+0000 7f3fa9c34700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5653494f7000 0x56534945c100 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.443+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.443+0000 7f3fa9c34700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5653494f7400 0x56534945cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.443+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc000 con 0x5653494f7400 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.443+0000 7f3fa9433700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5653494f7400 0x56534945cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.444+0000 7f3fa9433700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5653494f7400 0x56534945cc00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.444+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.444+0000 7f3fa9433700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5653495bc000 0x56534945d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.444+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653495bc000 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.444+0000 7f3faa435700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5653495bc000 0x56534945d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.444+0000 7f3faa435700 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5653495bc000 0x56534945d180 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.445+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.445+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x565349173800 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.445+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.445+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x565349173800 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.445+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.445+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653495bc000 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.445+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.445+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653495bc000 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.445+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.445+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7400 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.446+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.446+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7000 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.446+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.446+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x565349173800 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.446+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.446+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653495bc000 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.447+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.447+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x565349173800 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.447+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.447+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7400 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.447+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.447+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7000 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.447+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.447+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7000 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.447+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.447+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653495bc000 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.448+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.448+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7000 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.448+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.448+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7000 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.448+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.448+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x565349173800 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.448+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.448+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x565349173800 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.449+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.449+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653495bc000 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.449+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.449+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7000 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.449+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.449+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7400 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.449+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.449+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x565349173800 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.450+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.450+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653495bc000 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.450+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.450+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7000 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.450+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.450+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653495bc000 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.450+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.450+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7400 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.451+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.451+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7000 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.451+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.451+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653495bc000 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.451+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.451+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x565349173800 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.451+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.451+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7400 2024-04-19T23:45:41.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565349173c00 con 0x565349173800 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bcc00 con 0x565349173800 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bd000 con 0x5653494f7400 2024-04-19T23:45:41.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 zone default found 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 4 Realm: () 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 zonegroup default 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.452+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bd400 con 0x5653495bc000 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fabc8aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bd800 con 0x5653494f7000 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fabc8aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bdc00 con 0x5653494f7000 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fabc8aa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fabc8aa80 20 started sync module instance, tier type = 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fabc8aa80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.453+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bcc00 con 0x5653494f7400 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.454+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.454+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94915711539968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565349173c00 con 0x5653494f7400 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.454+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653494f7800 con 0x565349173800 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.455+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94915711539968] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.455+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.456+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94915711541120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653494f7c00 con 0x565349173800 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.456+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653494f7000 2024-04-19T23:45:41.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.456+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94915711541120] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.457+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.457+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94915711542272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bd000 con 0x5653494f7000 2024-04-19T23:45:41.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.457+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bcc00 con 0x5653494f7400 2024-04-19T23:45:41.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.458+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.458+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94915711543424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc400 con 0x5653494f7400 2024-04-19T23:45:41.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.458+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bd800 con 0x565349173800 2024-04-19T23:45:41.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.458+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94915711542272] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.459+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.459+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94915711544576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bdc00 con 0x565349173800 2024-04-19T23:45:41.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.459+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bc800 con 0x5653495bc000 2024-04-19T23:45:41.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.460+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94915711543424] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.460+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.460+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94915711545728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bd400 con 0x5653495bc000 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.460+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bd800 con 0x5653495bc000 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.460+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94915711544576] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.461+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.461+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94915711546880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bdc00 con 0x5653495bc000 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.461+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653494f7800 con 0x5653495bc000 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.461+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94915711545728] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.462+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94915711546880] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.462+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.462+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94915711548032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653494f7c00 con 0x5653495bc000 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.462+0000 7f3fabc8aa80 20 add_watcher() i=0 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.462+0000 7f3fabc8aa80 20 add_watcher() i=1 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.462+0000 7f3fabc8aa80 20 add_watcher() i=2 2024-04-19T23:45:41.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.462+0000 7f3fabc8aa80 20 add_watcher() i=3 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.462+0000 7f3fabc8aa80 20 add_watcher() i=4 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.462+0000 7f3fabc8aa80 20 add_watcher() i=5 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.462+0000 7f3fabc8aa80 20 add_watcher() i=6 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.463+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94915711548032] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.463+0000 7f3fabc8aa80 20 add_watcher() i=7 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.463+0000 7f3fabc8aa80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.463+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653494f7800 con 0x565349173800 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.463+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.463+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94915713073152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653494f7c00 con 0x565349173800 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.464+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94915713073152] v30'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.464+0000 7f3f90c02700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.465+0000 7f3fabc8aa80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.465+0000 7f3fabc8aa80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:41.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.465+0000 7f3fabc8aa80 1 Processor -- start 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.465+0000 7f3fabc8aa80 1 -- start start 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.465+0000 7f3fabc8aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.465+0000 7f3fabc8aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653491ae780 con 0x5653495bd400 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.465+0000 7f3fa9433700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.465+0000 7f3fa9433700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36316/0 (socket says 172.21.15.155:36316) 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.465+0000 7f3fa9433700 1 -- 172.21.15.155:0/2432167099 learned_addr learned my addr 172.21.15.155:0/2432167099 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.465+0000 7f3fa9433700 1 -- 172.21.15.155:0/2432167099 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56534919ab60 con 0x5653495bd400 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.466+0000 7f3fa9433700 1 --2- 172.21.15.155:0/2432167099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x56534950b440 tx=0x5653494bf6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530baa687994177d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.466+0000 7f3f90401700 1 -- 172.21.15.155:0/2432167099 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56534922b760 con 0x5653495bd400 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.466+0000 7f3f90401700 1 -- 172.21.15.155:0/2432167099 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5653495de000 con 0x5653495bd400 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.466+0000 7f3f90401700 1 -- 172.21.15.155:0/2432167099 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5653495e0000 con 0x5653495bd400 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.466+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/2432167099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 msgr2=0x56534945c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.466+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/2432167099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x56534950b440 tx=0x5653494bf6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.466+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/2432167099 shutdown_connections 2024-04-19T23:45:41.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.466+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/2432167099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.466+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/2432167099 >> 172.21.15.155:0/2432167099 conn(0x5653495bc800 msgr2=0x565349260000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.466+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/2432167099 shutdown_connections 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.466+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/2432167099 wait complete. 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.467+0000 7f3fabc8aa80 1 Processor -- start 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.467+0000 7f3fabc8aa80 1 -- start start 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.467+0000 7f3fabc8aa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.467+0000 7f3fabc8aa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x565349214000 con 0x5653495bd400 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.467+0000 7f3fa9433700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.467+0000 7f3fa9433700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36324/0 (socket says 172.21.15.155:36324) 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.467+0000 7f3fa9433700 1 -- 172.21.15.155:0/1967097290 learned_addr learned my addr 172.21.15.155:0/1967097290 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.467+0000 7f3fa9433700 1 -- 172.21.15.155:0/1967097290 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56534919ad00 con 0x5653495bd400 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.467+0000 7f3fa9433700 1 --2- 172.21.15.155:0/1967097290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x56534955f740 tx=0x5653494bf800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.468+0000 7f3f8ebfe700 1 -- 172.21.15.155:0/1967097290 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5653495e0160 con 0x5653495bd400 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.468+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1967097290 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56534919a340 con 0x5653495bd400 2024-04-19T23:45:41.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.468+0000 7f3f8ebfe700 1 -- 172.21.15.155:0/1967097290 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5653495de180 con 0x5653495bd400 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.468+0000 7f3f8ebfe700 1 -- 172.21.15.155:0/1967097290 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5653495e02c0 con 0x5653495bd400 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.468+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1967097290 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56534919bd40 con 0x5653495bd400 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.468+0000 7f3f8ebfe700 1 -- 172.21.15.155:0/1967097290 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x565349f15b80 con 0x5653495bd400 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.469+0000 7f3f8ebfe700 1 --2- 172.21.15.155:0/1967097290 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56534965a000 0x56534945d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.469+0000 7f3f8ebfe700 1 -- 172.21.15.155:0/1967097290 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5653491ed500 con 0x5653495bd400 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.469+0000 7f3fabc8aa80 5 note: GC not initialized 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.469+0000 7f3faa435700 1 --2- 172.21.15.155:0/1967097290 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56534965a000 0x56534945d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.469+0000 7f3faa435700 1 --2- 172.21.15.155:0/1967097290 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56534965a000 0x56534945d700 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x56534955e000 tx=0x5653494bf5c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.470+0000 7f3f8c3f9700 20 reqs_thread_entry: start 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.470+0000 7f3fabc8aa80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.470+0000 7f3fabc8aa80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.470+0000 7f3f8a3f5700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:11 2024 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.470+0000 7f3f89bd3700 20 reqs_thread_entry: start 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.470+0000 7f3fabc8aa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.470+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5653495bdc00 con 0x565349173800 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.470+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+332 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.471+0000 7f3fabc8aa80 20 rados_obj.operate() r=0 bl.length=193 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.471+0000 7f3f90c02700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.471+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94915713073152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56534965a400 con 0x565349173800 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.472+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94915713073152] v30'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.472+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94915711539968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56534965a800 con 0x5653494f7400 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.473+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94915711539968] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.473+0000 7f3fabc8aa80 20 remove_watcher() i=0 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.473+0000 7f3fabc8aa80 2 removed watcher, disabling cache 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.473+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94915711541120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56534965ac00 con 0x565349173800 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.474+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94915711541120] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.474+0000 7f3fabc8aa80 20 remove_watcher() i=1 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.474+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94915711542272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56534965b000 con 0x5653494f7000 2024-04-19T23:45:41.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.475+0000 7f3fa9c34700 1 -- 172.21.15.155:0/1187363886 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94915711542272] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495ad200 con 0x5653494f7000 2024-04-19T23:45:41.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.475+0000 7f3fabc8aa80 20 remove_watcher() i=2 2024-04-19T23:45:41.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.475+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94915711543424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56534965b400 con 0x5653494f7400 2024-04-19T23:45:41.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.476+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94915711543424] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495ad440 con 0x5653494f7400 2024-04-19T23:45:41.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.476+0000 7f3fabc8aa80 20 remove_watcher() i=3 2024-04-19T23:45:41.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.476+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94915711544576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56534965b800 con 0x565349173800 2024-04-19T23:45:41.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.478+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94915711544576] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x565349173800 2024-04-19T23:45:41.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.478+0000 7f3fabc8aa80 20 remove_watcher() i=4 2024-04-19T23:45:41.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.478+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94915711545728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56534965bc00 con 0x5653495bc000 2024-04-19T23:45:41.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.479+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94915711545728] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.479+0000 7f3fabc8aa80 20 remove_watcher() i=5 2024-04-19T23:45:41.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.479+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94915711546880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56534965a400 con 0x5653495bc000 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.480+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94915711546880] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.480+0000 7f3fabc8aa80 20 remove_watcher() i=6 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.480+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94915711548032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56534965ac00 con 0x5653495bc000 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3faa435700 1 -- 172.21.15.155:0/1187363886 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94915711548032] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5653495acb40 con 0x5653495bc000 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 20 remove_watcher() i=7 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5653495bc000 msgr2=0x56534945d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5653495bc000 0x56534945d180 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x565349173800 msgr2=0x56534945bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x565349173800 0x56534945bb80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5653494f7400 msgr2=0x56534945cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5653494f7400 0x56534945cc00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5653494f7000 msgr2=0x56534945c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5653494f7000 0x56534945c100 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5653494f6c00 msgr2=0x56534945b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5653494f6c00 0x56534945b600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x565349455890 tx=0x565349263800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 msgr2=0x56534945ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1187363886 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349173400 0x56534945ab00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x56534a000450 tx=0x5653494be840 comp rx=0 tx=0).stop 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 reap_dead start 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fa9433700 1 -- 172.21.15.155:0/1187363886 reap_dead start 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 shutdown_connections 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 >> 172.21.15.155:0/1187363886 conn(0x565349172c00 msgr2=0x56534925f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 shutdown_connections 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1187363886 wait complete. 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1967097290 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56534965a000 msgr2=0x56534945d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1967097290 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56534965a000 0x56534945d700 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x56534955e000 tx=0x5653494bf5c0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1967097290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 msgr2=0x56534945c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1967097290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x56534955f740 tx=0x5653494bf800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1967097290 shutdown_connections 2024-04-19T23:45:41.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1967097290 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56534965a000 0x56534945d700 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/1967097290 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5653495bd400 0x56534945c680 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1967097290 >> 172.21.15.155:0/1967097290 conn(0x5653495bc800 msgr2=0x565349260000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1967097290 shutdown_connections 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.481+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/1967097290 wait complete. 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.482+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/807614138 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5653494f6000 msgr2=0x56534945b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.482+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/807614138 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5653494f6000 0x56534945b080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x56534a000f30 tx=0x5653494be240 comp rx=0 tx=0).stop 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.482+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/807614138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 msgr2=0x56534945a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.482+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/807614138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x565349f43e30 tx=0x565349263920 comp rx=0 tx=0).stop 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.482+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/807614138 shutdown_connections 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.482+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/807614138 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5653494f6000 0x56534945b080 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.482+0000 7f3fabc8aa80 1 --2- 172.21.15.155:0/807614138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x565349172800 0x56534945a580 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.482+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/807614138 >> 172.21.15.155:0/807614138 conn(0x565349172400 msgr2=0x56534925f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.482+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/807614138 shutdown_connections 2024-04-19T23:45:41.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.482+0000 7f3fabc8aa80 1 -- 172.21.15.155:0/807614138 wait complete. 2024-04-19T23:45:41.490 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:41.490 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "bucket:testx/myfoo", 2024-04-19T23:45:41.490 INFO:teuthology.orchestra.run.smithi155.stdout: "ver": { 2024-04-19T23:45:41.490 INFO:teuthology.orchestra.run.smithi155.stdout: "tag": "xCoWLFokC2xtuqbCqzneILMD", 2024-04-19T23:45:41.490 INFO:teuthology.orchestra.run.smithi155.stdout: "ver": 2 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2024-04-19T23:45:41.367307Z", 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "data": { 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": { 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "myfoo", 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "marker": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "tenant": "testx", 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "explicit_placement": { 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": "", 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "", 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": "" 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:41.491 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "testx$tenanteduser", 2024-04-19T23:45:41.492 INFO:teuthology.orchestra.run.smithi155.stdout: "creation_time": "2024-04-19T23:45:39.164552Z", 2024-04-19T23:45:41.492 INFO:teuthology.orchestra.run.smithi155.stdout: "linked": true, 2024-04-19T23:45:41.492 INFO:teuthology.orchestra.run.smithi155.stdout: "has_bucket_info": false 2024-04-19T23:45:41.492 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:41.492 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:41.492 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'xCoWLFokC2xtuqbCqzneILMD', 'ver': 2}, 'mtime': '2024-04-19T23:45:41.367307Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'bucket_id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-04-19T23:45:39.164552Z', 'linked': True, 'has_bucket_info': False}} 2024-04-19T23:45:41.492 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-19T23:45:41.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-19T23:45:41.492 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-04-19T23:45:41.540 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:41.540 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.541+0000 7ffb05b64a80 1 Processor -- start 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.541+0000 7ffb05b64a80 1 -- start start 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.541+0000 7ffb05b64a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5569001d4c00 0x5569004bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.541+0000 7ffb05b64a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5569004ff500 con 0x5569001d4800 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.541+0000 7ffb05b64a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x556900276a00 con 0x5569001d4c00 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.541+0000 7ffb0330d700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5569001d4c00 0x5569004bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.541+0000 7ffb03b0e700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5569001d4800 0x5569002c0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46816/0 (socket says 172.21.15.155:46816) 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.541+0000 7ffb03b0e700 1 -- 172.21.15.155:0/1200773325 learned_addr learned my addr 172.21.15.155:0/1200773325 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb0330d700 1 -- 172.21.15.155:0/1200773325 >> v1:172.21.15.76:6789/0 conn(0x5569001d4800 legacy=0x5569002c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb0330d700 1 -- 172.21.15.155:0/1200773325 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569001fdd40 con 0x5569001d4c00 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb02b0c700 1 -- 172.21.15.155:0/1200773325 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355185783 0 0) 0x556900fa2000 con 0x5569001d4800 2024-04-19T23:45:41.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb0330d700 1 --2- 172.21.15.155:0/1200773325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4c00 0x5569004bc580 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x5569004b7890 tx=0x5569002c5920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2f882a2c6d9a00 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb02b0c700 1 -- 172.21.15.155:0/1200773325 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55690028d4a0 con 0x5569001d4c00 2024-04-19T23:45:41.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb02b0c700 1 -- 172.21.15.155:0/1200773325 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569004ff800 con 0x5569001d4c00 2024-04-19T23:45:41.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb02b0c700 1 -- 172.21.15.155:0/1200773325 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55690028d600 con 0x5569001d4c00 2024-04-19T23:45:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb05b64a80 1 -- 172.21.15.155:0/1200773325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4c00 msgr2=0x5569004bc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/1200773325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4c00 0x5569004bc580 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x5569004b7890 tx=0x5569002c5920 comp rx=0 tx=0).stop 2024-04-19T23:45:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb05b64a80 1 -- 172.21.15.155:0/1200773325 shutdown_connections 2024-04-19T23:45:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/1200773325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4c00 0x5569004bc580 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb05b64a80 1 -- 172.21.15.155:0/1200773325 >> 172.21.15.155:0/1200773325 conn(0x5569001d4400 msgr2=0x5569002c0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb05b64a80 1 -- 172.21.15.155:0/1200773325 shutdown_connections 2024-04-19T23:45:41.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.542+0000 7ffb05b64a80 1 -- 172.21.15.155:0/1200773325 wait complete. 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.543+0000 7ffb05b64a80 1 Processor -- start 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.543+0000 7ffb05b64a80 1 -- start start 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.543+0000 7ffb05b64a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.543+0000 7ffb05b64a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556900276500 con 0x5569001d4800 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.543+0000 7ffb03b0e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.543+0000 7ffb03b0e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36354/0 (socket says 172.21.15.155:36354) 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.543+0000 7ffb03b0e700 1 -- 172.21.15.155:0/1258842927 learned_addr learned my addr 172.21.15.155:0/1258842927 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb03b0e700 1 -- 172.21.15.155:0/1258842927 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569001fdba0 con 0x5569001d4800 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb03b0e700 1 --2- 172.21.15.155:0/1258842927 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x556900fa5770 tx=0x5569002c5b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcbe58a9f673bd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb0230b700 1 -- 172.21.15.155:0/1258842927 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55690028d1e0 con 0x5569001d4800 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb0230b700 1 -- 172.21.15.155:0/1258842927 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569004ffb00 con 0x5569001d4800 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb0230b700 1 -- 172.21.15.155:0/1258842927 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55690028d4a0 con 0x5569001d4800 2024-04-19T23:45:41.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb05b64a80 1 -- 172.21.15.155:0/1258842927 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 msgr2=0x5569004bc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/1258842927 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x556900fa5770 tx=0x5569002c5b60 comp rx=0 tx=0).stop 2024-04-19T23:45:41.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb05b64a80 1 -- 172.21.15.155:0/1258842927 shutdown_connections 2024-04-19T23:45:41.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/1258842927 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb05b64a80 1 -- 172.21.15.155:0/1258842927 >> 172.21.15.155:0/1258842927 conn(0x5569001d4400 msgr2=0x5569002c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb05b64a80 1 -- 172.21.15.155:0/1258842927 shutdown_connections 2024-04-19T23:45:41.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.544+0000 7ffb05b64a80 1 -- 172.21.15.155:0/1258842927 wait complete. 2024-04-19T23:45:41.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.545+0000 7ffb05b64a80 1 Processor -- start 2024-04-19T23:45:41.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.545+0000 7ffb05b64a80 1 -- start start 2024-04-19T23:45:41.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.545+0000 7ffb05b64a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.545+0000 7ffb05b64a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569002763c0 con 0x5569001d4800 2024-04-19T23:45:41.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.545+0000 7ffb03b0e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.545+0000 7ffb03b0e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36362/0 (socket says 172.21.15.155:36362) 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.545+0000 7ffb03b0e700 1 -- 172.21.15.155:0/4064586274 learned_addr learned my addr 172.21.15.155:0/4064586274 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.545+0000 7ffb03b0e700 1 -- 172.21.15.155:0/4064586274 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569001fda00 con 0x5569001d4800 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.545+0000 7ffb03b0e700 1 --2- 172.21.15.155:0/4064586274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x556900fa5e30 tx=0x5569002c5a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb00b08700 1 -- 172.21.15.155:0/4064586274 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55690028d600 con 0x5569001d4800 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb00b08700 1 -- 172.21.15.155:0/4064586274 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556900275c80 con 0x5569001d4800 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb00b08700 1 -- 172.21.15.155:0/4064586274 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55690028d1e0 con 0x5569001d4800 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4064586274 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5569001fd860 con 0x5569001d4800 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4064586274 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569001fd6c0 con 0x5569001d4800 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb05b64a80 1 Processor -- start 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb00b08700 1 -- 172.21.15.155:0/4064586274 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x556900f76b00 con 0x5569001d4800 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb05b64a80 1 -- start start 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb05b64a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 0x5569004bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb05b64a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556900210640 con 0x5569001d5400 2024-04-19T23:45:41.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb00b08700 1 --2- 172.21.15.155:0/4064586274 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55690055a000 0x5569004bd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.546+0000 7ffb00b08700 1 -- 172.21.15.155:0/4064586274 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55690024f180 con 0x5569001d4800 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.547+0000 7ffb03b0e700 1 --2- 172.21.15.155:0/4064586274 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55690055a000 0x5569004bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.547+0000 7ffb0430f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 0x5569004bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.547+0000 7ffb0430f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 0x5569004bcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36378/0 (socket says 172.21.15.155:36378) 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.547+0000 7ffb0430f700 1 -- 172.21.15.155:0/3910996734 learned_addr learned my addr 172.21.15.155:0/3910996734 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.547+0000 7ffb0430f700 1 -- 172.21.15.155:0/3910996734 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569001fc000 con 0x5569001d5400 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.547+0000 7ffb03b0e700 1 --2- 172.21.15.155:0/4064586274 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55690055a000 0x5569004bd080 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x556901066f00 tx=0x556900520240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.547+0000 7ffb0430f700 1 --2- 172.21.15.155:0/3910996734 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 0x5569004bcb00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x556901066360 tx=0x5569005209c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c71bd832cdbd3d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.547+0000 7ffafe303700 1 -- 172.21.15.155:0/3910996734 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55690028d600 con 0x5569001d5400 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.547+0000 7ffafe303700 1 -- 172.21.15.155:0/3910996734 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569004fe300 con 0x5569001d5400 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.547+0000 7ffafe303700 1 -- 172.21.15.155:0/3910996734 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55690028d1e0 con 0x5569001d5400 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb05b64a80 1 -- 172.21.15.155:0/3910996734 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 msgr2=0x5569004bcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/3910996734 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 0x5569004bcb00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x556901066360 tx=0x5569005209c0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb05b64a80 1 -- 172.21.15.155:0/3910996734 shutdown_connections 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/3910996734 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 0x5569004bcb00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb05b64a80 1 -- 172.21.15.155:0/3910996734 >> 172.21.15.155:0/3910996734 conn(0x5569001d4c00 msgr2=0x5569002c1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb05b64a80 1 -- 172.21.15.155:0/3910996734 shutdown_connections 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb05b64a80 1 -- 172.21.15.155:0/3910996734 wait complete. 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb05b64a80 1 Processor -- start 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb05b64a80 1 -- start start 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb05b64a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 0x5569004bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb05b64a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569002108c0 con 0x5569001d5400 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb0430f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 0x5569004bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb0430f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 0x5569004bcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36394/0 (socket says 172.21.15.155:36394) 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.548+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 learned_addr learned my addr 172.21.15.155:0/2214005610 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.549+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569001fcea0 con 0x5569001d5400 2024-04-19T23:45:41.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.549+0000 7ffb0430f700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 0x5569004bcb00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x5569010663f0 tx=0x556900520120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.549+0000 7ffafcb00700 1 -- 172.21.15.155:0/2214005610 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55690028da20 con 0x5569001d5400 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.549+0000 7ffafcb00700 1 -- 172.21.15.155:0/2214005610 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556900275c80 con 0x5569001d5400 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.549+0000 7ffafcb00700 1 -- 172.21.15.155:0/2214005610 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55690028d600 con 0x5569001d5400 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.549+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5569001fc820 con 0x5569001d5400 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.549+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569001fc9c0 con 0x5569001d5400 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.550+0000 7ffafcb00700 1 -- 172.21.15.155:0/2214005610 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x556900f76dc0 con 0x5569001d5400 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.550+0000 7ffafcb00700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55690055ac00 0x5569004bd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.550+0000 7ffafcb00700 1 -- 172.21.15.155:0/2214005610 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55690024f340 con 0x5569001d5400 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.550+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.550+0000 7ffb0330d700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55690055ac00 0x5569004bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.550+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5569001d5800 0x5569004bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.550+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569001d5c00 con 0x5569001d5800 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.550+0000 7ffb0430f700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5569001d5800 0x5569004bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.550+0000 7ffb0330d700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55690055ac00 0x5569004bd600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5569004b7890 tx=0x5569002c5800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.550+0000 7ffb0430f700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5569001d5800 0x5569004bdb80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 20 realm 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055b000 con 0x5569001d5800 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055b400 con 0x5569001d5800 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055b800 con 0x5569001d5800 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055bc00 con 0x5569001d5800 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 20 searching for the correct realm 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55690055b000 0x5569004be100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.551+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055b400 con 0x55690055b000 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.552+0000 7ffb03b0e700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55690055b000 0x5569004be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.552+0000 7ffb03b0e700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55690055b000 0x5569004be100 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.552+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.552+0000 7ffb03b0e700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55690055b400 0x5569004bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.552+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c000 con 0x55690055b400 2024-04-19T23:45:41.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.552+0000 7ffb0330d700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55690055b400 0x5569004bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.553+0000 7ffb0330d700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55690055b400 0x5569004bec00 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.553+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.553+0000 7ffb0330d700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55690061c000 0x5569004bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.553+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690061c000 2024-04-19T23:45:41.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.553+0000 7ffb0430f700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55690061c000 0x5569004bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.553+0000 7ffb0430f700 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55690061c000 0x5569004bf180 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.554+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.554+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x5569001d5800 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.554+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.554+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x5569001d5800 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.554+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.554+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690061c000 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.555+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.555+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690061c000 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.555+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.555+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b400 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.555+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.555+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b000 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.555+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.555+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x5569001d5800 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.556+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.556+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690061c000 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.556+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.556+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x5569001d5800 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.556+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.556+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b400 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.556+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.556+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b000 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.557+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.557+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b000 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.557+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.557+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690061c000 2024-04-19T23:45:41.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.557+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.557+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b000 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.557+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.557+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b000 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.557+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.557+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x5569001d5800 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.558+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.558+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x5569001d5800 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.558+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.558+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690061c000 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.558+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.558+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b000 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.558+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.558+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b400 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.559+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.559+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x5569001d5800 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.559+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.559+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690061c000 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.559+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.559+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b000 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.559+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.559+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690061c000 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.560+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.560+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b400 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.560+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.560+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b000 2024-04-19T23:45:41.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.560+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.560+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690061c000 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.560+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.560+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x5569001d5800 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.560+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.560+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b400 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569001d5c00 con 0x5569001d5800 2024-04-19T23:45:41.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061cc00 con 0x5569001d5800 2024-04-19T23:45:41.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061d000 con 0x55690055b400 2024-04-19T23:45:41.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:41.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 zone default found 2024-04-19T23:45:41.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 4 Realm: () 2024-04-19T23:45:41.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:41.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:41.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:41.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 zonegroup default 2024-04-19T23:45:41.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.561+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061d400 con 0x55690061c000 2024-04-19T23:45:41.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb05b64a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061d800 con 0x55690055b000 2024-04-19T23:45:41.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb05b64a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061dc00 con 0x55690055b000 2024-04-19T23:45:41.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb05b64a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb05b64a80 20 started sync module instance, tier type = 2024-04-19T23:45:41.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb05b64a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:41.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.562+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061cc00 con 0x55690055b400 2024-04-19T23:45:41.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.563+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.564+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93909464857344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569001d5c00 con 0x55690055b400 2024-04-19T23:45:41.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.564+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055b800 con 0x5569001d5800 2024-04-19T23:45:41.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.564+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93909464857344] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.565+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.565+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93909464858496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055bc00 con 0x5569001d5800 2024-04-19T23:45:41.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.565+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690055b000 2024-04-19T23:45:41.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.566+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93909464858496] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.566+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.566+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93909464859648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061d000 con 0x55690055b000 2024-04-19T23:45:41.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.566+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061cc00 con 0x55690055b400 2024-04-19T23:45:41.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.567+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93909464859648] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.567+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.567+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93909464860800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c400 con 0x55690055b400 2024-04-19T23:45:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.567+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061d800 con 0x5569001d5800 2024-04-19T23:45:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.568+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.568+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93909464861952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061dc00 con 0x5569001d5800 2024-04-19T23:45:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.568+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061c800 con 0x55690061c000 2024-04-19T23:45:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.568+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93909464860800] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.569+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.569+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93909464861952] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.569+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93909464863104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061d400 con 0x55690061c000 2024-04-19T23:45:41.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.569+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061d800 con 0x55690061c000 2024-04-19T23:45:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.570+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93909464863104] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.570+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.570+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93909464864256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061dc00 con 0x55690061c000 2024-04-19T23:45:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.570+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055b800 con 0x55690061c000 2024-04-19T23:45:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.571+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93909464864256] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.571+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.571+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93909464865408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055bc00 con 0x55690061c000 2024-04-19T23:45:41.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.571+0000 7ffb05b64a80 20 add_watcher() i=0 2024-04-19T23:45:41.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.571+0000 7ffb05b64a80 20 add_watcher() i=1 2024-04-19T23:45:41.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.571+0000 7ffb05b64a80 20 add_watcher() i=2 2024-04-19T23:45:41.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.571+0000 7ffb05b64a80 20 add_watcher() i=3 2024-04-19T23:45:41.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.571+0000 7ffb05b64a80 20 add_watcher() i=4 2024-04-19T23:45:41.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.571+0000 7ffb05b64a80 20 add_watcher() i=5 2024-04-19T23:45:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.571+0000 7ffb05b64a80 20 add_watcher() i=6 2024-04-19T23:45:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.572+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93909464865408] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.572+0000 7ffb05b64a80 20 add_watcher() i=7 2024-04-19T23:45:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.572+0000 7ffb05b64a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.572+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055b800 con 0x5569001d5800 2024-04-19T23:45:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.572+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.572+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93909466398720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055bc00 con 0x5569001d5800 2024-04-19T23:45:41.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.573+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93909466398720] v30'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.573+0000 7ffaeaadc700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.573+0000 7ffb05b64a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:41.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.573+0000 7ffb05b64a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:41.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.574+0000 7ffb05b64a80 1 Processor -- start 2024-04-19T23:45:41.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.574+0000 7ffb05b64a80 1 -- start start 2024-04-19T23:45:41.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.574+0000 7ffb05b64a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.574+0000 7ffb05b64a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569002763c0 con 0x55690061d400 2024-04-19T23:45:41.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.574+0000 7ffb0330d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.574+0000 7ffb0330d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36408/0 (socket says 172.21.15.155:36408) 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.574+0000 7ffb0330d700 1 -- 172.21.15.155:0/4190988824 learned_addr learned my addr 172.21.15.155:0/4190988824 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.574+0000 7ffb0330d700 1 -- 172.21.15.155:0/4190988824 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569001fcb60 con 0x55690061d400 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.574+0000 7ffb0330d700 1 --2- 172.21.15.155:0/4190988824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x5569005c1800 tx=0x5569005216e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5149aa7c334430 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.575+0000 7ffaea2db700 1 -- 172.21.15.155:0/4190988824 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55690028d760 con 0x55690061d400 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.575+0000 7ffaea2db700 1 -- 172.21.15.155:0/4190988824 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55690063e000 con 0x55690061d400 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.575+0000 7ffaea2db700 1 -- 172.21.15.155:0/4190988824 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556900640000 con 0x55690061d400 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.575+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4190988824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 msgr2=0x5569004be680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.575+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/4190988824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x5569005c1800 tx=0x5569005216e0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.575+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4190988824 shutdown_connections 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.575+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/4190988824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.575+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4190988824 >> 172.21.15.155:0/4190988824 conn(0x55690061c800 msgr2=0x5569002c2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.575+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4190988824 shutdown_connections 2024-04-19T23:45:41.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.575+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4190988824 wait complete. 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.576+0000 7ffb05b64a80 1 Processor -- start 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.576+0000 7ffb05b64a80 1 -- start start 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.576+0000 7ffb05b64a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.576+0000 7ffb05b64a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x556900276500 con 0x55690061d400 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.576+0000 7ffb0330d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.576+0000 7ffb0330d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36410/0 (socket says 172.21.15.155:36410) 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.576+0000 7ffb0330d700 1 -- 172.21.15.155:0/847287610 learned_addr learned my addr 172.21.15.155:0/847287610 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.576+0000 7ffb0330d700 1 -- 172.21.15.155:0/847287610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569001fcd00 con 0x55690061d400 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.576+0000 7ffb0330d700 1 --2- 172.21.15.155:0/847287610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x556900631200 tx=0x556900521800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.577+0000 7ffae8ad8700 1 -- 172.21.15.155:0/847287610 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556900640160 con 0x55690061d400 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.577+0000 7ffae8ad8700 1 -- 172.21.15.155:0/847287610 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55690063e180 con 0x55690061d400 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.577+0000 7ffb05b64a80 1 -- 172.21.15.155:0/847287610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5569001fc340 con 0x55690061d400 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.577+0000 7ffae8ad8700 1 -- 172.21.15.155:0/847287610 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5569006402c0 con 0x55690061d400 2024-04-19T23:45:41.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.577+0000 7ffb05b64a80 1 -- 172.21.15.155:0/847287610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569001fdd40 con 0x55690061d400 2024-04-19T23:45:41.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.577+0000 7ffae8ad8700 1 -- 172.21.15.155:0/847287610 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x556900f77b80 con 0x55690061d400 2024-04-19T23:45:41.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.577+0000 7ffae8ad8700 1 --2- 172.21.15.155:0/847287610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569006c0000 0x5569004bf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.578+0000 7ffae8ad8700 1 -- 172.21.15.155:0/847287610 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55690024f500 con 0x55690061d400 2024-04-19T23:45:41.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.578+0000 7ffb0430f700 1 --2- 172.21.15.155:0/847287610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569006c0000 0x5569004bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.578+0000 7ffb05b64a80 5 note: GC not initialized 2024-04-19T23:45:41.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.578+0000 7ffb0430f700 1 --2- 172.21.15.155:0/847287610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569006c0000 0x5569004bf700 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5569005c1f50 tx=0x556900520a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffae62d3700 20 reqs_thread_entry: start 2024-04-19T23:45:41.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:41.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffae42cf700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:11 2024 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffae3aad700 20 reqs_thread_entry: start 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061dc00 con 0x5569001d5800 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.579+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c0400 con 0x5569001d5800 2024-04-19T23:45:41.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+241 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 20 rados_obj.operate() r=0 bl.length=193 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 : miss 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.18 8:1f1bad56:root::.bucket.meta.testx%3amyfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c0800 con 0x5569001d5800 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv12 ondisk = 0) v8 ==== 338+0+733 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 20 rados_obj.operate() r=0 bl.length=371 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-19T23:45:41.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.580+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c0c00 con 0x5569001d5800 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.581+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.581+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c1000 con 0x5569001d5800 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.582+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(66 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [create,call,writefull 0~352,setxattr (123)] v30'5 uv5 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.582+0000 7ffb05b64a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x7 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.582+0000 7ffb05b64a80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.582+0000 7ffb05b64a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.582+0000 7ffb05b64a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1, ofs0, ns] 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.582+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93909466401024 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c1400 con 0x55690055b000 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 93909464859648 notify 128849018889 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x55690051fd40 con 0x55690055b000 2024-04-19T23:45:41.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffafe303700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 93909464859648 notifier 4597 bl.length()=701 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffafe303700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x7 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffafe303700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffafe303700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(67 notify.2 [notify cookie 93909466401024 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffafe303700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055b800 con 0x55690055b000 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== watch-notify(notify_complete (2) cookie 93909466401024 notify 128849018889 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556900687ba0 con 0x55690055b000 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffb05b64a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_sources= new_sources= 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffb05b64a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential sources added=[] removed=[] 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffb05b64a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_dests= new_dests= 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffb05b64a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential dests added=[] removed=[] 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.583+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c1800 con 0x55690055b400 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.585+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(69 foo.buckets [call] v30'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.585+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c1c00 con 0x55690055b400 2024-04-19T23:45:41.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.586+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffb05b64a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffb05b64a80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffb05b64a80 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93909466401024 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c1800 con 0x55690061c000 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== watch-notify(notify (1) cookie 93909464864256 notify 128849018898 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x5569005c5d40 con 0x55690061c000 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffafe303700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 93909464864256 notifier 4597 bl.length()=314 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffafe303700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffafe303700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffafe303700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690055bc00 con 0x55690061c000 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 notify.6 [notify cookie 93909466401024 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== watch-notify(notify_complete (2) cookie 93909466401024 notify 128849018898 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556900685a00 con 0x55690061c000 2024-04-19T23:45:41.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.587+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c1c00 con 0x5569001d5800 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.588+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(73 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.588+0000 7ffb05b64a80 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.588+0000 7ffb05b64a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.588+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 93909466401024 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c0400 con 0x5569001d5800 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.588+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== watch-notify(notify (1) cookie 93909464861952 notify 128849018893 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x556900685a00 con 0x5569001d5800 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.588+0000 7ffafdb02700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 93909464861952 notifier 4597 bl.length()=155 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.588+0000 7ffafdb02700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556900740000 con 0x5569001d5800 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.588+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(74 notify.4 [notify cookie 93909466401024 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.589+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.589+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== watch-notify(notify_complete (2) cookie 93909466401024 notify 128849018893 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556900683040 con 0x5569001d5800 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.589+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:76 8.18 8:1f1bad56:root::.bucket.meta.testx%3amyfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c0800 con 0x5569001d5800 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.590+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call,delete] v30'13 uv13 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.590+0000 7ffb05b64a80 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 from cache 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.590+0000 7ffb05b64a80 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1, ofs0, ns] 2024-04-19T23:45:41.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.590+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 93909466401024 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c0c00 con 0x5569001d5800 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.590+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 33 ==== watch-notify(notify (1) cookie 93909464858496 notify 128849018894 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x556900683040 con 0x5569001d5800 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.590+0000 7ffafe303700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 93909464858496 notifier 4597 bl.length()=212 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.590+0000 7ffafe303700 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556900740400 con 0x5569001d5800 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.590+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 34 ==== osd_op_reply(77 notify.1 [notify cookie 93909466401024 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.590+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 35 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.590+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 36 ==== watch-notify(notify_complete (2) cookie 93909466401024 notify 128849018894 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5569006831e0 con 0x5569001d5800 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.591+0000 7ffaeaadc700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.591+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93909466398720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569006c1000 con 0x5569001d5800 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.592+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 37 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93909466398720] v30'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.592+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93909464857344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061cc00 con 0x55690055b400 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.593+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93909464857344] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.593+0000 7ffb05b64a80 20 remove_watcher() i=0 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.593+0000 7ffb05b64a80 2 removed watcher, disabling cache 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.593+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93909464858496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55690061dc00 con 0x5569001d5800 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.594+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 38 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93909464858496] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.594+0000 7ffb05b64a80 20 remove_watcher() i=1 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.594+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93909464859648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5569001d5c00 con 0x55690055b000 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.595+0000 7ffb03b0e700 1 -- 172.21.15.155:0/2214005610 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93909464859648] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900615200 con 0x55690055b000 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.595+0000 7ffb05b64a80 20 remove_watcher() i=2 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.595+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93909464860800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556900740000 con 0x55690055b400 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.596+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93909464860800] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900615440 con 0x55690055b400 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.596+0000 7ffb05b64a80 20 remove_watcher() i=3 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.596+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93909464861952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556900740400 con 0x5569001d5800 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.597+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.1 v2:172.21.15.155:6800/41833 39 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93909464861952] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x5569001d5800 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.597+0000 7ffb05b64a80 20 remove_watcher() i=4 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.597+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93909464863104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556900741000 con 0x55690061c000 2024-04-19T23:45:41.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.598+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93909464863104] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.598+0000 7ffb05b64a80 20 remove_watcher() i=5 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.598+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93909464864256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556900741400 con 0x55690061c000 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.599+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93909464864256] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.599+0000 7ffb05b64a80 20 remove_watcher() i=6 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.599+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93909464865408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556900741800 con 0x55690061c000 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb0430f700 1 -- 172.21.15.155:0/2214005610 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93909464865408] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556900614b40 con 0x55690061c000 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 20 remove_watcher() i=7 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55690061c000 msgr2=0x5569004bf180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55690061c000 0x5569004bf180 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5569001d5800 msgr2=0x5569004bdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5569001d5800 0x5569004bdb80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55690055b400 msgr2=0x5569004bec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55690055b400 0x5569004bec00 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55690055b000 msgr2=0x5569004be100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55690055b000 0x5569004be100 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55690055ac00 msgr2=0x5569004bd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55690055ac00 0x5569004bd600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5569004b7890 tx=0x5569002c5800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 msgr2=0x5569004bcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/2214005610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d5400 0x5569004bcb00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x5569010663f0 tx=0x556900520120 comp rx=0 tx=0).stop 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 reap_dead start 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb0330d700 1 -- 172.21.15.155:0/2214005610 reap_dead start 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 shutdown_connections 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 >> 172.21.15.155:0/2214005610 conn(0x5569001d4c00 msgr2=0x5569002c1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 shutdown_connections 2024-04-19T23:45:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.600+0000 7ffb05b64a80 1 -- 172.21.15.155:0/2214005610 wait complete. 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/847287610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569006c0000 msgr2=0x5569004bf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/847287610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569006c0000 0x5569004bf700 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5569005c1f50 tx=0x556900520a20 comp rx=0 tx=0).stop 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/847287610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 msgr2=0x5569004be680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/847287610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x556900631200 tx=0x556900521800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/847287610 shutdown_connections 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/847287610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5569006c0000 0x5569004bf700 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/847287610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55690061d400 0x5569004be680 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/847287610 >> 172.21.15.155:0/847287610 conn(0x55690061c800 msgr2=0x5569002c2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/847287610 shutdown_connections 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/847287610 wait complete. 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4064586274 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55690055a000 msgr2=0x5569004bd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/4064586274 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55690055a000 0x5569004bd080 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x556901066f00 tx=0x556900520240 comp rx=0 tx=0).stop 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4064586274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 msgr2=0x5569004bc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/4064586274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x556900fa5e30 tx=0x5569002c5a40 comp rx=0 tx=0).stop 2024-04-19T23:45:41.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4064586274 shutdown_connections 2024-04-19T23:45:41.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/4064586274 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55690055a000 0x5569004bd080 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 --2- 172.21.15.155:0/4064586274 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5569001d4800 0x5569004bc580 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4064586274 >> 172.21.15.155:0/4064586274 conn(0x5569001d4400 msgr2=0x5569002c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4064586274 shutdown_connections 2024-04-19T23:45:41.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.601+0000 7ffb05b64a80 1 -- 172.21.15.155:0/4064586274 wait complete. 2024-04-19T23:45:41.619 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-19T23:45:41.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-19T23:45:41.619 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-04-19T23:45:41.666 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:41.666 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:41.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.667+0000 7f5d6db14a80 1 Processor -- start 2024-04-19T23:45:41.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.667+0000 7f5d6db14a80 1 -- start start 2024-04-19T23:45:41.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.667+0000 7f5d6db14a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x561b4bc62c00 0x561b4bf4a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.667+0000 7f5d6db14a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561b4bf8d500 con 0x561b4bc62800 2024-04-19T23:45:41.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.667+0000 7f5d6db14a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x561b4bd04a00 con 0x561b4bc62c00 2024-04-19T23:45:41.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.668+0000 7f5d6b2bd700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x561b4bc62c00 0x561b4bf4a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.668+0000 7f5d6babe700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x561b4bc62800 0x561b4bd4e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46818/0 (socket says 172.21.15.155:46818) 2024-04-19T23:45:41.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.668+0000 7f5d6babe700 1 -- 172.21.15.155:0/483224600 learned_addr learned my addr 172.21.15.155:0/483224600 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.668+0000 7f5d6aabc700 1 -- 172.21.15.155:0/483224600 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117159775 0 0) 0x561b4ca30000 con 0x561b4bc62800 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.668+0000 7f5d6aabc700 1 -- 172.21.15.155:0/483224600 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x561b4bf8d680 con 0x561b4bc62800 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.668+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/483224600 >> v1:172.21.15.76:6789/0 conn(0x561b4bc62800 legacy=0x561b4bd4e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.668+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/483224600 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b4bc8bd40 con 0x561b4bc62c00 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.668+0000 7f5d6b2bd700 1 --2- 172.21.15.155:0/483224600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62c00 0x561b4bf4a580 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x561b4bf45890 tx=0x561b4bd53980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100a828383d3569e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.668+0000 7f5d6aabc700 1 -- 172.21.15.155:0/483224600 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4bd1b4a0 con 0x561b4bc62c00 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.668+0000 7f5d6aabc700 1 -- 172.21.15.155:0/483224600 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b4bf8d680 con 0x561b4bc62c00 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.668+0000 7f5d6aabc700 1 -- 172.21.15.155:0/483224600 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4bd1b600 con 0x561b4bc62c00 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.669+0000 7f5d6db14a80 1 -- 172.21.15.155:0/483224600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62c00 msgr2=0x561b4bf4a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.669+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/483224600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62c00 0x561b4bf4a580 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x561b4bf45890 tx=0x561b4bd53980 comp rx=0 tx=0).stop 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.669+0000 7f5d6db14a80 1 -- 172.21.15.155:0/483224600 shutdown_connections 2024-04-19T23:45:41.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.669+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/483224600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62c00 0x561b4bf4a580 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.669+0000 7f5d6db14a80 1 -- 172.21.15.155:0/483224600 >> 172.21.15.155:0/483224600 conn(0x561b4bc62400 msgr2=0x561b4bd4e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.669+0000 7f5d6db14a80 1 -- 172.21.15.155:0/483224600 shutdown_connections 2024-04-19T23:45:41.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.669+0000 7f5d6db14a80 1 -- 172.21.15.155:0/483224600 wait complete. 2024-04-19T23:45:41.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.669+0000 7f5d6db14a80 1 Processor -- start 2024-04-19T23:45:41.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.669+0000 7f5d6db14a80 1 -- start start 2024-04-19T23:45:41.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.670+0000 7f5d6db14a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.670+0000 7f5d6db14a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b4bd04500 con 0x561b4bc62800 2024-04-19T23:45:41.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.670+0000 7f5d6babe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.670+0000 7f5d6babe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36422/0 (socket says 172.21.15.155:36422) 2024-04-19T23:45:41.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.670+0000 7f5d6babe700 1 -- 172.21.15.155:0/1414833674 learned_addr learned my addr 172.21.15.155:0/1414833674 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.670+0000 7f5d6babe700 1 -- 172.21.15.155:0/1414833674 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b4bc8bba0 con 0x561b4bc62800 2024-04-19T23:45:41.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6babe700 1 --2- 172.21.15.155:0/1414833674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x561b4ca33770 tx=0x561b4bd53b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df22461989cb06e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6a2bb700 1 -- 172.21.15.155:0/1414833674 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4bd1b1e0 con 0x561b4bc62800 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6a2bb700 1 -- 172.21.15.155:0/1414833674 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b4bf8db00 con 0x561b4bc62800 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6a2bb700 1 -- 172.21.15.155:0/1414833674 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4bd1b4a0 con 0x561b4bc62800 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6db14a80 1 -- 172.21.15.155:0/1414833674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 msgr2=0x561b4bf4a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/1414833674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x561b4ca33770 tx=0x561b4bd53b60 comp rx=0 tx=0).stop 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6db14a80 1 -- 172.21.15.155:0/1414833674 shutdown_connections 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/1414833674 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6db14a80 1 -- 172.21.15.155:0/1414833674 >> 172.21.15.155:0/1414833674 conn(0x561b4bc62400 msgr2=0x561b4bd4f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6db14a80 1 -- 172.21.15.155:0/1414833674 shutdown_connections 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6db14a80 1 -- 172.21.15.155:0/1414833674 wait complete. 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.671+0000 7f5d6db14a80 1 Processor -- start 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.672+0000 7f5d6db14a80 1 -- start start 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.672+0000 7f5d6db14a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.672+0000 7f5d6db14a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b4bd043c0 con 0x561b4bc62800 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.672+0000 7f5d6babe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.672+0000 7f5d6babe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36438/0 (socket says 172.21.15.155:36438) 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.672+0000 7f5d6babe700 1 -- 172.21.15.155:0/3401489471 learned_addr learned my addr 172.21.15.155:0/3401489471 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.672+0000 7f5d6babe700 1 -- 172.21.15.155:0/3401489471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b4bc8ba00 con 0x561b4bc62800 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.672+0000 7f5d6babe700 1 --2- 172.21.15.155:0/3401489471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x561b4ca33e30 tx=0x561b4bd53920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.672+0000 7f5d68ab8700 1 -- 172.21.15.155:0/3401489471 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4bd1b600 con 0x561b4bc62800 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.672+0000 7f5d68ab8700 1 -- 172.21.15.155:0/3401489471 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b4bd03c80 con 0x561b4bc62800 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.673+0000 7f5d6db14a80 1 -- 172.21.15.155:0/3401489471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b4bc8b860 con 0x561b4bc62800 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.673+0000 7f5d68ab8700 1 -- 172.21.15.155:0/3401489471 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4bd1b1e0 con 0x561b4bc62800 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.673+0000 7f5d6db14a80 1 -- 172.21.15.155:0/3401489471 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b4bc8b6c0 con 0x561b4bc62800 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.673+0000 7f5d6db14a80 1 Processor -- start 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.673+0000 7f5d6db14a80 1 -- start start 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.673+0000 7f5d68ab8700 1 -- 172.21.15.155:0/3401489471 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561b4ca04b00 con 0x561b4bc62800 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.673+0000 7f5d6db14a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 0x561b4bf4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.673+0000 7f5d6db14a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b4bc9e640 con 0x561b4bc63400 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d68ab8700 1 --2- 172.21.15.155:0/3401489471 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4bfea000 0x561b4bf4b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d68ab8700 1 -- 172.21.15.155:0/3401489471 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x561b4bcdd180 con 0x561b4bc62800 2024-04-19T23:45:41.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d6c2bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 0x561b4bf4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d6c2bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 0x561b4bf4ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36454/0 (socket says 172.21.15.155:36454) 2024-04-19T23:45:41.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/2486880653 learned_addr learned my addr 172.21.15.155:0/2486880653 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d6babe700 1 --2- 172.21.15.155:0/3401489471 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4bfea000 0x561b4bf4b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/2486880653 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b4bc8a000 con 0x561b4bc63400 2024-04-19T23:45:41.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d6babe700 1 --2- 172.21.15.155:0/3401489471 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4bfea000 0x561b4bf4b080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x561b4caf6f00 tx=0x561b4bfb2240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d6c2bf700 1 --2- 172.21.15.155:0/2486880653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 0x561b4bf4ab00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x561b4ca33e90 tx=0x561b4bfb29c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6162f389c96eb82 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d662b3700 1 -- 172.21.15.155:0/2486880653 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4bd1b600 con 0x561b4bc63400 2024-04-19T23:45:41.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d662b3700 1 -- 172.21.15.155:0/2486880653 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b4bf8c480 con 0x561b4bc63400 2024-04-19T23:45:41.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.674+0000 7f5d662b3700 1 -- 172.21.15.155:0/2486880653 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4bd1b1e0 con 0x561b4bc63400 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6db14a80 1 -- 172.21.15.155:0/2486880653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 msgr2=0x561b4bf4ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/2486880653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 0x561b4bf4ab00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x561b4ca33e90 tx=0x561b4bfb29c0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6db14a80 1 -- 172.21.15.155:0/2486880653 shutdown_connections 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/2486880653 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 0x561b4bf4ab00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6db14a80 1 -- 172.21.15.155:0/2486880653 >> 172.21.15.155:0/2486880653 conn(0x561b4bc62c00 msgr2=0x561b4bd4f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6db14a80 1 -- 172.21.15.155:0/2486880653 shutdown_connections 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6db14a80 1 -- 172.21.15.155:0/2486880653 wait complete. 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6db14a80 1 Processor -- start 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6db14a80 1 -- start start 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6db14a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 0x561b4bf4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6db14a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b4bc9e8c0 con 0x561b4bc63400 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.675+0000 7f5d6c2bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 0x561b4bf4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.676+0000 7f5d6c2bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 0x561b4bf4ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36458/0 (socket says 172.21.15.155:36458) 2024-04-19T23:45:41.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.676+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 learned_addr learned my addr 172.21.15.155:0/4176660377 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.676+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b4bc8aea0 con 0x561b4bc63400 2024-04-19T23:45:41.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.676+0000 7f5d6c2bf700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 0x561b4bf4ab00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x561b4caf6450 tx=0x561b4bd53f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.676+0000 7f5d64ab0700 1 -- 172.21.15.155:0/4176660377 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4bd1ba20 con 0x561b4bc63400 2024-04-19T23:45:41.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.676+0000 7f5d64ab0700 1 -- 172.21.15.155:0/4176660377 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b4bf8c180 con 0x561b4bc63400 2024-04-19T23:45:41.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.676+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b4bc8a820 con 0x561b4bc63400 2024-04-19T23:45:41.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.676+0000 7f5d64ab0700 1 -- 172.21.15.155:0/4176660377 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4bd1b600 con 0x561b4bc63400 2024-04-19T23:45:41.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.676+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b4bc8a9c0 con 0x561b4bc63400 2024-04-19T23:45:41.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.677+0000 7f5d64ab0700 1 -- 172.21.15.155:0/4176660377 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561b4ca04dc0 con 0x561b4bc63400 2024-04-19T23:45:41.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.677+0000 7f5d64ab0700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4bfeac00 0x561b4bf4b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.677+0000 7f5d64ab0700 1 -- 172.21.15.155:0/4176660377 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x561b4bcdd340 con 0x561b4bc63400 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.677+0000 7f5d6b2bd700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4bfeac00 0x561b4bf4b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.677+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.677+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561b4bc63800 0x561b4bf4bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.677+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bc63c00 con 0x561b4bc63800 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.677+0000 7f5d6c2bf700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561b4bc63800 0x561b4bf4bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6b2bd700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4bfeac00 0x561b4bf4b600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x561b4bf45890 tx=0x561b4bd53800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6c2bf700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561b4bc63800 0x561b4bf4bb80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6db14a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6db14a80 20 realm 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfeb000 con 0x561b4bc63800 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6db14a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6db14a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.678+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfeb400 con 0x561b4bc63800 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6db14a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfeb800 con 0x561b4bc63800 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6db14a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfebc00 con 0x561b4bc63800 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6db14a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6db14a80 20 searching for the correct realm 2024-04-19T23:45:41.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561b4bfeb000 0x561b4bf4c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfeb400 con 0x561b4bfeb000 2024-04-19T23:45:41.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.679+0000 7f5d6babe700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561b4bfeb000 0x561b4bf4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.680+0000 7f5d6babe700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561b4bfeb000 0x561b4bf4c100 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.680+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.680+0000 7f5d6babe700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561b4bfeb400 0x561b4bf4cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.680+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac000 con 0x561b4bfeb400 2024-04-19T23:45:41.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.680+0000 7f5d6b2bd700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561b4bfeb400 0x561b4bf4cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.680+0000 7f5d6b2bd700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561b4bfeb400 0x561b4bf4cc00 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.681+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.681+0000 7f5d6b2bd700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561b4c0ac000 0x561b4bf4d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.681+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4c0ac000 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.681+0000 7f5d6c2bf700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561b4c0ac000 0x561b4bf4d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.681+0000 7f5d6c2bf700 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561b4c0ac000 0x561b4bf4d180 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.681+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.681+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bc63800 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.682+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.682+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bc63800 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.682+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.682+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4c0ac000 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.682+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.682+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4c0ac000 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.682+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.682+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb400 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.683+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.683+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb000 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.683+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.683+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bc63800 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.683+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.683+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4c0ac000 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.683+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.683+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bc63800 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.683+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.683+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb400 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.684+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.684+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb000 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.684+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.684+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb000 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.684+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.684+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4c0ac000 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.685+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.685+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb000 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.685+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.685+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb000 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.685+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.685+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bc63800 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.685+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.685+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bc63800 2024-04-19T23:45:41.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.685+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.685+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4c0ac000 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.686+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.686+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb000 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.686+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.686+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb400 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.686+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.686+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bc63800 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.687+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.687+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4c0ac000 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.687+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.687+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb000 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.687+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.687+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4c0ac000 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.687+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.687+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb400 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.688+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.688+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb000 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.688+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.688+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4c0ac000 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.688+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.688+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bc63800 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.688+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.688+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb400 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:41.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:41.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bc63c00 con 0x561b4bc63800 2024-04-19T23:45:41.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0acc00 con 0x561b4bc63800 2024-04-19T23:45:41.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ad000 con 0x561b4bfeb400 2024-04-19T23:45:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 zone default found 2024-04-19T23:45:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 4 Realm: () 2024-04-19T23:45:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 zonegroup default 2024-04-19T23:45:41.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.689+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ad400 con 0x561b4c0ac000 2024-04-19T23:45:41.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6db14a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ad800 con 0x561b4bfeb000 2024-04-19T23:45:41.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6db14a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0adc00 con 0x561b4bfeb000 2024-04-19T23:45:41.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6db14a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6db14a80 20 started sync module instance, tier type = 2024-04-19T23:45:41.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6db14a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:41.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.690+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0acc00 con 0x561b4bfeb400 2024-04-19T23:45:41.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.691+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.691+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94675238394624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bc63c00 con 0x561b4bfeb400 2024-04-19T23:45:41.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.691+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfeb800 con 0x561b4bc63800 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.692+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94675238394624] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.692+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.693+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94675238395776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfebc00 con 0x561b4bc63800 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.693+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4bfeb000 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.694+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94675238395776] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.694+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.694+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94675238396928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ad000 con 0x561b4bfeb000 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.694+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0acc00 con 0x561b4bfeb400 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.695+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94675238396928] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.695+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.695+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94675238398080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac400 con 0x561b4bfeb400 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.695+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ad800 con 0x561b4bc63800 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.696+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94675238398080] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.696+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.696+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94675238399232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0adc00 con 0x561b4bc63800 2024-04-19T23:45:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.696+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ac800 con 0x561b4c0ac000 2024-04-19T23:45:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.697+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.697+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94675238400384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ad400 con 0x561b4c0ac000 2024-04-19T23:45:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.697+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ad800 con 0x561b4c0ac000 2024-04-19T23:45:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.697+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94675238399232] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.698+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94675238400384] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.698+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.698+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94675238401536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0adc00 con 0x561b4c0ac000 2024-04-19T23:45:41.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.698+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfeb800 con 0x561b4c0ac000 2024-04-19T23:45:41.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.699+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94675238401536] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.699+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.699+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94675238402688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfebc00 con 0x561b4c0ac000 2024-04-19T23:45:41.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.699+0000 7f5d6db14a80 20 add_watcher() i=0 2024-04-19T23:45:41.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.699+0000 7f5d6db14a80 20 add_watcher() i=1 2024-04-19T23:45:41.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.699+0000 7f5d6db14a80 20 add_watcher() i=2 2024-04-19T23:45:41.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.699+0000 7f5d6db14a80 20 add_watcher() i=3 2024-04-19T23:45:41.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.699+0000 7f5d6db14a80 20 add_watcher() i=4 2024-04-19T23:45:41.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.699+0000 7f5d6db14a80 20 add_watcher() i=5 2024-04-19T23:45:41.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.699+0000 7f5d6db14a80 20 add_watcher() i=6 2024-04-19T23:45:41.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.700+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94675238402688] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.700+0000 7f5d6db14a80 20 add_watcher() i=7 2024-04-19T23:45:41.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.700+0000 7f5d6db14a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:41.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.700+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfeb800 con 0x561b4bc63800 2024-04-19T23:45:41.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.700+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.700+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94675239944192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfebc00 con 0x561b4bc63800 2024-04-19T23:45:41.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.701+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94675239944192] v30'135 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.701+0000 7f5d52a8c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.701+0000 7f5d6db14a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:41.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.701+0000 7f5d6db14a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:41.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.702+0000 7f5d6db14a80 1 Processor -- start 2024-04-19T23:45:41.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.702+0000 7f5d6db14a80 1 -- start start 2024-04-19T23:45:41.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.702+0000 7f5d6db14a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 0x561b4bf4c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.702+0000 7f5d6db14a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b4bd043c0 con 0x561b4c0ad400 2024-04-19T23:45:41.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.702+0000 7f5d6b2bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 0x561b4bf4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.702+0000 7f5d6b2bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 0x561b4bf4c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36470/0 (socket says 172.21.15.155:36470) 2024-04-19T23:45:41.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.702+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/1278822180 learned_addr learned my addr 172.21.15.155:0/1278822180 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.703+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/1278822180 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b4bc8ab60 con 0x561b4c0ad400 2024-04-19T23:45:41.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.703+0000 7f5d6b2bd700 1 --2- 172.21.15.155:0/1278822180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 0x561b4bf4c680 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x561b4c04f800 tx=0x561b4bfb36e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfbe6b59de04161 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.703+0000 7f5d5228b700 1 -- 172.21.15.155:0/1278822180 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4bd1b760 con 0x561b4c0ad400 2024-04-19T23:45:41.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.703+0000 7f5d5228b700 1 -- 172.21.15.155:0/1278822180 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b4c0ce000 con 0x561b4c0ad400 2024-04-19T23:45:41.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.703+0000 7f5d5228b700 1 -- 172.21.15.155:0/1278822180 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4c0d0000 con 0x561b4c0ad400 2024-04-19T23:45:41.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.703+0000 7f5d6db14a80 1 -- 172.21.15.155:0/1278822180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 msgr2=0x561b4bf4c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.703+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/1278822180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 0x561b4bf4c680 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x561b4c04f800 tx=0x561b4bfb36e0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6db14a80 1 -- 172.21.15.155:0/1278822180 shutdown_connections 2024-04-19T23:45:41.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/1278822180 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 0x561b4bf4c680 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6db14a80 1 -- 172.21.15.155:0/1278822180 >> 172.21.15.155:0/1278822180 conn(0x561b4c0ac800 msgr2=0x561b4bd50000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6db14a80 1 -- 172.21.15.155:0/1278822180 shutdown_connections 2024-04-19T23:45:41.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6db14a80 1 -- 172.21.15.155:0/1278822180 wait complete. 2024-04-19T23:45:41.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6db14a80 1 Processor -- start 2024-04-19T23:45:41.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6db14a80 1 -- start start 2024-04-19T23:45:41.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6db14a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 0x561b4bf4c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6db14a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b4bd04500 con 0x561b4c0ad400 2024-04-19T23:45:41.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6b2bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 0x561b4bf4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6b2bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 0x561b4bf4c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36480/0 (socket says 172.21.15.155:36480) 2024-04-19T23:45:41.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.704+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/128457160 learned_addr learned my addr 172.21.15.155:0/128457160 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.705+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b4bc8ad00 con 0x561b4c0ad400 2024-04-19T23:45:41.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.705+0000 7f5d6b2bd700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 0x561b4bf4c680 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x561b4c0c1200 tx=0x561b4bfb3800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.705+0000 7f5d50a88700 1 -- 172.21.15.155:0/128457160 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4c0d0160 con 0x561b4c0ad400 2024-04-19T23:45:41.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.705+0000 7f5d50a88700 1 -- 172.21.15.155:0/128457160 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b4c0ce180 con 0x561b4c0ad400 2024-04-19T23:45:41.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.705+0000 7f5d50a88700 1 -- 172.21.15.155:0/128457160 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b4c0d02c0 con 0x561b4c0ad400 2024-04-19T23:45:41.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.705+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b4bc8a340 con 0x561b4c0ad400 2024-04-19T23:45:41.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.705+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b4bc8bd40 con 0x561b4c0ad400 2024-04-19T23:45:41.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.706+0000 7f5d50a88700 1 -- 172.21.15.155:0/128457160 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561b4ca05b80 con 0x561b4c0ad400 2024-04-19T23:45:41.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.706+0000 7f5d50a88700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4c150000 0x561b4bf4d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.706+0000 7f5d50a88700 1 -- 172.21.15.155:0/128457160 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x561b4bcdd500 con 0x561b4c0ad400 2024-04-19T23:45:41.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.706+0000 7f5d6c2bf700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4c150000 0x561b4bf4d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.706+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561b4c0ad800 0x561b4c166000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.706+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0adc00 con 0x561b4c0ad800 2024-04-19T23:45:41.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.706+0000 7f5d6babe700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561b4c0ad800 0x561b4c166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.706+0000 7f5d6c2bf700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4c150000 0x561b4bf4d700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x561b4c04ff50 tx=0x561b4bfb35c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.706+0000 7f5d6babe700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561b4c0ad800 0x561b4c166000 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.708+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c0ad800 2024-04-19T23:45:41.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.708+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561b4c150400 0x561b4c166580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.708+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c150800 con 0x561b4c150400 2024-04-19T23:45:41.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.708+0000 7f5d6b2bd700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561b4c150400 0x561b4c166580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.708+0000 7f5d6b2bd700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561b4c150400 0x561b4c166580 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.709+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/128457160 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4c150400 2024-04-19T23:45:41.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.709+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561b4c150c00 0x561b4c166b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.709+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c151000 con 0x561b4c150c00 2024-04-19T23:45:41.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.709+0000 7f5d6c2bf700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561b4c150c00 0x561b4c166b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.710+0000 7f5d6c2bf700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561b4c150c00 0x561b4c166b00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.710+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.710+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c151400 con 0x561b4c0ad800 2024-04-19T23:45:41.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.711+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'136 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c0ad800 2024-04-19T23:45:41.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.711+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561b4c151800 0x561b4c167080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.711+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c151c00 con 0x561b4c151800 2024-04-19T23:45:41.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.711+0000 7f5d6babe700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561b4c151800 0x561b4c167080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.712+0000 7f5d6babe700 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561b4c151800 0x561b4c167080 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.713+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c151800 2024-04-19T23:45:41.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.713+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176000 con 0x561b4c150c00 2024-04-19T23:45:41.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.714+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.714+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176400 con 0x561b4c0ad800 2024-04-19T23:45:41.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.715+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c0ad800 2024-04-19T23:45:41.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.715+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176800 con 0x561b4c150400 2024-04-19T23:45:41.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.715+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/128457160 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4c150400 2024-04-19T23:45:41.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.716+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176c00 con 0x561b4c151800 2024-04-19T23:45:41.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.716+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c151800 2024-04-19T23:45:41.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.716+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c177000 con 0x561b4c150c00 2024-04-19T23:45:41.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.717+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'22 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.717+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c177400 con 0x561b4c151800 2024-04-19T23:45:41.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.718+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c151800 2024-04-19T23:45:41.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.718+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c177800 con 0x561b4c150400 2024-04-19T23:45:41.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.720+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/128457160 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4c150400 2024-04-19T23:45:41.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.720+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c177c00 con 0x561b4c151800 2024-04-19T23:45:41.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.721+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c151800 2024-04-19T23:45:41.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.721+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176800 con 0x561b4c150400 2024-04-19T23:45:41.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.722+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/128457160 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'34 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4c150400 2024-04-19T23:45:41.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.722+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176400 con 0x561b4c0ad800 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.722+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'137 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c0ad800 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.723+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c150800 con 0x561b4c150c00 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.723+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.724+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c151400 con 0x561b4c151800 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.724+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'40 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c151800 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.724+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c151c00 con 0x561b4c150c00 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.725+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.725+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0acc00 con 0x561b4c0ad800 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.726+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c0ad800 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.726+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0ad000 con 0x561b4c0ad800 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.727+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'138 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c0ad800 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.727+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0adc00 con 0x561b4c150c00 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.728+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.728+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bc63c00 con 0x561b4c151800 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.729+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c151800 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.729+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c151000 con 0x561b4c150c00 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.730+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.730+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c151c00 con 0x561b4c150c00 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.731+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'22 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.731+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c151400 con 0x561b4c150c00 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.732+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.732+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c150800 con 0x561b4c150c00 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.732+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.733+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0adc00 con 0x561b4c150400 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.734+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/128457160 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4c150400 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.734+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0acc00 con 0x561b4c150c00 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.734+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.734+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176000 con 0x561b4c150400 2024-04-19T23:45:41.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.735+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/128457160 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4c150400 2024-04-19T23:45:41.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.735+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c177000 con 0x561b4c150c00 2024-04-19T23:45:41.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.736+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/128457160 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'37 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c150c00 2024-04-19T23:45:41.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.736+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176c00 con 0x561b4c150400 2024-04-19T23:45:41.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.737+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/128457160 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'35 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4c150400 2024-04-19T23:45:41.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.737+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c177400 con 0x561b4c151800 2024-04-19T23:45:41.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.738+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4c151800 2024-04-19T23:45:41.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.739+0000 7f5d4e283700 20 reqs_thread_entry: start 2024-04-19T23:45:41.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.739+0000 7f5d6db14a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:41.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.739+0000 7f5d6db14a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:41.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.739+0000 7f5d4c27f700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:11 2024 2024-04-19T23:45:41.743 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:41.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d4ba5d700 20 reqs_thread_entry: start 2024-04-19T23:45:41.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6db14a80 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-19T23:45:41.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6db14a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176400 con 0x561b4c0ac000 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6db14a80 20 rados_obj.operate() r=0 bl.length=385 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6db14a80 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6db14a80 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6db14a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfeb800 con 0x561b4bc63800 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(63 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6db14a80 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.740+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfebc00 con 0x561b4c0ac000 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(64 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d6db14a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-19T23:45:41.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94675239947648 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c177000 con 0x561b4bfeb000 2024-04-19T23:45:41.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 94675238396928 notify 128849018890 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x561b4bfafd40 con 0x561b4bfeb000 2024-04-19T23:45:41.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d662b3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94675238396928 notifier 4605 bl.length()=170 2024-04-19T23:45:41.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(65 notify.2 [notify cookie 94675239947648 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d662b3700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c212000 con 0x561b4bfeb000 2024-04-19T23:45:41.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== watch-notify(notify_complete (2) cookie 94675239947648 notify 128849018890 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561b4c117ba0 con 0x561b4bfeb000 2024-04-19T23:45:41.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d6db14a80 10 removing email index: 2024-04-19T23:45:41.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d6db14a80 10 removing user buckets index 2024-04-19T23:45:41.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.742+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176400 con 0x561b4bc63800 2024-04-19T23:45:41.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.743+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(67 testx$tenanteduser.buckets [delete] v30'3 uv3 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.743+0000 7f5d6db14a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-04-19T23:45:41.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.743+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify cookie 94675239947648 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c177800 con 0x561b4bc63800 2024-04-19T23:45:41.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.744+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94675238399232 notify 128849018895 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x561b4c115a00 con 0x561b4bc63800 2024-04-19T23:45:41.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.744+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 notify.4 [notify cookie 94675239947648 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.744+0000 7f5d662b3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94675238399232 notifier 4605 bl.length()=175 2024-04-19T23:45:41.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.744+0000 7f5d662b3700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c212400 con 0x561b4bc63800 2024-04-19T23:45:41.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.744+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== watch-notify(notify_complete (2) cookie 94675239947648 notify 128849018895 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561b4c113040 con 0x561b4bc63800 2024-04-19T23:45:41.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.744+0000 7f5d6db14a80 10 removing user index: testx$tenanteduser 2024-04-19T23:45:41.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.744+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(69 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.744+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176800 con 0x561b4c0ac000 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.745+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(70 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.745+0000 7f5d6db14a80 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.745+0000 7f5d6db14a80 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.745+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [notify cookie 94675239947648 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176000 con 0x561b4bfeb400 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.745+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== watch-notify(notify (1) cookie 94675238398080 notify 128849018893 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x561b4c111040 con 0x561b4bfeb400 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.745+0000 7f5d662b3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94675238398080 notifier 4605 bl.length()=167 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.745+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(71 notify.3 [notify cookie 94675239947648 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.745+0000 7f5d662b3700 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c212800 con 0x561b4bfeb400 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.746+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== watch-notify(notify_complete (2) cookie 94675239947648 notify 128849018893 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561b4c1111e0 con 0x561b4bfeb400 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.746+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(72 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.747+0000 7f5d52a8c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.747+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94675239944192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c176c00 con 0x561b4bc63800 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.748+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94675239944192] v30'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.748+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94675238394624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0acc00 con 0x561b4bfeb400 2024-04-19T23:45:41.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.749+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94675238394624] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.749+0000 7f5d6db14a80 20 remove_watcher() i=0 2024-04-19T23:45:41.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.749+0000 7f5d6db14a80 2 removed watcher, disabling cache 2024-04-19T23:45:41.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.749+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94675238395776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c0adc00 con 0x561b4bc63800 2024-04-19T23:45:41.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.750+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94675238395776] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.750+0000 7f5d6db14a80 20 remove_watcher() i=1 2024-04-19T23:45:41.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.750+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94675238396928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4bfeb800 con 0x561b4bfeb000 2024-04-19T23:45:41.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.751+0000 7f5d6babe700 1 -- 172.21.15.155:0/4176660377 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94675238396928] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a5200 con 0x561b4bfeb000 2024-04-19T23:45:41.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.751+0000 7f5d6db14a80 20 remove_watcher() i=2 2024-04-19T23:45:41.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.751+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94675238398080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c151000 con 0x561b4bfeb400 2024-04-19T23:45:41.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.752+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94675238398080] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a5440 con 0x561b4bfeb400 2024-04-19T23:45:41.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.752+0000 7f5d6db14a80 20 remove_watcher() i=3 2024-04-19T23:45:41.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.752+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94675238399232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c151c00 con 0x561b4bc63800 2024-04-19T23:45:41.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.753+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94675238399232] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4bc63800 2024-04-19T23:45:41.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.753+0000 7f5d6db14a80 20 remove_watcher() i=4 2024-04-19T23:45:41.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.753+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94675238400384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c151400 con 0x561b4c0ac000 2024-04-19T23:45:41.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.754+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94675238400384] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.754+0000 7f5d6db14a80 20 remove_watcher() i=5 2024-04-19T23:45:41.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.754+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94675238401536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c150800 con 0x561b4c0ac000 2024-04-19T23:45:41.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.755+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94675238401536] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.755+0000 7f5d6db14a80 20 remove_watcher() i=6 2024-04-19T23:45:41.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.755+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94675238402688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b4c212400 con 0x561b4c0ac000 2024-04-19T23:45:41.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6c2bf700 1 -- 172.21.15.155:0/4176660377 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94675238402688] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b4c0a4b40 con 0x561b4c0ac000 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 20 remove_watcher() i=7 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561b4c0ac000 msgr2=0x561b4bf4d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561b4c0ac000 0x561b4bf4d180 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561b4bc63800 msgr2=0x561b4bf4bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561b4bc63800 0x561b4bf4bb80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561b4bfeb400 msgr2=0x561b4bf4cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561b4bfeb400 0x561b4bf4cc00 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561b4bfeb000 msgr2=0x561b4bf4c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561b4bfeb000 0x561b4bf4c100 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4bfeac00 msgr2=0x561b4bf4b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4bfeac00 0x561b4bf4b600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x561b4bf45890 tx=0x561b4bd53800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 msgr2=0x561b4bf4ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/4176660377 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc63400 0x561b4bf4ab00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x561b4caf6450 tx=0x561b4bd53f20 comp rx=0 tx=0).stop 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 reap_dead start 2024-04-19T23:45:41.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6b2bd700 1 -- 172.21.15.155:0/4176660377 reap_dead start 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 shutdown_connections 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 >> 172.21.15.155:0/4176660377 conn(0x561b4bc62c00 msgr2=0x561b4bd4f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 shutdown_connections 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/4176660377 wait complete. 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561b4c150400 msgr2=0x561b4c166580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561b4c150400 0x561b4c166580 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561b4c0ad800 msgr2=0x561b4c166000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561b4c0ad800 0x561b4c166000 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561b4c151800 msgr2=0x561b4c167080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561b4c151800 0x561b4c167080 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561b4c150c00 msgr2=0x561b4c166b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561b4c150c00 0x561b4c166b00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4c150000 msgr2=0x561b4bf4d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4c150000 0x561b4bf4d700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x561b4c04ff50 tx=0x561b4bfb35c0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 msgr2=0x561b4bf4c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.756+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/128457160 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4c0ad400 0x561b4bf4c680 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x561b4c0c1200 tx=0x561b4bfb3800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6babe700 1 -- 172.21.15.155:0/128457160 reap_dead start 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 shutdown_connections 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 >> 172.21.15.155:0/128457160 conn(0x561b4c0ac800 msgr2=0x561b4bd50000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 shutdown_connections 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 -- 172.21.15.155:0/128457160 wait complete. 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 -- 172.21.15.155:0/3401489471 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4bfea000 msgr2=0x561b4bf4b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/3401489471 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4bfea000 0x561b4bf4b080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x561b4caf6f00 tx=0x561b4bfb2240 comp rx=0 tx=0).stop 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 -- 172.21.15.155:0/3401489471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 msgr2=0x561b4bf4a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/3401489471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x561b4ca33e30 tx=0x561b4bd53920 comp rx=0 tx=0).stop 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 -- 172.21.15.155:0/3401489471 shutdown_connections 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/3401489471 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561b4bfea000 0x561b4bf4b080 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 --2- 172.21.15.155:0/3401489471 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561b4bc62800 0x561b4bf4a580 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 -- 172.21.15.155:0/3401489471 >> 172.21.15.155:0/3401489471 conn(0x561b4bc62400 msgr2=0x561b4bd4f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 -- 172.21.15.155:0/3401489471 shutdown_connections 2024-04-19T23:45:41.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.757+0000 7f5d6db14a80 1 -- 172.21.15.155:0/3401489471 wait complete. 2024-04-19T23:45:41.768 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-19T23:45:41.771 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-04-19T23:45:41.815 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:41.815 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-19T23:45:41.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-19T23:45:41.815 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-04-19T23:45:41.863 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:41.863 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:41.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f7520f3ea80 1 Processor -- start 2024-04-19T23:45:41.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f7520f3ea80 1 -- start start 2024-04-19T23:45:41.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f7520f3ea80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55daa3e72c00 0x55daa415a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f7520f3ea80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55daa419d500 con 0x55daa3e72800 2024-04-19T23:45:41.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f7520f3ea80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55daa3f14a00 con 0x55daa3e72c00 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f751eee8700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55daa3e72800 0x55daa3f5e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46828/0 (socket says 172.21.15.155:46828) 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f751eee8700 1 -- 172.21.15.155:0/2889272464 learned_addr learned my addr 172.21.15.155:0/2889272464 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f751e6e7700 1 --2- 172.21.15.155:0/2889272464 >> v2:172.21.15.76:3300/0 conn(0x55daa3e72c00 0x55daa415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f751dee6700 1 -- 172.21.15.155:0/2889272464 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973841021 0 0) 0x55daa4c40000 con 0x55daa3e72800 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f751dee6700 1 -- 172.21.15.155:0/2889272464 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55daa419d680 con 0x55daa3e72800 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f751e6e7700 1 -- 172.21.15.155:0/2889272464 >> v1:172.21.15.76:6789/0 conn(0x55daa3e72800 legacy=0x55daa3f5e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.864+0000 7f751e6e7700 1 -- 172.21.15.155:0/2889272464 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daa3e9bd40 con 0x55daa3e72c00 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.865+0000 7f751e6e7700 1 --2- 172.21.15.155:0/2889272464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72c00 0x55daa415a580 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x55daa4155890 tx=0x55daa3f63980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36dad0d7d44b3a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.865+0000 7f751dee6700 1 -- 172.21.15.155:0/2889272464 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa3f2b4a0 con 0x55daa3e72c00 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.865+0000 7f751dee6700 1 -- 172.21.15.155:0/2889272464 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55daa419d500 con 0x55daa3e72c00 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.865+0000 7f751dee6700 1 -- 172.21.15.155:0/2889272464 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa3f2b600 con 0x55daa3e72c00 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.865+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2889272464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72c00 msgr2=0x55daa415a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.865+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2889272464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72c00 0x55daa415a580 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x55daa4155890 tx=0x55daa3f63980 comp rx=0 tx=0).stop 2024-04-19T23:45:41.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.865+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2889272464 shutdown_connections 2024-04-19T23:45:41.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.865+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2889272464 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72c00 0x55daa415a580 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.865+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2889272464 >> 172.21.15.155:0/2889272464 conn(0x55daa3e72400 msgr2=0x55daa3f5e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.865+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2889272464 shutdown_connections 2024-04-19T23:45:41.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.865+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2889272464 wait complete. 2024-04-19T23:45:41.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.866+0000 7f7520f3ea80 1 Processor -- start 2024-04-19T23:45:41.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.866+0000 7f7520f3ea80 1 -- start start 2024-04-19T23:45:41.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.866+0000 7f7520f3ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.866+0000 7f7520f3ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daa3f14500 con 0x55daa3e72800 2024-04-19T23:45:41.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.866+0000 7f751eee8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.866+0000 7f751eee8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36508/0 (socket says 172.21.15.155:36508) 2024-04-19T23:45:41.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.866+0000 7f751eee8700 1 -- 172.21.15.155:0/3872217059 learned_addr learned my addr 172.21.15.155:0/3872217059 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.866+0000 7f751eee8700 1 -- 172.21.15.155:0/3872217059 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daa3e9bba0 con 0x55daa3e72800 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f751eee8700 1 --2- 172.21.15.155:0/3872217059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55daa4c43770 tx=0x55daa3f63b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14985cd46b8be9b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f751d6e5700 1 -- 172.21.15.155:0/3872217059 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa3f2b1e0 con 0x55daa3e72800 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f751d6e5700 1 -- 172.21.15.155:0/3872217059 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55daa419db00 con 0x55daa3e72800 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f751d6e5700 1 -- 172.21.15.155:0/3872217059 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa3f2b4a0 con 0x55daa3e72800 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f7520f3ea80 1 -- 172.21.15.155:0/3872217059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 msgr2=0x55daa415a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/3872217059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55daa4c43770 tx=0x55daa3f63b60 comp rx=0 tx=0).stop 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f7520f3ea80 1 -- 172.21.15.155:0/3872217059 shutdown_connections 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/3872217059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f7520f3ea80 1 -- 172.21.15.155:0/3872217059 >> 172.21.15.155:0/3872217059 conn(0x55daa3e72400 msgr2=0x55daa3f5f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f7520f3ea80 1 -- 172.21.15.155:0/3872217059 shutdown_connections 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f7520f3ea80 1 -- 172.21.15.155:0/3872217059 wait complete. 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f7520f3ea80 1 Processor -- start 2024-04-19T23:45:41.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.867+0000 7f7520f3ea80 1 -- start start 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f7520f3ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f7520f3ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daa3f143c0 con 0x55daa3e72800 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f751eee8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f751eee8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36524/0 (socket says 172.21.15.155:36524) 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f751eee8700 1 -- 172.21.15.155:0/302192084 learned_addr learned my addr 172.21.15.155:0/302192084 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f751eee8700 1 -- 172.21.15.155:0/302192084 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daa3e9ba00 con 0x55daa3e72800 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f751eee8700 1 --2- 172.21.15.155:0/302192084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x55daa4c43e30 tx=0x55daa3f63920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f751bee2700 1 -- 172.21.15.155:0/302192084 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa3f2b600 con 0x55daa3e72800 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f751bee2700 1 -- 172.21.15.155:0/302192084 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55daa3f13c80 con 0x55daa3e72800 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f751bee2700 1 -- 172.21.15.155:0/302192084 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa3f2b1e0 con 0x55daa3e72800 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f7520f3ea80 1 -- 172.21.15.155:0/302192084 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55daa3e9b860 con 0x55daa3e72800 2024-04-19T23:45:41.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.868+0000 7f7520f3ea80 1 -- 172.21.15.155:0/302192084 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55daa3e9b6c0 con 0x55daa3e72800 2024-04-19T23:45:41.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.869+0000 7f7520f3ea80 1 Processor -- start 2024-04-19T23:45:41.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.869+0000 7f7520f3ea80 1 -- start start 2024-04-19T23:45:41.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.869+0000 7f751bee2700 1 -- 172.21.15.155:0/302192084 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55daa4c14b00 con 0x55daa3e72800 2024-04-19T23:45:41.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.869+0000 7f7520f3ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 0x55daa415ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.869+0000 7f7520f3ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daa3eae640 con 0x55daa3e73400 2024-04-19T23:45:41.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.869+0000 7f751bee2700 1 --2- 172.21.15.155:0/302192084 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa41f8000 0x55daa415b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.869+0000 7f751bee2700 1 -- 172.21.15.155:0/302192084 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55daa3eed180 con 0x55daa3e72800 2024-04-19T23:45:41.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.869+0000 7f751f6e9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 0x55daa415ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.869+0000 7f751f6e9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 0x55daa415ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36526/0 (socket says 172.21.15.155:36526) 2024-04-19T23:45:41.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.869+0000 7f751f6e9700 1 -- 172.21.15.155:0/2662886654 learned_addr learned my addr 172.21.15.155:0/2662886654 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f751eee8700 1 --2- 172.21.15.155:0/302192084 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa41f8000 0x55daa415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f751f6e9700 1 -- 172.21.15.155:0/2662886654 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daa3e9a000 con 0x55daa3e73400 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f751f6e9700 1 --2- 172.21.15.155:0/2662886654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 0x55daa415ab00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55daa4c43e90 tx=0x55daa41c2060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a6857f0677c5d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f751eee8700 1 --2- 172.21.15.155:0/302192084 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa41f8000 0x55daa415b080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55daa4d04f00 tx=0x55daa41c2240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f75196dd700 1 -- 172.21.15.155:0/2662886654 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa3f2b600 con 0x55daa3e73400 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f75196dd700 1 -- 172.21.15.155:0/2662886654 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55daa419c480 con 0x55daa3e73400 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f75196dd700 1 -- 172.21.15.155:0/2662886654 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa3f2b1e0 con 0x55daa3e73400 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2662886654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 msgr2=0x55daa415ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2662886654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 0x55daa415ab00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55daa4c43e90 tx=0x55daa41c2060 comp rx=0 tx=0).stop 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2662886654 shutdown_connections 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2662886654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 0x55daa415ab00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.870+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2662886654 >> 172.21.15.155:0/2662886654 conn(0x55daa3e72c00 msgr2=0x55daa3f5f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.871+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2662886654 shutdown_connections 2024-04-19T23:45:41.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.871+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2662886654 wait complete. 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.871+0000 7f7520f3ea80 1 Processor -- start 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.871+0000 7f7520f3ea80 1 -- start start 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.871+0000 7f7520f3ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 0x55daa415ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.871+0000 7f7520f3ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daa3eae8c0 con 0x55daa3e73400 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.871+0000 7f751f6e9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 0x55daa415ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.871+0000 7f751f6e9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 0x55daa415ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36530/0 (socket says 172.21.15.155:36530) 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.871+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 learned_addr learned my addr 172.21.15.155:0/4006436851 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.871+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daa3e9aea0 con 0x55daa3e73400 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.871+0000 7f751f6e9700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 0x55daa415ab00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55daa4c43f50 tx=0x55daa3f63f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.872+0000 7f7517eda700 1 -- 172.21.15.155:0/4006436851 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa3f2ba20 con 0x55daa3e73400 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.872+0000 7f7517eda700 1 -- 172.21.15.155:0/4006436851 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55daa419c180 con 0x55daa3e73400 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.872+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55daa3e9a820 con 0x55daa3e73400 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.872+0000 7f7517eda700 1 -- 172.21.15.155:0/4006436851 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa3f2b600 con 0x55daa3e73400 2024-04-19T23:45:41.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.872+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55daa3e9a9c0 con 0x55daa3e73400 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.872+0000 7f7517eda700 1 -- 172.21.15.155:0/4006436851 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55daa4c14dc0 con 0x55daa3e73400 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.872+0000 7f7517eda700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa41f8c00 0x55daa415b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.872+0000 7f7517eda700 1 -- 172.21.15.155:0/4006436851 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55daa3eed340 con 0x55daa3e73400 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.872+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f751e6e7700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa41f8c00 0x55daa415b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55daa3e73800 0x55daa415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa3e73c00 con 0x55daa3e73800 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f751f6e9700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55daa3e73800 0x55daa415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f751e6e7700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa41f8c00 0x55daa415b600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55daa4155890 tx=0x55daa3f63800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f751f6e9700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55daa3e73800 0x55daa415bb80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f7520f3ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f7520f3ea80 20 realm 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9000 con 0x55daa3e73800 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f7520f3ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f7520f3ea80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.873+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9400 con 0x55daa3e73800 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f7520f3ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9800 con 0x55daa3e73800 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f7520f3ea80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9c00 con 0x55daa3e73800 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f7520f3ea80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f7520f3ea80 20 searching for the correct realm 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55daa41f9000 0x55daa415c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9400 con 0x55daa41f9000 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.874+0000 7f751eee8700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55daa41f9000 0x55daa415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.875+0000 7f751eee8700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55daa41f9000 0x55daa415c100 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.875+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.875+0000 7f751eee8700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55daa41f9400 0x55daa415cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.875+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba000 con 0x55daa41f9400 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.875+0000 7f751e6e7700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55daa41f9400 0x55daa415cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.876+0000 7f751e6e7700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55daa41f9400 0x55daa415cc00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.876+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.876+0000 7f751e6e7700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55daa42ba000 0x55daa415d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.876+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa42ba000 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.876+0000 7f751f6e9700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55daa42ba000 0x55daa415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.876+0000 7f751f6e9700 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55daa42ba000 0x55daa415d180 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.877+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.877+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa3e73800 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.877+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.877+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa3e73800 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.877+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.877+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa42ba000 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.877+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.877+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa42ba000 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.877+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.877+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9400 2024-04-19T23:45:41.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.878+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.878+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9000 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.878+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.878+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa3e73800 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.878+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.878+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa42ba000 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.878+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.878+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa3e73800 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.879+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.879+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9400 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.879+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.879+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9000 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.879+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.879+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9000 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.879+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.879+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa42ba000 2024-04-19T23:45:41.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.879+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.879+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9000 2024-04-19T23:45:41.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.880+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.880+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9000 2024-04-19T23:45:41.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.880+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.880+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa3e73800 2024-04-19T23:45:41.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.880+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.880+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa3e73800 2024-04-19T23:45:41.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.880+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.880+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa42ba000 2024-04-19T23:45:41.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.881+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.881+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9000 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.881+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.881+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9400 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.881+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.881+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa3e73800 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.881+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.881+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa42ba000 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.882+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.882+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9000 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.882+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.882+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa42ba000 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.883+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.883+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9400 2024-04-19T23:45:41.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.883+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.883+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9000 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.883+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.883+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa42ba000 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.883+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.883+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa3e73800 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.883+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.883+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9400 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa3e73c00 con 0x55daa3e73800 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bac00 con 0x55daa3e73800 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.884+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bb000 con 0x55daa41f9400 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 20 zone default found 2024-04-19T23:45:41.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 4 Realm: () 2024-04-19T23:45:41.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:41.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:41.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:41.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 20 zonegroup default 2024-04-19T23:45:41.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bb400 con 0x55daa42ba000 2024-04-19T23:45:41.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bb800 con 0x55daa41f9000 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bbc00 con 0x55daa41f9000 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 20 started sync module instance, tier type = 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.885+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bac00 con 0x55daa41f9400 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.886+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.886+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94397544078080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa3e73c00 con 0x55daa41f9400 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.886+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9800 con 0x55daa3e73800 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.887+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94397544078080] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.888+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.888+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94397544079232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9c00 con 0x55daa3e73800 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.888+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa41f9000 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.889+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94397544079232] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.889+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.889+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94397544080384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bb000 con 0x55daa41f9000 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.889+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bac00 con 0x55daa41f9400 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.890+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94397544080384] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.890+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.890+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94397544081536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba400 con 0x55daa41f9400 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.890+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bb800 con 0x55daa3e73800 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.891+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.891+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94397544082688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bbc00 con 0x55daa3e73800 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.891+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42ba800 con 0x55daa42ba000 2024-04-19T23:45:41.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.891+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94397544081536] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.892+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.892+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94397544083840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bb400 con 0x55daa42ba000 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.892+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bb800 con 0x55daa42ba000 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.892+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94397544082688] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.893+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94397544083840] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.893+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.893+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94397544084992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bbc00 con 0x55daa42ba000 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.893+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9800 con 0x55daa42ba000 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.894+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94397544084992] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.894+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.894+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94397544086144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9c00 con 0x55daa42ba000 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.894+0000 7f7520f3ea80 20 add_watcher() i=0 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.894+0000 7f7520f3ea80 20 add_watcher() i=1 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.894+0000 7f7520f3ea80 20 add_watcher() i=2 2024-04-19T23:45:41.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.894+0000 7f7520f3ea80 20 add_watcher() i=3 2024-04-19T23:45:41.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.894+0000 7f7520f3ea80 20 add_watcher() i=4 2024-04-19T23:45:41.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.894+0000 7f7520f3ea80 20 add_watcher() i=5 2024-04-19T23:45:41.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.894+0000 7f7520f3ea80 20 add_watcher() i=6 2024-04-19T23:45:41.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.895+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94397544086144] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.895+0000 7f7520f3ea80 20 add_watcher() i=7 2024-04-19T23:45:41.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.895+0000 7f7520f3ea80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:41.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.895+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9800 con 0x55daa3e73800 2024-04-19T23:45:41.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.895+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.895+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94397545619456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9c00 con 0x55daa3e73800 2024-04-19T23:45:41.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.896+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94397545619456] v30'140 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.896+0000 7f7505eb6700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.896+0000 7f7520f3ea80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:41.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.896+0000 7f7520f3ea80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:41.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.897+0000 7f7520f3ea80 1 Processor -- start 2024-04-19T23:45:41.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.897+0000 7f7520f3ea80 1 -- start start 2024-04-19T23:45:41.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.897+0000 7f7520f3ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.897+0000 7f7520f3ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daa3f143c0 con 0x55daa42bb400 2024-04-19T23:45:41.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.897+0000 7f751e6e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.897+0000 7f751e6e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36538/0 (socket says 172.21.15.155:36538) 2024-04-19T23:45:41.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.897+0000 7f751e6e7700 1 -- 172.21.15.155:0/3503593898 learned_addr learned my addr 172.21.15.155:0/3503593898 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.897+0000 7f751e6e7700 1 -- 172.21.15.155:0/3503593898 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daa3e9ab60 con 0x55daa42bb400 2024-04-19T23:45:41.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.897+0000 7f751e6e7700 1 --2- 172.21.15.155:0/3503593898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55daa420d440 tx=0x55daa41c36e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c2b653cf997b6e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.898+0000 7f75056b5700 1 -- 172.21.15.155:0/3503593898 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa3f2b760 con 0x55daa42bb400 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.898+0000 7f75056b5700 1 -- 172.21.15.155:0/3503593898 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55daa42dc000 con 0x55daa42bb400 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.898+0000 7f75056b5700 1 -- 172.21.15.155:0/3503593898 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa42de000 con 0x55daa42bb400 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.898+0000 7f7520f3ea80 1 -- 172.21.15.155:0/3503593898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 msgr2=0x55daa415c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.898+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/3503593898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55daa420d440 tx=0x55daa41c36e0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.898+0000 7f7520f3ea80 1 -- 172.21.15.155:0/3503593898 shutdown_connections 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.898+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/3503593898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.898+0000 7f7520f3ea80 1 -- 172.21.15.155:0/3503593898 >> 172.21.15.155:0/3503593898 conn(0x55daa42ba800 msgr2=0x55daa3f60000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.898+0000 7f7520f3ea80 1 -- 172.21.15.155:0/3503593898 shutdown_connections 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.898+0000 7f7520f3ea80 1 -- 172.21.15.155:0/3503593898 wait complete. 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f7520f3ea80 1 Processor -- start 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f7520f3ea80 1 -- start start 2024-04-19T23:45:41.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f7520f3ea80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f7520f3ea80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daa3f14500 con 0x55daa42bb400 2024-04-19T23:45:41.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f751e6e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f751e6e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36540/0 (socket says 172.21.15.155:36540) 2024-04-19T23:45:41.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f751e6e7700 1 -- 172.21.15.155:0/2349346701 learned_addr learned my addr 172.21.15.155:0/2349346701 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:41.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f751e6e7700 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daa3e9ad00 con 0x55daa42bb400 2024-04-19T23:45:41.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f751e6e7700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x55daa42cf200 tx=0x55daa41c3800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f7503eb2700 1 -- 172.21.15.155:0/2349346701 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa42de160 con 0x55daa42bb400 2024-04-19T23:45:41.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f7503eb2700 1 -- 172.21.15.155:0/2349346701 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55daa42dc180 con 0x55daa42bb400 2024-04-19T23:45:41.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55daa3e9a340 con 0x55daa42bb400 2024-04-19T23:45:41.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.899+0000 7f7503eb2700 1 -- 172.21.15.155:0/2349346701 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55daa42de2c0 con 0x55daa42bb400 2024-04-19T23:45:41.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.900+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55daa3e9bd40 con 0x55daa42bb400 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.900+0000 7f7503eb2700 1 -- 172.21.15.155:0/2349346701 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55daa4c15b80 con 0x55daa42bb400 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.900+0000 7f7503eb2700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa4358000 0x55daa415d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.900+0000 7f7503eb2700 1 -- 172.21.15.155:0/2349346701 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55daa3eed500 con 0x55daa42bb400 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.900+0000 7f751f6e9700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa4358000 0x55daa415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.900+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55daa42bb800 0x55daa4374000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.900+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bbc00 con 0x55daa42bb800 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.901+0000 7f751eee8700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55daa42bb800 0x55daa4374000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.901+0000 7f751f6e9700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa4358000 0x55daa415d700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55daa425df50 tx=0x55daa41c35c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.901+0000 7f751eee8700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55daa42bb800 0x55daa4374000 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.902+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa42bb800 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.902+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55daa4358400 0x55daa4374580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.902+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4358800 con 0x55daa4358400 2024-04-19T23:45:41.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.902+0000 7f751e6e7700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55daa4358400 0x55daa4374580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.902+0000 7f751e6e7700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55daa4358400 0x55daa4374580 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.903+0000 7f751e6e7700 1 -- 172.21.15.155:0/2349346701 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa4358400 2024-04-19T23:45:41.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.903+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55daa4358c00 0x55daa4374b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.903+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4359000 con 0x55daa4358c00 2024-04-19T23:45:41.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.903+0000 7f751f6e9700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55daa4358c00 0x55daa4374b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.904+0000 7f751f6e9700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55daa4358c00 0x55daa4374b00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.904+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.904+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4359400 con 0x55daa42bb800 2024-04-19T23:45:41.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.905+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'141 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa42bb800 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.905+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55daa4359800 0x55daa4375080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.905+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4359c00 con 0x55daa4359800 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.906+0000 7f751eee8700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55daa4359800 0x55daa4375080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.906+0000 7f751eee8700 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55daa4359800 0x55daa4375080 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.907+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'41 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa4359800 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.907+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384000 con 0x55daa4358c00 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.908+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'27 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.908+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384400 con 0x55daa42bb800 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.909+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa42bb800 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.909+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384800 con 0x55daa4358400 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.910+0000 7f751e6e7700 1 -- 172.21.15.155:0/2349346701 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'27 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa4358400 2024-04-19T23:45:41.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.910+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384c00 con 0x55daa4359800 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.910+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa4359800 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.911+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4385000 con 0x55daa4358c00 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.911+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.911+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4385400 con 0x55daa4359800 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.912+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa4359800 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.912+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4385800 con 0x55daa4358400 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.914+0000 7f751e6e7700 1 -- 172.21.15.155:0/2349346701 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa4358400 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.914+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4385c00 con 0x55daa4359800 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.914+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa4359800 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.914+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384800 con 0x55daa4358400 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.916+0000 7f751e6e7700 1 -- 172.21.15.155:0/2349346701 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'36 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa4358400 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.916+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384400 con 0x55daa42bb800 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.917+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'142 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa42bb800 2024-04-19T23:45:41.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.917+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4358800 con 0x55daa4358c00 2024-04-19T23:45:41.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.917+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.918+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4359400 con 0x55daa4359800 2024-04-19T23:45:41.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.918+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa4359800 2024-04-19T23:45:41.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.918+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4359c00 con 0x55daa4358c00 2024-04-19T23:45:41.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.919+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.919+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bac00 con 0x55daa42bb800 2024-04-19T23:45:41.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.921+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa42bb800 2024-04-19T23:45:41.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.921+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bb000 con 0x55daa42bb800 2024-04-19T23:45:41.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.922+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'143 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa42bb800 2024-04-19T23:45:41.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.922+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bbc00 con 0x55daa4358c00 2024-04-19T23:45:41.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.923+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.923+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa3e73c00 con 0x55daa4359800 2024-04-19T23:45:41.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.924+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa4359800 2024-04-19T23:45:41.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.924+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4359400 con 0x55daa4358c00 2024-04-19T23:45:41.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.924+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.925+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4359000 con 0x55daa4358c00 2024-04-19T23:45:41.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.925+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.925+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4358800 con 0x55daa4358c00 2024-04-19T23:45:41.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.926+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.926+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4359c00 con 0x55daa4358c00 2024-04-19T23:45:41.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.927+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.927+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384c00 con 0x55daa4358400 2024-04-19T23:45:41.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.928+0000 7f751e6e7700 1 -- 172.21.15.155:0/2349346701 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa4358400 2024-04-19T23:45:41.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.928+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4385400 con 0x55daa4358c00 2024-04-19T23:45:41.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.929+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.929+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4385c00 con 0x55daa4358400 2024-04-19T23:45:41.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.930+0000 7f751e6e7700 1 -- 172.21.15.155:0/2349346701 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa4358400 2024-04-19T23:45:41.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.930+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384400 con 0x55daa4358c00 2024-04-19T23:45:41.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.931+0000 7f751f6e9700 1 -- 172.21.15.155:0/2349346701 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'40 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa4358c00 2024-04-19T23:45:41.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.931+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384000 con 0x55daa4358400 2024-04-19T23:45:41.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.932+0000 7f751e6e7700 1 -- 172.21.15.155:0/2349346701 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'37 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa4358400 2024-04-19T23:45:41.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.932+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4385000 con 0x55daa4359800 2024-04-19T23:45:41.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.933+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa4359800 2024-04-19T23:45:41.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.934+0000 7f75016ad700 20 reqs_thread_entry: start 2024-04-19T23:45:41.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.934+0000 7f7520f3ea80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.934+0000 7f7520f3ea80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.934+0000 7f74ff6a9700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:12 2024 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.934+0000 7f74fee87700 20 reqs_thread_entry: start 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.934+0000 7f7520f3ea80 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.934+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.934+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa41f9c00 con 0x55daa41f9400 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 : miss 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 20 rados->read ofs=0 len=0 2024-04-19T23:45:41.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bac00 con 0x55daa3e73800 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(63 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 20 get_obj_state: rctx=0x55daa42729a0 obj=myfoo:four state=0x55daa44121e8 s->prefetch_data=0 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 3.12 3:4a873167:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4385400 con 0x55daa41f9400 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(64 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+867 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 10 manifest: total_size = 4 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 20 get_obj_state: setting s->obj_tag to 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4221.13342560605068352107 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 20 get_obj_state: rctx=0x55daa42729a0 obj=myfoo:four state=0x55daa44121e8 s->prefetch_data=0 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 20 prepare_atomic_modification: state is not atomic. state=0x55daa44121e8 2024-04-19T23:45:41.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 20 bucket index object: default.rgw.buckets.index:.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.935+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:65 4.30 4:0e2208dd:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384400 con 0x55daa41f9000 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.937+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(65 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6 [stat,call,call] v30'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.937+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 3.12 3:4a873167:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4385800 con 0x55daa41f9400 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.937+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(66 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1_four [call] v30'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.938+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 4.30 4:0e2208dd:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384c00 con 0x55daa41f9000 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.938+0000 7f7505eb6700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.938+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94397545619456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4385c00 con 0x55daa3e73800 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.939+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(67 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6 [stat,call,call] v30'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.939+0000 7f75196dd700 20 handle_completion(): completion ok for obj=four 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.939+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(68 data_loggenerations_metadata [watch unwatch cookie 94397545619456] v30'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.939+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94397544078080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4384000 con 0x55daa41f9400 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.940+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(69 notify.0 [watch unwatch cookie 94397544078080] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.940+0000 7f7520f3ea80 20 remove_watcher() i=0 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.940+0000 7f7520f3ea80 2 removed watcher, disabling cache 2024-04-19T23:45:41.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.940+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94397544079232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bbc00 con 0x55daa3e73800 2024-04-19T23:45:41.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.942+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(70 notify.1 [watch unwatch cookie 94397544079232] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.942+0000 7f7520f3ea80 20 remove_watcher() i=1 2024-04-19T23:45:41.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.942+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:71 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94397544080384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42bac00 con 0x55daa41f9000 2024-04-19T23:45:41.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.943+0000 7f751eee8700 1 -- 172.21.15.155:0/4006436851 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(71 notify.2 [watch unwatch cookie 94397544080384] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42ad200 con 0x55daa41f9000 2024-04-19T23:45:41.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.943+0000 7f7520f3ea80 20 remove_watcher() i=2 2024-04-19T23:45:41.946 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.943+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94397544081536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4359400 con 0x55daa41f9400 2024-04-19T23:45:41.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.944+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(72 notify.3 [watch unwatch cookie 94397544081536] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42ad440 con 0x55daa41f9400 2024-04-19T23:45:41.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.944+0000 7f7520f3ea80 20 remove_watcher() i=3 2024-04-19T23:45:41.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.944+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94397544082688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4359000 con 0x55daa3e73800 2024-04-19T23:45:41.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.945+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(73 notify.4 [watch unwatch cookie 94397544082688] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa3e73800 2024-04-19T23:45:41.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.945+0000 7f7520f3ea80 20 remove_watcher() i=4 2024-04-19T23:45:41.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.945+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94397544083840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4358800 con 0x55daa42ba000 2024-04-19T23:45:41.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.946+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(74 notify.5 [watch unwatch cookie 94397544083840] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.946+0000 7f7520f3ea80 20 remove_watcher() i=5 2024-04-19T23:45:41.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.946+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94397544084992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa4359c00 con 0x55daa42ba000 2024-04-19T23:45:41.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.947+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(75 notify.6 [watch unwatch cookie 94397544084992] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.947+0000 7f7520f3ea80 20 remove_watcher() i=6 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.947+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94397544086144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55daa42aa000 con 0x55daa42ba000 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f751f6e9700 1 -- 172.21.15.155:0/4006436851 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(76 notify.7 [watch unwatch cookie 94397544086144] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55daa42acb40 con 0x55daa42ba000 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 20 remove_watcher() i=7 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55daa42ba000 msgr2=0x55daa415d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55daa42ba000 0x55daa415d180 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55daa3e73800 msgr2=0x55daa415bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55daa3e73800 0x55daa415bb80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55daa41f9400 msgr2=0x55daa415cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55daa41f9400 0x55daa415cc00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55daa41f9000 msgr2=0x55daa415c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55daa41f9000 0x55daa415c100 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa41f8c00 msgr2=0x55daa415b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa41f8c00 0x55daa415b600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55daa4155890 tx=0x55daa3f63800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 msgr2=0x55daa415ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/4006436851 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e73400 0x55daa415ab00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55daa4c43f50 tx=0x55daa3f63f20 comp rx=0 tx=0).stop 2024-04-19T23:45:41.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 reap_dead start 2024-04-19T23:45:41.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f751e6e7700 1 -- 172.21.15.155:0/4006436851 reap_dead start 2024-04-19T23:45:41.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 shutdown_connections 2024-04-19T23:45:41.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 >> 172.21.15.155:0/4006436851 conn(0x55daa3e72c00 msgr2=0x55daa3f5f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 shutdown_connections 2024-04-19T23:45:41.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/4006436851 wait complete. 2024-04-19T23:45:41.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55daa4358400 msgr2=0x55daa4374580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55daa4358400 0x55daa4374580 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55daa42bb800 msgr2=0x55daa4374000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.948+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55daa42bb800 0x55daa4374000 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55daa4359800 msgr2=0x55daa4375080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55daa4359800 0x55daa4375080 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55daa4358c00 msgr2=0x55daa4374b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55daa4358c00 0x55daa4374b00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa4358000 msgr2=0x55daa415d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa4358000 0x55daa415d700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55daa425df50 tx=0x55daa41c35c0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 msgr2=0x55daa415c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f751eee8700 1 -- 172.21.15.155:0/2349346701 reap_dead start 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x55daa42cf200 tx=0x55daa41c3800 comp rx=0 tx=0).stop 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 shutdown_connections 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/2349346701 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa42bb400 0x55daa415c680 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 >> 172.21.15.155:0/2349346701 conn(0x55daa42ba800 msgr2=0x55daa3f60000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 shutdown_connections 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/2349346701 wait complete. 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/302192084 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa41f8000 msgr2=0x55daa415b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/302192084 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa41f8000 0x55daa415b080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55daa4d04f00 tx=0x55daa41c2240 comp rx=0 tx=0).stop 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/302192084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 msgr2=0x55daa415a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/302192084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x55daa4c43e30 tx=0x55daa3f63920 comp rx=0 tx=0).stop 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/302192084 shutdown_connections 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/302192084 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55daa41f8000 0x55daa415b080 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 --2- 172.21.15.155:0/302192084 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55daa3e72800 0x55daa415a580 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/302192084 >> 172.21.15.155:0/302192084 conn(0x55daa3e72400 msgr2=0x55daa3f5f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/302192084 shutdown_connections 2024-04-19T23:45:41.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:41.949+0000 7f7520f3ea80 1 -- 172.21.15.155:0/302192084 wait complete. 2024-04-19T23:45:41.956 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-19T23:45:41.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-19T23:45:41.956 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-19T23:45:42.001 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:42.002 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:42.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.002+0000 7fc430010a80 1 Processor -- start 2024-04-19T23:45:42.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.002+0000 7fc430010a80 1 -- start start 2024-04-19T23:45:42.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc430010a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55bc088aec00 0x55bc08b96580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc430010a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bc08bd9500 con 0x55bc088ae800 2024-04-19T23:45:42.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc430010a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bc08950a00 con 0x55bc088aec00 2024-04-19T23:45:42.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc42dfba700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55bc088ae800 0x55bc0899a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46832/0 (socket says 172.21.15.155:46832) 2024-04-19T23:45:42.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc42dfba700 1 -- 172.21.15.155:0/1395162748 learned_addr learned my addr 172.21.15.155:0/1395162748 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:42.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc42d7b9700 1 --2- 172.21.15.155:0/1395162748 >> v2:172.21.15.76:3300/0 conn(0x55bc088aec00 0x55bc08b96580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc42cfb8700 1 -- 172.21.15.155:0/1395162748 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088832954 0 0) 0x55bc0967c000 con 0x55bc088ae800 2024-04-19T23:45:42.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc42cfb8700 1 -- 172.21.15.155:0/1395162748 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55bc08bd9680 con 0x55bc088ae800 2024-04-19T23:45:42.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc42d7b9700 1 -- 172.21.15.155:0/1395162748 >> v1:172.21.15.76:6789/0 conn(0x55bc088ae800 legacy=0x55bc0899a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc42d7b9700 1 -- 172.21.15.155:0/1395162748 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc088d7d40 con 0x55bc088aec00 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc42d7b9700 1 --2- 172.21.15.155:0/1395162748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088aec00 0x55bc08b96580 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55bc08b91890 tx=0x55bc0899f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c89a669300c5c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc42cfb8700 1 -- 172.21.15.155:0/1395162748 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc089674a0 con 0x55bc088aec00 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.003+0000 7fc42cfb8700 1 -- 172.21.15.155:0/1395162748 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc08bd9500 con 0x55bc088aec00 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.004+0000 7fc42cfb8700 1 -- 172.21.15.155:0/1395162748 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc08967600 con 0x55bc088aec00 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.004+0000 7fc430010a80 1 -- 172.21.15.155:0/1395162748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088aec00 msgr2=0x55bc08b96580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.004+0000 7fc430010a80 1 --2- 172.21.15.155:0/1395162748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088aec00 0x55bc08b96580 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55bc08b91890 tx=0x55bc0899f980 comp rx=0 tx=0).stop 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.004+0000 7fc430010a80 1 -- 172.21.15.155:0/1395162748 shutdown_connections 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.004+0000 7fc430010a80 1 --2- 172.21.15.155:0/1395162748 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088aec00 0x55bc08b96580 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.004+0000 7fc430010a80 1 -- 172.21.15.155:0/1395162748 >> 172.21.15.155:0/1395162748 conn(0x55bc088ae400 msgr2=0x55bc0899a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.004+0000 7fc430010a80 1 -- 172.21.15.155:0/1395162748 shutdown_connections 2024-04-19T23:45:42.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.004+0000 7fc430010a80 1 -- 172.21.15.155:0/1395162748 wait complete. 2024-04-19T23:45:42.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.005+0000 7fc430010a80 1 Processor -- start 2024-04-19T23:45:42.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.005+0000 7fc430010a80 1 -- start start 2024-04-19T23:45:42.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.005+0000 7fc430010a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.005+0000 7fc430010a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc08950500 con 0x55bc088ae800 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.005+0000 7fc42dfba700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.005+0000 7fc42dfba700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36556/0 (socket says 172.21.15.155:36556) 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.005+0000 7fc42dfba700 1 -- 172.21.15.155:0/297584199 learned_addr learned my addr 172.21.15.155:0/297584199 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.005+0000 7fc42dfba700 1 -- 172.21.15.155:0/297584199 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc088d7ba0 con 0x55bc088ae800 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.005+0000 7fc42dfba700 1 --2- 172.21.15.155:0/297584199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x55bc0967f770 tx=0x55bc0899fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133f9ffa9f41c34e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.006+0000 7fc42c7b7700 1 -- 172.21.15.155:0/297584199 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc089674a0 con 0x55bc088ae800 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.006+0000 7fc42c7b7700 1 -- 172.21.15.155:0/297584199 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc08bd9b00 con 0x55bc088ae800 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.006+0000 7fc42c7b7700 1 -- 172.21.15.155:0/297584199 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc08967600 con 0x55bc088ae800 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.006+0000 7fc430010a80 1 -- 172.21.15.155:0/297584199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 msgr2=0x55bc08b96580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.006+0000 7fc430010a80 1 --2- 172.21.15.155:0/297584199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x55bc0967f770 tx=0x55bc0899fb60 comp rx=0 tx=0).stop 2024-04-19T23:45:42.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.006+0000 7fc430010a80 1 -- 172.21.15.155:0/297584199 shutdown_connections 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.006+0000 7fc430010a80 1 --2- 172.21.15.155:0/297584199 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.006+0000 7fc430010a80 1 -- 172.21.15.155:0/297584199 >> 172.21.15.155:0/297584199 conn(0x55bc088ae400 msgr2=0x55bc0899b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.006+0000 7fc430010a80 1 -- 172.21.15.155:0/297584199 shutdown_connections 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.006+0000 7fc430010a80 1 -- 172.21.15.155:0/297584199 wait complete. 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.006+0000 7fc430010a80 1 Processor -- start 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.007+0000 7fc430010a80 1 -- start start 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.007+0000 7fc430010a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.007+0000 7fc430010a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc089503c0 con 0x55bc088ae800 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.007+0000 7fc42dfba700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.007+0000 7fc42dfba700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36564/0 (socket says 172.21.15.155:36564) 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.007+0000 7fc42dfba700 1 -- 172.21.15.155:0/3011072271 learned_addr learned my addr 172.21.15.155:0/3011072271 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.007+0000 7fc42dfba700 1 -- 172.21.15.155:0/3011072271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc088d7a00 con 0x55bc088ae800 2024-04-19T23:45:42.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.007+0000 7fc42dfba700 1 --2- 172.21.15.155:0/3011072271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x55bc0967fe30 tx=0x55bc0899f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.007+0000 7fc42afb4700 1 -- 172.21.15.155:0/3011072271 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc089678c0 con 0x55bc088ae800 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.007+0000 7fc42afb4700 1 -- 172.21.15.155:0/3011072271 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc0894fc80 con 0x55bc088ae800 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc430010a80 1 -- 172.21.15.155:0/3011072271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc088d7860 con 0x55bc088ae800 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc42afb4700 1 -- 172.21.15.155:0/3011072271 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc089674a0 con 0x55bc088ae800 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc430010a80 1 -- 172.21.15.155:0/3011072271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc088d76c0 con 0x55bc088ae800 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc430010a80 1 Processor -- start 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc430010a80 1 -- start start 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc42afb4700 1 -- 172.21.15.155:0/3011072271 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55bc09650b00 con 0x55bc088ae800 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc430010a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 0x55bc08b96b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc430010a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc08950000 con 0x55bc088af400 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc42afb4700 1 --2- 172.21.15.155:0/3011072271 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08c30000 0x55bc08b97080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc42afb4700 1 -- 172.21.15.155:0/3011072271 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55bc08929180 con 0x55bc088ae800 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc42e7bb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 0x55bc08b96b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc42e7bb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 0x55bc08b96b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36580/0 (socket says 172.21.15.155:36580) 2024-04-19T23:45:42.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.008+0000 7fc42e7bb700 1 -- 172.21.15.155:0/4134834136 learned_addr learned my addr 172.21.15.155:0/4134834136 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc42dfba700 1 --2- 172.21.15.155:0/3011072271 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08c30000 0x55bc08b97080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc42e7bb700 1 -- 172.21.15.155:0/4134834136 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc088d6000 con 0x55bc088af400 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc42dfba700 1 --2- 172.21.15.155:0/3011072271 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08c30000 0x55bc08b97080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55bc0973cf00 tx=0x55bc08bfa240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc42e7bb700 1 --2- 172.21.15.155:0/4134834136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 0x55bc08b96b00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55bc0973ce10 tx=0x55bc08bfa060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716872893ad1421 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc4287af700 1 -- 172.21.15.155:0/4134834136 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc089678c0 con 0x55bc088af400 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc4287af700 1 -- 172.21.15.155:0/4134834136 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc08bd8480 con 0x55bc088af400 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc4287af700 1 -- 172.21.15.155:0/4134834136 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc089674a0 con 0x55bc088af400 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc430010a80 1 -- 172.21.15.155:0/4134834136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 msgr2=0x55bc08b96b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc430010a80 1 --2- 172.21.15.155:0/4134834136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 0x55bc08b96b00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55bc0973ce10 tx=0x55bc08bfa060 comp rx=0 tx=0).stop 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc430010a80 1 -- 172.21.15.155:0/4134834136 shutdown_connections 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc430010a80 1 --2- 172.21.15.155:0/4134834136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 0x55bc08b96b00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc430010a80 1 -- 172.21.15.155:0/4134834136 >> 172.21.15.155:0/4134834136 conn(0x55bc088aec00 msgr2=0x55bc0899b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc430010a80 1 -- 172.21.15.155:0/4134834136 shutdown_connections 2024-04-19T23:45:42.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.009+0000 7fc430010a80 1 -- 172.21.15.155:0/4134834136 wait complete. 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.010+0000 7fc430010a80 1 Processor -- start 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.010+0000 7fc430010a80 1 -- start start 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.010+0000 7fc430010a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 0x55bc08b96b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.010+0000 7fc430010a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc088ea640 con 0x55bc088af400 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.010+0000 7fc42e7bb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 0x55bc08b96b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.010+0000 7fc42e7bb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 0x55bc08b96b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36588/0 (socket says 172.21.15.155:36588) 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.010+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 learned_addr learned my addr 172.21.15.155:0/523219994 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.010+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc088d6ea0 con 0x55bc088af400 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.011+0000 7fc42e7bb700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 0x55bc08b96b00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55bc0973c420 tx=0x55bc08bfa120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.011+0000 7fc426fac700 1 -- 172.21.15.155:0/523219994 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc08967b80 con 0x55bc088af400 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.011+0000 7fc426fac700 1 -- 172.21.15.155:0/523219994 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc08bd8180 con 0x55bc088af400 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.011+0000 7fc426fac700 1 -- 172.21.15.155:0/523219994 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc089678c0 con 0x55bc088af400 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.011+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc088d6820 con 0x55bc088af400 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.011+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc088d69c0 con 0x55bc088af400 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.012+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.012+0000 7fc426fac700 1 -- 172.21.15.155:0/523219994 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55bc09650dc0 con 0x55bc088af400 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.012+0000 7fc426fac700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08c30c00 0x55bc08b97600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.012+0000 7fc426fac700 1 -- 172.21.15.155:0/523219994 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55bc08929340 con 0x55bc088af400 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.012+0000 7fc42d7b9700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08c30c00 0x55bc08b97600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.012+0000 7fc430010a80 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bc088af800 0x55bc08b97b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.012+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc088afc00 con 0x55bc088af800 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.012+0000 7fc42e7bb700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bc088af800 0x55bc08b97b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.012+0000 7fc42d7b9700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08c30c00 0x55bc08b97600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55bc08b91890 tx=0x55bc0899f800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.012+0000 7fc42e7bb700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bc088af800 0x55bc08b97b80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 20 realm 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08c31000 con 0x55bc088af800 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08c31400 con 0x55bc088af800 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08c31800 con 0x55bc088af800 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:42.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.013+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08c31c00 con 0x55bc088af800 2024-04-19T23:45:42.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.014+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.014+0000 7fc430010a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:42.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.014+0000 7fc430010a80 20 searching for the correct realm 2024-04-19T23:45:42.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.014+0000 7fc430010a80 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bc08c31000 0x55bc08b98100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.014+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08c31400 con 0x55bc08c31000 2024-04-19T23:45:42.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.014+0000 7fc42dfba700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bc08c31000 0x55bc08b98100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.014+0000 7fc42dfba700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bc08c31000 0x55bc08b98100 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.014+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.014+0000 7fc42dfba700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bc08c31400 0x55bc08b98c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.015+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8000 con 0x55bc08c31400 2024-04-19T23:45:42.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.015+0000 7fc42d7b9700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bc08c31400 0x55bc08b98c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.015+0000 7fc42d7b9700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bc08c31400 0x55bc08b98c00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.015+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.015+0000 7fc42d7b9700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bc08cf8000 0x55bc08b99180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.015+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08cf8000 2024-04-19T23:45:42.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.015+0000 7fc42e7bb700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bc08cf8000 0x55bc08b99180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.016+0000 7fc42e7bb700 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bc08cf8000 0x55bc08b99180 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.016+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.016+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc088af800 2024-04-19T23:45:42.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.016+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.016+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc088af800 2024-04-19T23:45:42.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.016+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.016+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08cf8000 2024-04-19T23:45:42.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.016+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.017+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08cf8000 2024-04-19T23:45:42.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.017+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.017+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31400 2024-04-19T23:45:42.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.017+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.017+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31000 2024-04-19T23:45:42.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.017+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.017+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc088af800 2024-04-19T23:45:42.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.017+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.017+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08cf8000 2024-04-19T23:45:42.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.018+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.018+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc088af800 2024-04-19T23:45:42.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.018+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.018+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31400 2024-04-19T23:45:42.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.018+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.018+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31000 2024-04-19T23:45:42.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.018+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.018+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31000 2024-04-19T23:45:42.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.018+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.019+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08cf8000 2024-04-19T23:45:42.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.019+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.019+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31000 2024-04-19T23:45:42.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.019+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.019+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31000 2024-04-19T23:45:42.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.019+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.019+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc088af800 2024-04-19T23:45:42.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.019+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.019+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc088af800 2024-04-19T23:45:42.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.020+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.020+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08cf8000 2024-04-19T23:45:42.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.020+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.020+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31000 2024-04-19T23:45:42.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.020+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.020+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31400 2024-04-19T23:45:42.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.020+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.020+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc088af800 2024-04-19T23:45:42.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.021+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.021+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08cf8000 2024-04-19T23:45:42.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.021+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.021+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31000 2024-04-19T23:45:42.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.021+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.021+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08cf8000 2024-04-19T23:45:42.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.021+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.022+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31400 2024-04-19T23:45:42.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.022+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.022+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31000 2024-04-19T23:45:42.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.022+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.022+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08cf8000 2024-04-19T23:45:42.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.022+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.022+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc088af800 2024-04-19T23:45:42.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.022+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.022+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31400 2024-04-19T23:45:42.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:42.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:42.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:42.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:42.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc088afc00 con 0x55bc088af800 2024-04-19T23:45:42.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8c00 con 0x55bc088af800 2024-04-19T23:45:42.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:42.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9000 con 0x55bc08c31400 2024-04-19T23:45:42.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:42.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 zone default found 2024-04-19T23:45:42.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 4 Realm: () 2024-04-19T23:45:42.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:42.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:42.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:42.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 zonegroup default 2024-04-19T23:45:42.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.023+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9400 con 0x55bc08cf8000 2024-04-19T23:45:42.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc430010a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9800 con 0x55bc08c31000 2024-04-19T23:45:42.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc430010a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9c00 con 0x55bc08c31000 2024-04-19T23:45:42.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc430010a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc430010a80 20 started sync module instance, tier type = 2024-04-19T23:45:42.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc430010a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:42.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.024+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8c00 con 0x55bc08c31400 2024-04-19T23:45:42.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.025+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.025+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94266088545024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc088afc00 con 0x55bc08c31400 2024-04-19T23:45:42.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.025+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08c31800 con 0x55bc088af800 2024-04-19T23:45:42.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.026+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94266088545024] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.027+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.027+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94266088546176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08c31c00 con 0x55bc088af800 2024-04-19T23:45:42.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.027+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08c31000 2024-04-19T23:45:42.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.028+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94266088546176] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.028+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.028+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94266088547328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9000 con 0x55bc08c31000 2024-04-19T23:45:42.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.028+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8c00 con 0x55bc08c31400 2024-04-19T23:45:42.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.029+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94266088547328] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.029+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.029+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94266088548480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8400 con 0x55bc08c31400 2024-04-19T23:45:42.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.029+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9800 con 0x55bc088af800 2024-04-19T23:45:42.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.030+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.030+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94266088549632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9c00 con 0x55bc088af800 2024-04-19T23:45:42.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.030+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8800 con 0x55bc08cf8000 2024-04-19T23:45:42.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.030+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94266088548480] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.033+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.033+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94266088550784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9400 con 0x55bc08cf8000 2024-04-19T23:45:42.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.033+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9800 con 0x55bc08cf8000 2024-04-19T23:45:42.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.033+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94266088549632] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.034+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.034+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94266088551936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9c00 con 0x55bc08cf8000 2024-04-19T23:45:42.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.034+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08c31800 con 0x55bc08cf8000 2024-04-19T23:45:42.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.034+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94266088550784] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.036+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94266088551936] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.036+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.036+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94266088553088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08c31c00 con 0x55bc08cf8000 2024-04-19T23:45:42.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.036+0000 7fc430010a80 20 add_watcher() i=0 2024-04-19T23:45:42.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.036+0000 7fc430010a80 20 add_watcher() i=1 2024-04-19T23:45:42.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.036+0000 7fc430010a80 20 add_watcher() i=2 2024-04-19T23:45:42.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.036+0000 7fc430010a80 20 add_watcher() i=3 2024-04-19T23:45:42.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.036+0000 7fc430010a80 20 add_watcher() i=4 2024-04-19T23:45:42.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.036+0000 7fc430010a80 20 add_watcher() i=5 2024-04-19T23:45:42.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.036+0000 7fc430010a80 20 add_watcher() i=6 2024-04-19T23:45:42.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.037+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94266088553088] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.037+0000 7fc430010a80 20 add_watcher() i=7 2024-04-19T23:45:42.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.037+0000 7fc430010a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:42.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.037+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08c31800 con 0x55bc088af800 2024-04-19T23:45:42.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.037+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.037+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94266090086400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08c31c00 con 0x55bc088af800 2024-04-19T23:45:42.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.038+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94266090086400] v30'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.038+0000 7fc414f88700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:42.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.039+0000 7fc430010a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:42.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.039+0000 7fc430010a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:42.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.039+0000 7fc430010a80 1 Processor -- start 2024-04-19T23:45:42.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.039+0000 7fc430010a80 1 -- start start 2024-04-19T23:45:42.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.039+0000 7fc430010a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.039+0000 7fc430010a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc088ea780 con 0x55bc08cf9400 2024-04-19T23:45:42.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.039+0000 7fc42d7b9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.039+0000 7fc42d7b9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36592/0 (socket says 172.21.15.155:36592) 2024-04-19T23:45:42.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.039+0000 7fc42d7b9700 1 -- 172.21.15.155:0/1313447001 learned_addr learned my addr 172.21.15.155:0/1313447001 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.040+0000 7fc42d7b9700 1 -- 172.21.15.155:0/1313447001 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc088d6b60 con 0x55bc08cf9400 2024-04-19T23:45:42.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.040+0000 7fc42d7b9700 1 --2- 172.21.15.155:0/1313447001 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x55bc08c45440 tx=0x55bc08bfb6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59270191bb158c40 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.040+0000 7fc414787700 1 -- 172.21.15.155:0/1313447001 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc08967760 con 0x55bc08cf9400 2024-04-19T23:45:42.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.040+0000 7fc414787700 1 -- 172.21.15.155:0/1313447001 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc08d1e000 con 0x55bc08cf9400 2024-04-19T23:45:42.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.040+0000 7fc414787700 1 -- 172.21.15.155:0/1313447001 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc08d20000 con 0x55bc08cf9400 2024-04-19T23:45:42.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.040+0000 7fc430010a80 1 -- 172.21.15.155:0/1313447001 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 msgr2=0x55bc08b98680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.040+0000 7fc430010a80 1 --2- 172.21.15.155:0/1313447001 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x55bc08c45440 tx=0x55bc08bfb6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc430010a80 1 -- 172.21.15.155:0/1313447001 shutdown_connections 2024-04-19T23:45:42.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc430010a80 1 --2- 172.21.15.155:0/1313447001 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc430010a80 1 -- 172.21.15.155:0/1313447001 >> 172.21.15.155:0/1313447001 conn(0x55bc08cf8800 msgr2=0x55bc0899c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc430010a80 1 -- 172.21.15.155:0/1313447001 shutdown_connections 2024-04-19T23:45:42.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc430010a80 1 -- 172.21.15.155:0/1313447001 wait complete. 2024-04-19T23:45:42.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc430010a80 1 Processor -- start 2024-04-19T23:45:42.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc430010a80 1 -- start start 2024-04-19T23:45:42.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc430010a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc430010a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc08950000 con 0x55bc08cf9400 2024-04-19T23:45:42.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc42d7b9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc42d7b9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36596/0 (socket says 172.21.15.155:36596) 2024-04-19T23:45:42.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc42d7b9700 1 -- 172.21.15.155:0/28916391 learned_addr learned my addr 172.21.15.155:0/28916391 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.041+0000 7fc42d7b9700 1 -- 172.21.15.155:0/28916391 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc088d6d00 con 0x55bc08cf9400 2024-04-19T23:45:42.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.042+0000 7fc42d7b9700 1 --2- 172.21.15.155:0/28916391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55bc08d0b200 tx=0x55bc08bfb800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.042+0000 7fc412f84700 1 -- 172.21.15.155:0/28916391 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc08d20160 con 0x55bc08cf9400 2024-04-19T23:45:42.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.042+0000 7fc412f84700 1 -- 172.21.15.155:0/28916391 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc08d1e180 con 0x55bc08cf9400 2024-04-19T23:45:42.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.042+0000 7fc430010a80 1 -- 172.21.15.155:0/28916391 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc088d6340 con 0x55bc08cf9400 2024-04-19T23:45:42.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.042+0000 7fc412f84700 1 -- 172.21.15.155:0/28916391 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc08d202c0 con 0x55bc08cf9400 2024-04-19T23:45:42.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.042+0000 7fc430010a80 1 -- 172.21.15.155:0/28916391 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc088d7d40 con 0x55bc08cf9400 2024-04-19T23:45:42.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.042+0000 7fc412f84700 1 -- 172.21.15.155:0/28916391 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55bc09651b80 con 0x55bc08cf9400 2024-04-19T23:45:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.043+0000 7fc412f84700 1 --2- 172.21.15.155:0/28916391 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08d96000 0x55bc08b99700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.043+0000 7fc412f84700 1 -- 172.21.15.155:0/28916391 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55bc08929500 con 0x55bc08cf9400 2024-04-19T23:45:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.043+0000 7fc42e7bb700 1 --2- 172.21.15.155:0/28916391 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08d96000 0x55bc08b99700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.043+0000 7fc430010a80 5 note: GC not initialized 2024-04-19T23:45:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.043+0000 7fc42e7bb700 1 --2- 172.21.15.155:0/28916391 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08d96000 0x55bc08b99700 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55bc08c89f50 tx=0x55bc08bfa000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.044+0000 7fc41077f700 20 reqs_thread_entry: start 2024-04-19T23:45:42.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.044+0000 7fc430010a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:42.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.044+0000 7fc430010a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:42.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.044+0000 7fc40e77b700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:12 2024 2024-04-19T23:45:42.077 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:42.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.044+0000 7fc40df59700 20 reqs_thread_entry: start 2024-04-19T23:45:42.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.044+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.044+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9c00 con 0x55bc08c31400 2024-04-19T23:45:42.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.044+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.044+0000 7fc430010a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:42.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.044+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.044+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08d96400 con 0x55bc088af800 2024-04-19T23:45:42.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(63 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:42.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-19T23:45:42.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08d96800 con 0x55bc08c31400 2024-04-19T23:45:42.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:42.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08d96c00 con 0x55bc088af800 2024-04-19T23:45:42.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:42.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-19T23:45:42.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 4.18 4:18bf188b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08d97000 con 0x55bc08c31400 2024-04-19T23:45:42.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 4.1e 4:78fbacd6:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08d97400 con 0x55bc08cf8000 2024-04-19T23:45:42.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 4.3e 4:7f7048b3:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08d97800 con 0x55bc08c31400 2024-04-19T23:45:42.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.045+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 4.1b 4:d86c5742:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08d97c00 con 0x55bc08c31400 2024-04-19T23:45:42.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 4.34 4:2c84189a:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08d96800 con 0x55bc08c31400 2024-04-19T23:45:42.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 4.2d 4:b7b7c48d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf8c00 con 0x55bc08cf8000 2024-04-19T23:45:42.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:72 4.30 4:0e2208dd:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9c00 con 0x55bc08c31000 2024-04-19T23:45:42.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 4.10 4:0a1e2427:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc088afc00 con 0x55bc08c31000 2024-04-19T23:45:42.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:74 4.3a 4:5cb7eb41:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08e1a000 con 0x55bc08c31000 2024-04-19T23:45:42.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 4.9 4:9256d036:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08e1a400 con 0x55bc088af800 2024-04-19T23:45:42.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:76 4.0 4:034cf032:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08e1a800 con 0x55bc08c31000 2024-04-19T23:45:42.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(66 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(67 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(75 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(72 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(73 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(74 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(76 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(68 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(69 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.046+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(70 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.047+0000 7fc414f88700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:42.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.047+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94266090086400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08e1ac00 con 0x55bc088af800 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.048+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94266090086400] v30'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.048+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94266088545024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08e1b000 con 0x55bc08c31400 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.049+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94266088545024] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.049+0000 7fc430010a80 20 remove_watcher() i=0 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.049+0000 7fc430010a80 2 removed watcher, disabling cache 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.049+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94266088546176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08e1b400 con 0x55bc088af800 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.050+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94266088546176] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.050+0000 7fc430010a80 20 remove_watcher() i=1 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.050+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94266088547328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08e1b800 con 0x55bc08c31000 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.051+0000 7fc42dfba700 1 -- 172.21.15.155:0/523219994 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94266088547328] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc5200 con 0x55bc08c31000 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.051+0000 7fc430010a80 20 remove_watcher() i=2 2024-04-19T23:45:42.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.051+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94266088548480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08e1bc00 con 0x55bc08c31400 2024-04-19T23:45:42.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.052+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94266088548480] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc5440 con 0x55bc08c31400 2024-04-19T23:45:42.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.052+0000 7fc430010a80 20 remove_watcher() i=3 2024-04-19T23:45:42.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.052+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94266088549632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08e1b000 con 0x55bc088af800 2024-04-19T23:45:42.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.053+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94266088549632] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc088af800 2024-04-19T23:45:42.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.053+0000 7fc430010a80 20 remove_watcher() i=4 2024-04-19T23:45:42.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.053+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94266088550784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08e1a000 con 0x55bc08cf8000 2024-04-19T23:45:42.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.054+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94266088550784] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.054+0000 7fc430010a80 20 remove_watcher() i=5 2024-04-19T23:45:42.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.054+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94266088551936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9000 con 0x55bc08cf8000 2024-04-19T23:45:42.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.055+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94266088551936] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.055+0000 7fc430010a80 20 remove_watcher() i=6 2024-04-19T23:45:42.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.055+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94266088553088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc08cf9c00 con 0x55bc08cf8000 2024-04-19T23:45:42.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc42e7bb700 1 -- 172.21.15.155:0/523219994 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94266088553088] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc08cc4b40 con 0x55bc08cf8000 2024-04-19T23:45:42.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 20 remove_watcher() i=7 2024-04-19T23:45:42.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bc08cf8000 msgr2=0x55bc08b99180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55bc08cf8000 0x55bc08b99180 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bc088af800 msgr2=0x55bc08b97b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55bc088af800 0x55bc08b97b80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bc08c31400 msgr2=0x55bc08b98c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55bc08c31400 0x55bc08b98c00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bc08c31000 msgr2=0x55bc08b98100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55bc08c31000 0x55bc08b98100 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08c30c00 msgr2=0x55bc08b97600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08c30c00 0x55bc08b97600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55bc08b91890 tx=0x55bc0899f800 comp rx=0 tx=0).stop 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 msgr2=0x55bc08b96b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 --2- 172.21.15.155:0/523219994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088af400 0x55bc08b96b00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55bc0973c420 tx=0x55bc08bfa120 comp rx=0 tx=0).stop 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 reap_dead start 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc42d7b9700 1 -- 172.21.15.155:0/523219994 reap_dead start 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 shutdown_connections 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 >> 172.21.15.155:0/523219994 conn(0x55bc088aec00 msgr2=0x55bc0899b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 shutdown_connections 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.056+0000 7fc430010a80 1 -- 172.21.15.155:0/523219994 wait complete. 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/28916391 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08d96000 msgr2=0x55bc08b99700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 --2- 172.21.15.155:0/28916391 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08d96000 0x55bc08b99700 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55bc08c89f50 tx=0x55bc08bfa000 comp rx=0 tx=0).stop 2024-04-19T23:45:42.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/28916391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 msgr2=0x55bc08b98680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 --2- 172.21.15.155:0/28916391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55bc08d0b200 tx=0x55bc08bfb800 comp rx=0 tx=0).stop 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/28916391 shutdown_connections 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 --2- 172.21.15.155:0/28916391 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08d96000 0x55bc08b99700 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 --2- 172.21.15.155:0/28916391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc08cf9400 0x55bc08b98680 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/28916391 >> 172.21.15.155:0/28916391 conn(0x55bc08cf8800 msgr2=0x55bc0899c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/28916391 shutdown_connections 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/28916391 wait complete. 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/3011072271 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08c30000 msgr2=0x55bc08b97080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 --2- 172.21.15.155:0/3011072271 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08c30000 0x55bc08b97080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55bc0973cf00 tx=0x55bc08bfa240 comp rx=0 tx=0).stop 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/3011072271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 msgr2=0x55bc08b96580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 --2- 172.21.15.155:0/3011072271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x55bc0967fe30 tx=0x55bc0899f920 comp rx=0 tx=0).stop 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/3011072271 shutdown_connections 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 --2- 172.21.15.155:0/3011072271 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55bc08c30000 0x55bc08b97080 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 --2- 172.21.15.155:0/3011072271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55bc088ae800 0x55bc08b96580 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/3011072271 >> 172.21.15.155:0/3011072271 conn(0x55bc088ae400 msgr2=0x55bc0899b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/3011072271 shutdown_connections 2024-04-19T23:45:42.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.057+0000 7fc430010a80 1 -- 172.21.15.155:0/3011072271 wait complete. 2024-04-19T23:45:42.092 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:42.092 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo", 2024-04-19T23:45:42.092 INFO:teuthology.orchestra.run.smithi155.stdout: "num_shards": 11, 2024-04-19T23:45:42.092 INFO:teuthology.orchestra.run.smithi155.stdout: "tenant": "", 2024-04-19T23:45:42.092 INFO:teuthology.orchestra.run.smithi155.stdout: "zonegroup": "415e25ff-1f45-4d94-b7a7-66fe1b576744", 2024-04-19T23:45:42.092 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_rule": "default-placement", 2024-04-19T23:45:42.092 INFO:teuthology.orchestra.run.smithi155.stdout: "explicit_placement": { 2024-04-19T23:45:42.092 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": "", 2024-04-19T23:45:42.092 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "", 2024-04-19T23:45:42.092 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": "" 2024-04-19T23:45:42.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "marker": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1", 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "index_type": "Normal", 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "versioned": false, 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "versioning_enabled": false, 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "object_lock_enabled": false, 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_enabled": false, 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1", 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "mtime": "2024-04-19T23:45:41.582942Z", 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "creation_time": "2024-04-19T23:45:39.164552Z", 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "usage": { 2024-04-19T23:45:42.093 INFO:teuthology.orchestra.run.smithi155.stdout: "rgw.main": { 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "size": 0, 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "size_actual": 0, 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "size_utilized": 0, 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "size_kb": 0, 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "size_kb_actual": 0, 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "size_kb_utilized": 0, 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "num_objects": 0 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:42.094 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:42.095 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:42.095 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:42.095 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:42.095 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '415e25ff-1f45-4d94-b7a7-66fe1b576744', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'marker': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-19T23:45:41.582942Z', 'creation_time': '2024-04-19T23:45:39.164552Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-19T23:45:42.095 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-04-19T23:45:42.095 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-04-19T23:45:42.095 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-04-19T23:45:42.139 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:42.139 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:42.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.140+0000 7f44d5971a80 1 Processor -- start 2024-04-19T23:45:42.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.140+0000 7f44d5971a80 1 -- start start 2024-04-19T23:45:42.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.140+0000 7f44d5971a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55832de70c00 0x55832e158580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.140+0000 7f44d5971a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55832e19b500 con 0x55832de70800 2024-04-19T23:45:42.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.140+0000 7f44d5971a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55832df12a00 con 0x55832de70c00 2024-04-19T23:45:42.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.141+0000 7f44d311a700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55832de70c00 0x55832e158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.141+0000 7f44d391b700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55832de70800 0x55832df5c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46840/0 (socket says 172.21.15.155:46840) 2024-04-19T23:45:42.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.141+0000 7f44d391b700 1 -- 172.21.15.155:0/2531135747 learned_addr learned my addr 172.21.15.155:0/2531135747 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:42.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.141+0000 7f44d311a700 1 -- 172.21.15.155:0/2531135747 >> v1:172.21.15.76:6789/0 conn(0x55832de70800 legacy=0x55832df5c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.141+0000 7f44d311a700 1 -- 172.21.15.155:0/2531135747 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55832de99d40 con 0x55832de70c00 2024-04-19T23:45:42.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.141+0000 7f44d2919700 1 -- 172.21.15.155:0/2531135747 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306779817 0 0) 0x55832ec3e000 con 0x55832de70800 2024-04-19T23:45:42.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.141+0000 7f44d311a700 1 --2- 172.21.15.155:0/2531135747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70c00 0x55832e158580 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55832e153890 tx=0x55832df61920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d60393a1b23887 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.141+0000 7f44d2919700 1 -- 172.21.15.155:0/2531135747 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832df294a0 con 0x55832de70c00 2024-04-19T23:45:42.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.141+0000 7f44d2919700 1 -- 172.21.15.155:0/2531135747 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55832e19b800 con 0x55832de70c00 2024-04-19T23:45:42.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.141+0000 7f44d2919700 1 -- 172.21.15.155:0/2531135747 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832df29600 con 0x55832de70c00 2024-04-19T23:45:42.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.142+0000 7f44d5971a80 1 -- 172.21.15.155:0/2531135747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70c00 msgr2=0x55832e158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.142+0000 7f44d5971a80 1 --2- 172.21.15.155:0/2531135747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70c00 0x55832e158580 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55832e153890 tx=0x55832df61920 comp rx=0 tx=0).stop 2024-04-19T23:45:42.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.142+0000 7f44d5971a80 1 -- 172.21.15.155:0/2531135747 shutdown_connections 2024-04-19T23:45:42.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.142+0000 7f44d5971a80 1 --2- 172.21.15.155:0/2531135747 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70c00 0x55832e158580 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.142+0000 7f44d5971a80 1 -- 172.21.15.155:0/2531135747 >> 172.21.15.155:0/2531135747 conn(0x55832de70400 msgr2=0x55832df5c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.142+0000 7f44d5971a80 1 -- 172.21.15.155:0/2531135747 shutdown_connections 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.142+0000 7f44d5971a80 1 -- 172.21.15.155:0/2531135747 wait complete. 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.142+0000 7f44d5971a80 1 Processor -- start 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.142+0000 7f44d5971a80 1 -- start start 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.142+0000 7f44d5971a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.142+0000 7f44d5971a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55832df12500 con 0x55832de70800 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.143+0000 7f44d391b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.143+0000 7f44d391b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36626/0 (socket says 172.21.15.155:36626) 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.143+0000 7f44d391b700 1 -- 172.21.15.155:0/972528193 learned_addr learned my addr 172.21.15.155:0/972528193 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.143+0000 7f44d391b700 1 -- 172.21.15.155:0/972528193 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55832de99ba0 con 0x55832de70800 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.143+0000 7f44d391b700 1 --2- 172.21.15.155:0/972528193 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55832ec41770 tx=0x55832df61b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b458993978077d4d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.143+0000 7f44d2118700 1 -- 172.21.15.155:0/972528193 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832df294a0 con 0x55832de70800 2024-04-19T23:45:42.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.143+0000 7f44d2118700 1 -- 172.21.15.155:0/972528193 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55832e19bb00 con 0x55832de70800 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.143+0000 7f44d2118700 1 -- 172.21.15.155:0/972528193 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832df29600 con 0x55832de70800 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d5971a80 1 -- 172.21.15.155:0/972528193 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 msgr2=0x55832e158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d5971a80 1 --2- 172.21.15.155:0/972528193 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55832ec41770 tx=0x55832df61b60 comp rx=0 tx=0).stop 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d5971a80 1 -- 172.21.15.155:0/972528193 shutdown_connections 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d5971a80 1 --2- 172.21.15.155:0/972528193 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d5971a80 1 -- 172.21.15.155:0/972528193 >> 172.21.15.155:0/972528193 conn(0x55832de70400 msgr2=0x55832df5d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d5971a80 1 -- 172.21.15.155:0/972528193 shutdown_connections 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d5971a80 1 -- 172.21.15.155:0/972528193 wait complete. 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d5971a80 1 Processor -- start 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d5971a80 1 -- start start 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d5971a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d5971a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55832df123c0 con 0x55832de70800 2024-04-19T23:45:42.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d391b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d391b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36632/0 (socket says 172.21.15.155:36632) 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.144+0000 7f44d391b700 1 -- 172.21.15.155:0/2275184276 learned_addr learned my addr 172.21.15.155:0/2275184276 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.145+0000 7f44d391b700 1 -- 172.21.15.155:0/2275184276 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55832de99a00 con 0x55832de70800 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.145+0000 7f44d391b700 1 --2- 172.21.15.155:0/2275184276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55832ec41e30 tx=0x55832df61a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.145+0000 7f44d0915700 1 -- 172.21.15.155:0/2275184276 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832df298c0 con 0x55832de70800 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.145+0000 7f44d0915700 1 -- 172.21.15.155:0/2275184276 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55832df11c80 con 0x55832de70800 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.145+0000 7f44d5971a80 1 -- 172.21.15.155:0/2275184276 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55832de99860 con 0x55832de70800 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.145+0000 7f44d0915700 1 -- 172.21.15.155:0/2275184276 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832df294a0 con 0x55832de70800 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.145+0000 7f44d5971a80 1 -- 172.21.15.155:0/2275184276 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55832de996c0 con 0x55832de70800 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.145+0000 7f44d5971a80 1 Processor -- start 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.145+0000 7f44d5971a80 1 -- start start 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d5971a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 0x55832e158b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d5971a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55832df12000 con 0x55832de71400 2024-04-19T23:45:42.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d0915700 1 -- 172.21.15.155:0/2275184276 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55832ec12b00 con 0x55832de70800 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d411c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 0x55832e158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d411c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 0x55832e158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36644/0 (socket says 172.21.15.155:36644) 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d411c700 1 -- 172.21.15.155:0/1285818045 learned_addr learned my addr 172.21.15.155:0/1285818045 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d0915700 1 --2- 172.21.15.155:0/2275184276 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e200000 0x55832e159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d0915700 1 -- 172.21.15.155:0/2275184276 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55832deeb180 con 0x55832de70800 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d391b700 1 --2- 172.21.15.155:0/2275184276 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e200000 0x55832e159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d411c700 1 -- 172.21.15.155:0/1285818045 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55832de98000 con 0x55832de71400 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d411c700 1 --2- 172.21.15.155:0/1285818045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 0x55832e158b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x55832e1fe030 tx=0x55832e1c2120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2080cea5cefb10fa server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44d391b700 1 --2- 172.21.15.155:0/2275184276 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e200000 0x55832e159080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55832ed06f00 tx=0x55832e1c2240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44ce110700 1 -- 172.21.15.155:0/1285818045 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832df298c0 con 0x55832de71400 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44ce110700 1 -- 172.21.15.155:0/1285818045 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55832e19a300 con 0x55832de71400 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.146+0000 7f44ce110700 1 -- 172.21.15.155:0/1285818045 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832df294a0 con 0x55832de71400 2024-04-19T23:45:42.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d5971a80 1 -- 172.21.15.155:0/1285818045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 msgr2=0x55832e158b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1285818045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 0x55832e158b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x55832e1fe030 tx=0x55832e1c2120 comp rx=0 tx=0).stop 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d5971a80 1 -- 172.21.15.155:0/1285818045 shutdown_connections 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1285818045 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 0x55832e158b00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d5971a80 1 -- 172.21.15.155:0/1285818045 >> 172.21.15.155:0/1285818045 conn(0x55832de70c00 msgr2=0x55832df5d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d5971a80 1 -- 172.21.15.155:0/1285818045 shutdown_connections 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d5971a80 1 -- 172.21.15.155:0/1285818045 wait complete. 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d5971a80 1 Processor -- start 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d5971a80 1 -- start start 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d5971a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 0x55832e158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d5971a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55832deac640 con 0x55832de71400 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d411c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 0x55832e158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d411c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 0x55832e158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36656/0 (socket says 172.21.15.155:36656) 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.147+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 learned_addr learned my addr 172.21.15.155:0/1284062555 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.148+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55832de98ea0 con 0x55832de71400 2024-04-19T23:45:42.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.148+0000 7f44d411c700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 0x55832e158b00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x55832ed064e0 tx=0x55832e1c28a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.148+0000 7f44cc90d700 1 -- 172.21.15.155:0/1284062555 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832df29b80 con 0x55832de71400 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.148+0000 7f44cc90d700 1 -- 172.21.15.155:0/1284062555 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55832df11c80 con 0x55832de71400 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.148+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55832de98820 con 0x55832de71400 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.148+0000 7f44cc90d700 1 -- 172.21.15.155:0/1284062555 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832df298c0 con 0x55832de71400 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.148+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55832de989c0 con 0x55832de71400 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.149+0000 7f44cc90d700 1 -- 172.21.15.155:0/1284062555 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55832ec12dc0 con 0x55832de71400 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.149+0000 7f44cc90d700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e200c00 0x55832e159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.149+0000 7f44cc90d700 1 -- 172.21.15.155:0/1284062555 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55832deeb340 con 0x55832de71400 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.149+0000 7f44d5971a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.149+0000 7f44d311a700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e200c00 0x55832e159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.149+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55832de71800 0x55832e159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.149+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832de71c00 con 0x55832de71800 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.149+0000 7f44d411c700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55832de71800 0x55832e159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.149+0000 7f44d311a700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e200c00 0x55832e159600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55832e153890 tx=0x55832df61800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.149+0000 7f44d411c700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55832de71800 0x55832e159b80 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 20 realm 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201000 con 0x55832de71800 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201400 con 0x55832de71800 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201800 con 0x55832de71800 2024-04-19T23:45:42.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:42.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.150+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832de71800 2024-04-19T23:45:42.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.151+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.151+0000 7f44d5971a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:42.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.151+0000 7f44d5971a80 20 searching for the correct realm 2024-04-19T23:45:42.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.151+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55832e201000 0x55832e15a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.151+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201400 con 0x55832e201000 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.151+0000 7f44d391b700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55832e201000 0x55832e15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.151+0000 7f44d391b700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55832e201000 0x55832e15a100 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.152+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.152+0000 7f44d391b700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55832e201400 0x55832e15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.152+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8000 con 0x55832e201400 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.152+0000 7f44d311a700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55832e201400 0x55832e15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.152+0000 7f44d311a700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55832e201400 0x55832e15ac00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.152+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.152+0000 7f44d311a700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55832e2b8000 0x55832e15b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.152+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e2b8000 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.152+0000 7f44d411c700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55832e2b8000 0x55832e15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.153+0000 7f44d411c700 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55832e2b8000 0x55832e15b180 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.153+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.153+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832de71800 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.153+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.153+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832de71800 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.154+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.154+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e2b8000 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.154+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.154+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e2b8000 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.154+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.154+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201400 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.154+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.154+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201000 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.154+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.154+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832de71800 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.155+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.155+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e2b8000 2024-04-19T23:45:42.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.155+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.155+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832de71800 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.155+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.155+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201400 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.155+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.155+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201000 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.156+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.156+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201000 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.156+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.156+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e2b8000 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.156+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.156+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201000 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.156+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.156+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201000 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.156+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.156+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832de71800 2024-04-19T23:45:42.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.157+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.157+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832de71800 2024-04-19T23:45:42.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.157+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.157+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e2b8000 2024-04-19T23:45:42.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.157+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.157+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201000 2024-04-19T23:45:42.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.157+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.157+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201400 2024-04-19T23:45:42.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.158+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.158+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832de71800 2024-04-19T23:45:42.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.158+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.158+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e2b8000 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.158+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.158+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201000 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.158+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.158+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e2b8000 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.159+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.159+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201400 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.159+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.159+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201000 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.159+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.159+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e2b8000 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.159+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.159+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832de71800 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201400 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832de71c00 con 0x55832de71800 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8c00 con 0x55832de71800 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.160+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9000 con 0x55832e201400 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 20 zone default found 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 4 Realm: () 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 20 zonegroup default 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9400 con 0x55832e2b8000 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9800 con 0x55832e201000 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9c00 con 0x55832e201000 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 20 started sync module instance, tier type = 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.161+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8c00 con 0x55832e201400 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.162+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.162+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94021902203648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832de71c00 con 0x55832e201400 2024-04-19T23:45:42.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.162+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201800 con 0x55832de71800 2024-04-19T23:45:42.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.163+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94021902203648] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.163+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.163+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94021902204800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832de71800 2024-04-19T23:45:42.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.163+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e201000 2024-04-19T23:45:42.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.164+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94021902204800] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.165+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.165+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94021902205952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9000 con 0x55832e201000 2024-04-19T23:45:42.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.165+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8c00 con 0x55832e201400 2024-04-19T23:45:42.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.166+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94021902205952] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.166+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.166+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94021902207104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8400 con 0x55832e201400 2024-04-19T23:45:42.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.166+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9800 con 0x55832de71800 2024-04-19T23:45:42.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.167+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94021902207104] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.167+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.167+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94021902208256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9c00 con 0x55832de71800 2024-04-19T23:45:42.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.167+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b8800 con 0x55832e2b8000 2024-04-19T23:45:42.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.168+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.168+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94021902208256] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.168+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94021902209408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9400 con 0x55832e2b8000 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.168+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9800 con 0x55832e2b8000 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.169+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94021902209408] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.169+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.169+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94021902210560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9c00 con 0x55832e2b8000 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.169+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201800 con 0x55832e2b8000 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.170+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.170+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94021902211712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e2b8000 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.170+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94021902210560] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.170+0000 7f44d5971a80 20 add_watcher() i=0 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.170+0000 7f44d5971a80 20 add_watcher() i=1 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.170+0000 7f44d5971a80 20 add_watcher() i=2 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.170+0000 7f44d5971a80 20 add_watcher() i=3 2024-04-19T23:45:42.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.170+0000 7f44d5971a80 20 add_watcher() i=4 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.170+0000 7f44d5971a80 20 add_watcher() i=5 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.170+0000 7f44d5971a80 20 add_watcher() i=6 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.171+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94021902211712] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.171+0000 7f44d5971a80 20 add_watcher() i=7 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.171+0000 7f44d5971a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.171+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201800 con 0x55832de71800 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.171+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.171+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94021903745024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832de71800 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.172+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94021903745024] v30'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.172+0000 7f44ba8e9700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.172+0000 7f44d5971a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.172+0000 7f44d5971a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:42.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.172+0000 7f44d5971a80 1 Processor -- start 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.173+0000 7f44d5971a80 1 -- start start 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.173+0000 7f44d5971a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 0x55832e15a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.173+0000 7f44d5971a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55832deac780 con 0x55832e2b9400 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.173+0000 7f44d311a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 0x55832e15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.173+0000 7f44d311a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 0x55832e15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36660/0 (socket says 172.21.15.155:36660) 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.173+0000 7f44d311a700 1 -- 172.21.15.155:0/1790458604 learned_addr learned my addr 172.21.15.155:0/1790458604 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.173+0000 7f44d311a700 1 -- 172.21.15.155:0/1790458604 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55832de98b60 con 0x55832e2b9400 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.174+0000 7f44d311a700 1 --2- 172.21.15.155:0/1790458604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 0x55832e15a680 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55832e2520c0 tx=0x55832e1c36e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46baf4d61d55971 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.174+0000 7f44ba0e8700 1 -- 172.21.15.155:0/1790458604 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832df29760 con 0x55832e2b9400 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.174+0000 7f44ba0e8700 1 -- 172.21.15.155:0/1790458604 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55832e2e0000 con 0x55832e2b9400 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.174+0000 7f44ba0e8700 1 -- 172.21.15.155:0/1790458604 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832e2e2000 con 0x55832e2b9400 2024-04-19T23:45:42.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.174+0000 7f44d5971a80 1 -- 172.21.15.155:0/1790458604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 msgr2=0x55832e15a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.174+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1790458604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 0x55832e15a680 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55832e2520c0 tx=0x55832e1c36e0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.174+0000 7f44d5971a80 1 -- 172.21.15.155:0/1790458604 shutdown_connections 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.174+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1790458604 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 0x55832e15a680 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.174+0000 7f44d5971a80 1 -- 172.21.15.155:0/1790458604 >> 172.21.15.155:0/1790458604 conn(0x55832e2b8800 msgr2=0x55832df5e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.174+0000 7f44d5971a80 1 -- 172.21.15.155:0/1790458604 shutdown_connections 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.174+0000 7f44d5971a80 1 -- 172.21.15.155:0/1790458604 wait complete. 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.175+0000 7f44d5971a80 1 Processor -- start 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.175+0000 7f44d5971a80 1 -- start start 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.175+0000 7f44d5971a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 0x55832e15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.175+0000 7f44d5971a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55832df12000 con 0x55832e2b9400 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.175+0000 7f44d311a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 0x55832e15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.175+0000 7f44d311a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 0x55832e15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36666/0 (socket says 172.21.15.155:36666) 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.175+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 learned_addr learned my addr 172.21.15.155:0/39104778 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.175+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55832de98d00 con 0x55832e2b9400 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.176+0000 7f44d311a700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 0x55832e15a680 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x55832e2cd200 tx=0x55832e1c3800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.176+0000 7f44b88e5700 1 -- 172.21.15.155:0/39104778 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832e2e2160 con 0x55832e2b9400 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.176+0000 7f44b88e5700 1 -- 172.21.15.155:0/39104778 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55832e2e0180 con 0x55832e2b9400 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.176+0000 7f44b88e5700 1 -- 172.21.15.155:0/39104778 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55832e2e22c0 con 0x55832e2b9400 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.176+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55832de98340 con 0x55832e2b9400 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.176+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55832de99d40 con 0x55832e2b9400 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.176+0000 7f44b88e5700 1 -- 172.21.15.155:0/39104778 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55832ec13b80 con 0x55832e2b9400 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.177+0000 7f44b88e5700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e35c000 0x55832e15b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.177+0000 7f44b88e5700 1 -- 172.21.15.155:0/39104778 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55832deeb500 con 0x55832e2b9400 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.177+0000 7f44d5971a80 5 note: GC not initialized 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.177+0000 7f44d411c700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e35c000 0x55832e15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.177+0000 7f44d411c700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e35c000 0x55832e15b700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55832e2539b0 tx=0x55832e1c20c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.178+0000 7f44b60e0700 20 reqs_thread_entry: start 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.178+0000 7f44d5971a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:42.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.178+0000 7f44d5971a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.178+0000 7f44b40dc700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:12 2024 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.178+0000 7f44b38ba700 20 reqs_thread_entry: start 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.178+0000 7f44d5971a80 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55832e2b9c00 0x55832e3c0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.178+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:1 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e35c400 con 0x55832e2b9c00 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.178+0000 7f44d391b700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55832e2b9c00 0x55832e3c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.178+0000 7f44d391b700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55832e2b9c00 0x55832e3c0000 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.179+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(1 [pgnls start_epoch 30 out=254b] v30'37 uv29 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x55832e2ad200 con 0x55832e2b9c00 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.179+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e35c400 con 0x55832e2b9c00 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.179+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(2 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x55832e2ad200 con 0x55832e2b9c00 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.179+0000 7f44d391b700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55832e35c400 0x55832e3c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.179+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9000 con 0x55832e35c400 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.179+0000 7f44d311a700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55832e35c400 0x55832e3c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.180+0000 7f44d311a700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55832e35c400 0x55832e3c1600 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.180+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.180+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:4 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e2b9000 con 0x55832e2b9c00 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.181+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(4 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x55832e2ad200 con 0x55832e2b9c00 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.181+0000 7f44d391b700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55832e2b9000 0x55832e3c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.181+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e3cc000 con 0x55832e2b9000 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.181+0000 7f44d411c700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55832e2b9000 0x55832e3c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.181+0000 7f44d411c700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55832e2b9000 0x55832e3c1b80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.181+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(5 [pgnls start_epoch 30 out=335b] v30'147 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b9000 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.181+0000 7f44d411c700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55832e3cc000 0x55832e3c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.181+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:6 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e3cc000 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.181+0000 7f44d391b700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55832e3cc000 0x55832e3c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.182+0000 7f44d391b700 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55832e3cc000 0x55832e3c2100 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.182+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=213b] v30'13 uv13 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x55832e2ad200 con 0x55832e3cc000 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.182+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:7 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.182+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.182+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:8 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.182+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(8 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.182+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:9 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.183+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.183+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:10 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e3cc000 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.183+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(10 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x55832e2ad200 con 0x55832e3cc000 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.183+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e3cc000 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.183+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=336b] v30'27 uv19 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x55832e2ad200 con 0x55832e3cc000 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.183+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:12 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.183+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(12 [pgnls start_epoch 30 out=131b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.184+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:13 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.184+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(13 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.184+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.184+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(14 [pgnls start_epoch 30 out=90b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.184+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e2b9000 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.184+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(15 [pgnls start_epoch 30 out=213b] v30'20 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b9000 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.184+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.185+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(16 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.185+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e2b9000 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.185+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(17 [pgnls start_epoch 30 out=254b] v30'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b9000 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.185+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.185+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(18 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.185+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.185+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(19 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.185+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e2b9000 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.186+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b9000 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.186+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e3cc000 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.186+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 30 out=276b] v30'14 uv13 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x55832e2ad200 con 0x55832e3cc000 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.186+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e3cc000 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.186+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x55832e2ad200 con 0x55832e3cc000 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.186+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:23 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e2b9000 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.187+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(23 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b9000 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.187+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:24 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e2b9c00 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.187+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(24 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x55832e2ad200 con 0x55832e2b9c00 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.187+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:25 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e3cc000 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.187+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(25 [pgnls start_epoch 30 out=213b] v30'43 uv19 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x55832e2ad200 con 0x55832e3cc000 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.187+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e2b9c00 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.188+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(26 [pgnls start_epoch 30 out=172b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x55832e2ad200 con 0x55832e2b9c00 2024-04-19T23:45:42.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.188+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.188+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(27 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.188+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.189+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(28 [pgnls start_epoch 30 out=90b] v30'13 uv5 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.189+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:29 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e35c400 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.189+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(29 [pgnls start_epoch 30 out=90b] v30'40 uv28 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x55832e2ad440 con 0x55832e35c400 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.189+0000 7f44d311a700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:30 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e2b9000 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.189+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(30 [pgnls start_epoch 30 out=131b] v30'6 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b9000 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.189+0000 7f44d411c700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:31 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e3cc000 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.189+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(31 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x55832e2ad200 con 0x55832e3cc000 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.189+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e201c00 con 0x55832e2b9c00 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.190+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x55832e2ad200 con 0x55832e2b9c00 2024-04-19T23:45:42.205 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000078", 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000070", 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000104", 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000026", 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000028", 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000040", 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000015", 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000069", 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000095", 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000003", 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000047", 2024-04-19T23:45:42.206 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000035", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000037", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000024", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000000", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000031", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "data_loggenerations_metadata", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000076", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000113", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000005", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000011", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000058", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000052", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000088", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000080", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000090", 2024-04-19T23:45:42.207 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000110", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000096", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000087", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000008", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000006", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000029", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000089", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000022", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000016", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000041", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000018", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000092", 2024-04-19T23:45:42.208 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000014", 2024-04-19T23:45:42.209 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000112", 2024-04-19T23:45:42.209 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000007", 2024-04-19T23:45:42.209 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000021", 2024-04-19T23:45:42.209 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000064", 2024-04-19T23:45:42.209 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000071", 2024-04-19T23:45:42.209 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000074", 2024-04-19T23:45:42.209 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000081", 2024-04-19T23:45:42.209 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000009", 2024-04-19T23:45:42.209 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000121", 2024-04-19T23:45:42.209 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000125", 2024-04-19T23:45:42.209 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000082", 2024-04-19T23:45:42.210 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000105", 2024-04-19T23:45:42.210 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000059", 2024-04-19T23:45:42.210 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000077", 2024-04-19T23:45:42.210 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000032", 2024-04-19T23:45:42.210 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000053", 2024-04-19T23:45:42.210 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000091", 2024-04-19T23:45:42.210 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000065", 2024-04-19T23:45:42.210 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000083", 2024-04-19T23:45:42.210 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000010", 2024-04-19T23:45:42.210 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000045", 2024-04-19T23:45:42.210 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000002", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000116", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000034", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000101", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000079", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000049", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000117", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000044", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000066", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000068", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000085", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000073", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000038", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000118", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000036", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000103", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000119", 2024-04-19T23:45:42.211 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000098", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000027", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000019", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000039", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000100", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000093", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000004", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000063", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000122", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000057", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000054", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000114", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "data_log.0", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000012", 2024-04-19T23:45:42.212 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000084", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000043", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000111", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000048", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000020", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000099", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000056", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000072", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000062", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000115", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000033", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000025", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000123", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000108", 2024-04-19T23:45:42.213 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000094", 2024-04-19T23:45:42.214 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000060", 2024-04-19T23:45:42.214 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000109", 2024-04-19T23:45:42.214 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000013", 2024-04-19T23:45:42.214 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000051", 2024-04-19T23:45:42.214 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000106", 2024-04-19T23:45:42.214 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000017", 2024-04-19T23:45:42.214 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000023", 2024-04-19T23:45:42.214 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000107", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000046", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000067", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000086", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000050", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000102", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000124", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000001", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000126", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000055", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000061", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000097", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000042", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000075", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000120", 2024-04-19T23:45:42.215 INFO:teuthology.orchestra.run.smithi155.stdout: "obj_delete_at_hint.0000000030" 2024-04-19T23:45:42.216 INFO:teuthology.orchestra.run.smithi155.stdout:] 2024-04-19T23:45:42.216 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:42.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.191+0000 7f44ba8e9700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:42.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.191+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94021903745024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e35c800 con 0x55832de71800 2024-04-19T23:45:42.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.192+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 data_loggenerations_metadata [watch unwatch cookie 94021903745024] v30'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.192+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94021902203648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e35d400 con 0x55832e201400 2024-04-19T23:45:42.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.193+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 notify.0 [watch unwatch cookie 94021902203648] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.193+0000 7f44d5971a80 20 remove_watcher() i=0 2024-04-19T23:45:42.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.193+0000 7f44d5971a80 2 removed watcher, disabling cache 2024-04-19T23:45:42.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.193+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94021902204800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e35d800 con 0x55832de71800 2024-04-19T23:45:42.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.194+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 notify.1 [watch unwatch cookie 94021902204800] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.194+0000 7f44d5971a80 20 remove_watcher() i=1 2024-04-19T23:45:42.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.194+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94021902205952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e35dc00 con 0x55832e201000 2024-04-19T23:45:42.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.195+0000 7f44d391b700 1 -- 172.21.15.155:0/1284062555 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(65 notify.2 [watch unwatch cookie 94021902205952] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2ad200 con 0x55832e201000 2024-04-19T23:45:42.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.195+0000 7f44d5971a80 20 remove_watcher() i=2 2024-04-19T23:45:42.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.195+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94021902207104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e3cd000 con 0x55832e201400 2024-04-19T23:45:42.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.196+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(66 notify.3 [watch unwatch cookie 94021902207104] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2ad440 con 0x55832e201400 2024-04-19T23:45:42.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.196+0000 7f44d5971a80 20 remove_watcher() i=3 2024-04-19T23:45:42.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.196+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94021902208256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e3cd400 con 0x55832de71800 2024-04-19T23:45:42.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.197+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(67 notify.4 [watch unwatch cookie 94021902208256] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832de71800 2024-04-19T23:45:42.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.197+0000 7f44d5971a80 20 remove_watcher() i=4 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.197+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94021902209408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e3cd800 con 0x55832e2b8000 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.198+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(68 notify.5 [watch unwatch cookie 94021902209408] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.198+0000 7f44d5971a80 20 remove_watcher() i=5 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.198+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94021902210560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e3cdc00 con 0x55832e2b8000 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.199+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(69 notify.6 [watch unwatch cookie 94021902210560] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.199+0000 7f44d5971a80 20 remove_watcher() i=6 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.199+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94021902211712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55832e35d000 con 0x55832e2b8000 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d411c700 1 -- 172.21.15.155:0/1284062555 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(70 notify.7 [watch unwatch cookie 94021902211712] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55832e2acb40 con 0x55832e2b8000 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 20 remove_watcher() i=7 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55832e2b8000 msgr2=0x55832e15b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55832e2b8000 0x55832e15b180 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55832de71800 msgr2=0x55832e159b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55832de71800 0x55832e159b80 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55832e201400 msgr2=0x55832e15ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55832e201400 0x55832e15ac00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55832e201000 msgr2=0x55832e15a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55832e201000 0x55832e15a100 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e200c00 msgr2=0x55832e159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e200c00 0x55832e159600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55832e153890 tx=0x55832df61800 comp rx=0 tx=0).stop 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 msgr2=0x55832e158b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 --2- 172.21.15.155:0/1284062555 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de71400 0x55832e158b00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x55832ed064e0 tx=0x55832e1c28a0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 reap_dead start 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d311a700 1 -- 172.21.15.155:0/1284062555 reap_dead start 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 shutdown_connections 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.200+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 >> 172.21.15.155:0/1284062555 conn(0x55832de70c00 msgr2=0x55832df5d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 shutdown_connections 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/1284062555 wait complete. 2024-04-19T23:45:42.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55832e2b9c00 msgr2=0x55832e3c0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55832e2b9c00 0x55832e3c0000 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55832e2b9000 msgr2=0x55832e3c1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55832e2b9000 0x55832e3c1b80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55832e3cc000 msgr2=0x55832e3c2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55832e3cc000 0x55832e3c2100 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55832e35c400 msgr2=0x55832e3c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55832e35c400 0x55832e3c1600 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e35c000 msgr2=0x55832e15b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e35c000 0x55832e15b700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55832e2539b0 tx=0x55832e1c20c0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 msgr2=0x55832e15a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 --2- 172.21.15.155:0/39104778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832e2b9400 0x55832e15a680 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x55832e2cd200 tx=0x55832e1c3800 comp rx=0 tx=0).stop 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d391b700 1 -- 172.21.15.155:0/39104778 reap_dead start 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 shutdown_connections 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 >> 172.21.15.155:0/39104778 conn(0x55832e2b8800 msgr2=0x55832df5e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 shutdown_connections 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.201+0000 7f44d5971a80 1 -- 172.21.15.155:0/39104778 wait complete. 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.202+0000 7f44d5971a80 1 -- 172.21.15.155:0/2275184276 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e200000 msgr2=0x55832e159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.202+0000 7f44d5971a80 1 --2- 172.21.15.155:0/2275184276 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e200000 0x55832e159080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55832ed06f00 tx=0x55832e1c2240 comp rx=0 tx=0).stop 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.202+0000 7f44d5971a80 1 -- 172.21.15.155:0/2275184276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 msgr2=0x55832e158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.202+0000 7f44d5971a80 1 --2- 172.21.15.155:0/2275184276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55832ec41e30 tx=0x55832df61a40 comp rx=0 tx=0).stop 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.202+0000 7f44d5971a80 1 -- 172.21.15.155:0/2275184276 shutdown_connections 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.202+0000 7f44d5971a80 1 --2- 172.21.15.155:0/2275184276 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55832e200000 0x55832e159080 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.202+0000 7f44d5971a80 1 --2- 172.21.15.155:0/2275184276 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55832de70800 0x55832e158580 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.202+0000 7f44d5971a80 1 -- 172.21.15.155:0/2275184276 >> 172.21.15.155:0/2275184276 conn(0x55832de70400 msgr2=0x55832df5d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.202+0000 7f44d5971a80 1 -- 172.21.15.155:0/2275184276 shutdown_connections 2024-04-19T23:45:42.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.202+0000 7f44d5971a80 1 -- 172.21.15.155:0/2275184276 wait complete. 2024-04-19T23:45:42.227 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-04-19T23:45:42.227 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-19T23:45:42.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-19T23:45:42.227 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-19T23:45:42.273 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:42.273 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:42.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.274+0000 7f32f4a15a80 1 Processor -- start 2024-04-19T23:45:42.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.274+0000 7f32f4a15a80 1 -- start start 2024-04-19T23:45:42.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.274+0000 7f32f4a15a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5629473e2800 0x5629476ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.274+0000 7f32f4a15a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56294770d500 con 0x5629473e2c00 2024-04-19T23:45:42.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.274+0000 7f32f4a15a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x562947484a00 con 0x5629473e2800 2024-04-19T23:45:42.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.274+0000 7f32f29bf700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5629473e2800 0x5629476ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.274+0000 7f32f21be700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5629473e2c00 0x5629474ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46856/0 (socket says 172.21.15.155:46856) 2024-04-19T23:45:42.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.274+0000 7f32f21be700 1 -- 172.21.15.155:0/3859969453 learned_addr learned my addr 172.21.15.155:0/3859969453 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:42.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.274+0000 7f32f29bf700 1 -- 172.21.15.155:0/3859969453 >> v1:172.21.15.76:6789/0 conn(0x5629473e2c00 legacy=0x5629474ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f29bf700 1 -- 172.21.15.155:0/3859969453 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56294740bd40 con 0x5629473e2800 2024-04-19T23:45:42.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f19bd700 1 -- 172.21.15.155:0/3859969453 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790218160 0 0) 0x5629481b0000 con 0x5629473e2c00 2024-04-19T23:45:42.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f29bf700 1 --2- 172.21.15.155:0/3859969453 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x5629476c59e0 tx=0x5629474d3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851c2c44e4ce2d61 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f19bd700 1 -- 172.21.15.155:0/3859969453 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56294749b4a0 con 0x5629473e2800 2024-04-19T23:45:42.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f19bd700 1 -- 172.21.15.155:0/3859969453 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56294770d800 con 0x5629473e2800 2024-04-19T23:45:42.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f19bd700 1 -- 172.21.15.155:0/3859969453 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56294749b600 con 0x5629473e2800 2024-04-19T23:45:42.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f4a15a80 1 -- 172.21.15.155:0/3859969453 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 msgr2=0x5629476ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/3859969453 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x5629476c59e0 tx=0x5629474d3920 comp rx=0 tx=0).stop 2024-04-19T23:45:42.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f4a15a80 1 -- 172.21.15.155:0/3859969453 shutdown_connections 2024-04-19T23:45:42.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/3859969453 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f4a15a80 1 -- 172.21.15.155:0/3859969453 >> 172.21.15.155:0/3859969453 conn(0x5629473e2400 msgr2=0x5629474ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f4a15a80 1 -- 172.21.15.155:0/3859969453 shutdown_connections 2024-04-19T23:45:42.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.275+0000 7f32f4a15a80 1 -- 172.21.15.155:0/3859969453 wait complete. 2024-04-19T23:45:42.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.276+0000 7f32f4a15a80 1 Processor -- start 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.276+0000 7f32f4a15a80 1 -- start start 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.276+0000 7f32f4a15a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.276+0000 7f32f4a15a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562947484500 con 0x5629473e2800 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.276+0000 7f32f29bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.276+0000 7f32f29bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36688/0 (socket says 172.21.15.155:36688) 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.276+0000 7f32f29bf700 1 -- 172.21.15.155:0/230566765 learned_addr learned my addr 172.21.15.155:0/230566765 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f29bf700 1 -- 172.21.15.155:0/230566765 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56294740bba0 con 0x5629473e2800 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f29bf700 1 --2- 172.21.15.155:0/230566765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x5629481b3800 tx=0x5629474d3800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828d32c17dcc01e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f11bc700 1 -- 172.21.15.155:0/230566765 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56294749b760 con 0x5629473e2800 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f11bc700 1 -- 172.21.15.155:0/230566765 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56294770db00 con 0x5629473e2800 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f11bc700 1 -- 172.21.15.155:0/230566765 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56294749b4a0 con 0x5629473e2800 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f4a15a80 1 -- 172.21.15.155:0/230566765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 msgr2=0x5629476ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/230566765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x5629481b3800 tx=0x5629474d3800 comp rx=0 tx=0).stop 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f4a15a80 1 -- 172.21.15.155:0/230566765 shutdown_connections 2024-04-19T23:45:42.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/230566765 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f4a15a80 1 -- 172.21.15.155:0/230566765 >> 172.21.15.155:0/230566765 conn(0x5629473e2400 msgr2=0x5629474cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f4a15a80 1 -- 172.21.15.155:0/230566765 shutdown_connections 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.277+0000 7f32f4a15a80 1 -- 172.21.15.155:0/230566765 wait complete. 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32f4a15a80 1 Processor -- start 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32f4a15a80 1 -- start start 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32f4a15a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32f4a15a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629474843c0 con 0x5629473e2800 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32f29bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32f29bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36694/0 (socket says 172.21.15.155:36694) 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32f29bf700 1 -- 172.21.15.155:0/379711622 learned_addr learned my addr 172.21.15.155:0/379711622 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32f29bf700 1 -- 172.21.15.155:0/379711622 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56294740ba00 con 0x5629473e2800 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32f29bf700 1 --2- 172.21.15.155:0/379711622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x5629481b3ec0 tx=0x5629474d3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32ef9b9700 1 -- 172.21.15.155:0/379711622 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56294749b600 con 0x5629473e2800 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32ef9b9700 1 -- 172.21.15.155:0/379711622 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56294770dc80 con 0x5629473e2800 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32f4a15a80 1 -- 172.21.15.155:0/379711622 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56294740b860 con 0x5629473e2800 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.278+0000 7f32ef9b9700 1 -- 172.21.15.155:0/379711622 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56294749b8c0 con 0x5629473e2800 2024-04-19T23:45:42.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.279+0000 7f32f4a15a80 1 -- 172.21.15.155:0/379711622 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56294740b6c0 con 0x5629473e2800 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.279+0000 7f32f4a15a80 1 Processor -- start 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.279+0000 7f32ef9b9700 1 -- 172.21.15.155:0/379711622 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562948184b00 con 0x5629473e2800 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.279+0000 7f32f4a15a80 1 -- start start 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.279+0000 7f32ef9b9700 1 --2- 172.21.15.155:0/379711622 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629473e3400 0x5629476cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.279+0000 7f32f4a15a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.279+0000 7f32f4a15a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56294741e640 con 0x5629473e3800 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.279+0000 7f32ef9b9700 1 -- 172.21.15.155:0/379711622 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56294745d180 con 0x5629473e2800 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.280+0000 7f32f31c0700 1 --2- 172.21.15.155:0/379711622 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629473e3400 0x5629476cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.280+0000 7f32f29bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.280+0000 7f32f29bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36698/0 (socket says 172.21.15.155:36698) 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.280+0000 7f32f29bf700 1 -- 172.21.15.155:0/2441395136 learned_addr learned my addr 172.21.15.155:0/2441395136 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.280+0000 7f32f31c0700 1 --2- 172.21.15.155:0/379711622 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629473e3400 0x5629476cb080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x5629481b3fb0 tx=0x562947726540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.280+0000 7f32f29bf700 1 -- 172.21.15.155:0/2441395136 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56294740a000 con 0x5629473e3800 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.280+0000 7f32f29bf700 1 --2- 172.21.15.155:0/2441395136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x56294825cf90 tx=0x5629477264e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfa364e341e3e98 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.280+0000 7f32ed1b4700 1 -- 172.21.15.155:0/2441395136 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56294749b600 con 0x5629473e3800 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.280+0000 7f32ed1b4700 1 -- 172.21.15.155:0/2441395136 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56294770dc80 con 0x5629473e3800 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.280+0000 7f32ed1b4700 1 -- 172.21.15.155:0/2441395136 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56294749b8c0 con 0x5629473e3800 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2441395136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 msgr2=0x5629476cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2441395136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x56294825cf90 tx=0x5629477264e0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2441395136 shutdown_connections 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2441395136 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2441395136 >> 172.21.15.155:0/2441395136 conn(0x5629473e2c00 msgr2=0x5629474cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2441395136 shutdown_connections 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2441395136 wait complete. 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f4a15a80 1 Processor -- start 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f4a15a80 1 -- start start 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f4a15a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f4a15a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56294741e8c0 con 0x5629473e3800 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f29bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f29bf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36712/0 (socket says 172.21.15.155:36712) 2024-04-19T23:45:42.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.281+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 learned_addr learned my addr 172.21.15.155:0/2165924381 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.282+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56294740aea0 con 0x5629473e3800 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.282+0000 7f32f29bf700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x56294825c330 tx=0x562947726720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.282+0000 7f32eb9b1700 1 -- 172.21.15.155:0/2165924381 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56294749b760 con 0x5629473e3800 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.282+0000 7f32eb9b1700 1 -- 172.21.15.155:0/2165924381 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562947483e00 con 0x5629473e3800 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.282+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56294740a820 con 0x5629473e3800 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.282+0000 7f32eb9b1700 1 -- 172.21.15.155:0/2165924381 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56294749b4a0 con 0x5629473e3800 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.282+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56294740a9c0 con 0x5629473e3800 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.283+0000 7f32eb9b1700 1 -- 172.21.15.155:0/2165924381 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562948184dc0 con 0x5629473e3800 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.283+0000 7f32eb9b1700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562947780c00 0x5629476cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.283+0000 7f32eb9b1700 1 -- 172.21.15.155:0/2165924381 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56294745d340 con 0x5629473e3800 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.283+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.283+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5629473e3c00 0x5629476cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.283+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947781000 con 0x5629473e3c00 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.283+0000 7f32f21be700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562947780c00 0x5629476cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.283+0000 7f32f31c0700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5629473e3c00 0x5629476cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.283+0000 7f32f21be700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562947780c00 0x5629476cb600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x5629481b2030 tx=0x5629477266c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.283+0000 7f32f31c0700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5629473e3c00 0x5629476cbb80 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 20 realm 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947781400 con 0x5629473e3c00 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947781800 con 0x5629473e3c00 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947781c00 con 0x5629473e3c00 2024-04-19T23:45:42.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:42.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.284+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947781000 con 0x5629473e3c00 2024-04-19T23:45:42.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.285+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.285+0000 7f32f4a15a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:42.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.285+0000 7f32f4a15a80 20 searching for the correct realm 2024-04-19T23:45:42.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.285+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562947781400 0x5629476cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.285+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947781800 con 0x562947781400 2024-04-19T23:45:42.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.285+0000 7f32f29bf700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562947781400 0x5629476cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.285+0000 7f32f29bf700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562947781400 0x5629476cc100 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.285+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.285+0000 7f32f29bf700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562947781800 0x5629476ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.285+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947780400 con 0x562947781800 2024-04-19T23:45:42.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.286+0000 7f32f21be700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562947781800 0x5629476ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.286+0000 7f32f21be700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562947781800 0x5629476ccc00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.286+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.286+0000 7f32f21be700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562947780400 0x5629476cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.286+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947780400 2024-04-19T23:45:42.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.286+0000 7f32f31c0700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562947780400 0x5629476cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.287+0000 7f32f31c0700 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562947780400 0x5629476cd180 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.287+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.287+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x5629473e3c00 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.287+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.287+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x5629473e3c00 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.287+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.287+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947780400 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.287+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.287+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947780400 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.288+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.288+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781800 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.288+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.288+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781400 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.288+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.288+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x5629473e3c00 2024-04-19T23:45:42.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.288+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.288+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947780400 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.289+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.289+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x5629473e3c00 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.289+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.289+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781800 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.289+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.289+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781400 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.289+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.289+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781400 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.289+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.289+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947780400 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.290+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.290+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781400 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.290+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.290+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781400 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.290+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.290+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x5629473e3c00 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.290+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.290+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x5629473e3c00 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.291+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.291+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947780400 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.291+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.291+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781400 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.291+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.291+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781800 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.291+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.291+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x5629473e3c00 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.292+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.292+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947780400 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.292+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.292+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781400 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.292+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.292+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947780400 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.292+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.293+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781800 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.293+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.293+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781400 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.293+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.293+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947780400 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.293+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.293+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x5629473e3c00 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.293+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.293+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781800 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947781c00 con 0x5629473e3c00 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947781000 con 0x5629473e3c00 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718400 con 0x562947781800 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 zone default found 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 4 Realm: () 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 zonegroup default 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.294+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718800 con 0x562947780400 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f4a15a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718c00 con 0x562947781400 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f4a15a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947719000 con 0x562947781400 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f4a15a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f4a15a80 20 started sync module instance, tier type = 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f4a15a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.295+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947719400 con 0x562947781800 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.296+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.296+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94735291915008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947719800 con 0x562947781800 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.296+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947719c00 con 0x5629473e3c00 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.297+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94735291915008] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.297+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.297+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94735291916160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718800 con 0x5629473e3c00 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.297+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947719c00 con 0x562947781400 2024-04-19T23:45:42.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.298+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94735291916160] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.298+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.298+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94735291917312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947781400 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.299+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718400 con 0x562947781800 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.299+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94735291917312] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.299+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.299+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94735291918464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947719400 con 0x562947781800 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.300+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947781c00 con 0x5629473e3c00 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.301+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94735291918464] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.301+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.301+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94735291919616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947781000 con 0x5629473e3c00 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.301+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718c00 con 0x562947780400 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.301+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94735291919616] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.302+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.302+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94735291920768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947719000 con 0x562947780400 2024-04-19T23:45:42.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.302+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947719c00 con 0x562947780400 2024-04-19T23:45:42.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.303+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.303+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94735291921920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x562947780400 2024-04-19T23:45:42.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.303+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718800 con 0x562947780400 2024-04-19T23:45:42.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.303+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94735291920768] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94735291921920] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94735291923072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718c00 con 0x562947780400 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f4a15a80 20 add_watcher() i=0 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f4a15a80 20 add_watcher() i=1 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f4a15a80 20 add_watcher() i=2 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f4a15a80 20 add_watcher() i=3 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f4a15a80 20 add_watcher() i=4 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f4a15a80 20 add_watcher() i=5 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f4a15a80 20 add_watcher() i=6 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94735291923072] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f4a15a80 20 add_watcher() i=7 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f4a15a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.304+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947719000 con 0x5629473e3c00 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.305+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.305+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94735293317120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947781c00 con 0x5629473e3c00 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.306+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94735293317120] v30'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.306+0000 7f32d998d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.306+0000 7f32f4a15a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.306+0000 7f32f4a15a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.306+0000 7f32f4a15a80 1 Processor -- start 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.306+0000 7f32f4a15a80 1 -- start start 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.306+0000 7f32f4a15a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.306+0000 7f32f4a15a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629474843c0 con 0x562947781c00 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.307+0000 7f32f21be700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.307+0000 7f32f21be700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36722/0 (socket says 172.21.15.155:36722) 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.307+0000 7f32f21be700 1 -- 172.21.15.155:0/2575970388 learned_addr learned my addr 172.21.15.155:0/2575970388 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.307+0000 7f32f21be700 1 -- 172.21.15.155:0/2575970388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56294740ab60 con 0x562947781c00 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.307+0000 7f32f21be700 1 --2- 172.21.15.155:0/2575970388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x5629478200c0 tx=0x562947727500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7d7029a2a94e96 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.307+0000 7f32d918c700 1 -- 172.21.15.155:0/2575970388 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562947816160 con 0x562947781c00 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.307+0000 7f32d918c700 1 -- 172.21.15.155:0/2575970388 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562947836000 con 0x562947781c00 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.307+0000 7f32d918c700 1 -- 172.21.15.155:0/2575970388 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629478162c0 con 0x562947781c00 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.308+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2575970388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 msgr2=0x5629476cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.308+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2575970388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x5629478200c0 tx=0x562947727500 comp rx=0 tx=0).stop 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.308+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2575970388 shutdown_connections 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.308+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2575970388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.308+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2575970388 >> 172.21.15.155:0/2575970388 conn(0x562947781000 msgr2=0x5629474d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.308+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2575970388 shutdown_connections 2024-04-19T23:45:42.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.308+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2575970388 wait complete. 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.308+0000 7f32f4a15a80 1 Processor -- start 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.308+0000 7f32f4a15a80 1 -- start start 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.308+0000 7f32f4a15a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.308+0000 7f32f4a15a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x562947484500 con 0x562947781c00 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.309+0000 7f32f21be700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.309+0000 7f32f21be700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36738/0 (socket says 172.21.15.155:36738) 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.309+0000 7f32f21be700 1 -- 172.21.15.155:0/4128195636 learned_addr learned my addr 172.21.15.155:0/4128195636 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.309+0000 7f32f21be700 1 -- 172.21.15.155:0/4128195636 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56294740ad00 con 0x562947781c00 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.309+0000 7f32f21be700 1 --2- 172.21.15.155:0/4128195636 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x5629478202d0 tx=0x562947727620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.309+0000 7f32d7989700 1 -- 172.21.15.155:0/4128195636 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562947816420 con 0x562947781c00 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.309+0000 7f32d7989700 1 -- 172.21.15.155:0/4128195636 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562947836180 con 0x562947781c00 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.309+0000 7f32f4a15a80 1 -- 172.21.15.155:0/4128195636 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56294740a340 con 0x562947781c00 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.309+0000 7f32d7989700 1 -- 172.21.15.155:0/4128195636 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562947816160 con 0x562947781c00 2024-04-19T23:45:42.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.309+0000 7f32f4a15a80 1 -- 172.21.15.155:0/4128195636 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56294740ab60 con 0x562947781c00 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.310+0000 7f32d7989700 1 -- 172.21.15.155:0/4128195636 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x562948185b80 con 0x562947781c00 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.310+0000 7f32d7989700 1 --2- 172.21.15.155:0/4128195636 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629478b6000 0x5629476cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.310+0000 7f32d7989700 1 -- 172.21.15.155:0/4128195636 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56294745d6c0 con 0x562947781c00 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.310+0000 7f32f4a15a80 5 note: GC not initialized 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.310+0000 7f32f31c0700 1 --2- 172.21.15.155:0/4128195636 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629478b6000 0x5629476cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.310+0000 7f32f31c0700 1 --2- 172.21.15.155:0/4128195636 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629478b6000 0x5629476cd700 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x562947821f20 tx=0x562947727380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.311+0000 7f32d5184700 20 reqs_thread_entry: start 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.311+0000 7f32f4a15a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.311+0000 7f32f4a15a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.311+0000 7f32d3180700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:12 2024 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.311+0000 7f32d295e700 20 reqs_thread_entry: start 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.311+0000 7f32f4a15a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.311+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718000 con 0x5629473e3c00 2024-04-19T23:45:42.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f4a15a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f4a15a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f4a15a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f4a15a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718800 con 0x562947781800 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f4a15a80 20 disabling bucket name=myfoo 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f4a15a80 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.312+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718c00 con 0x562947781800 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:42.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 : miss 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947719000 con 0x5629473e3c00 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.313+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5629478b6800 con 0x5629473e3c00 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.314+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(66 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'6 uv6 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.314+0000 7f32f4a15a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.314+0000 7f32f4a15a80 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.314+0000 7f32f4a15a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.314+0000 7f32f4a15a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1, ofs0, ns] 2024-04-19T23:45:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.314+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94735293319424 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5629478b7000 con 0x562947781400 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 94735291917312 notify 128849018891 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x56294779c9c0 con 0x562947781400 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32ed1b4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94735291917312 notifier 4637 bl.length()=725 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(67 notify.2 [notify cookie 94735293319424 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32ed1b4700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32ed1b4700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32ed1b4700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32ed1b4700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56294791c000 con 0x562947781400 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== watch-notify(notify_complete (2) cookie 94735293319424 notify 128849018891 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56294779cb60 con 0x562947781400 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32f4a15a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_sources= new_sources= 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32f4a15a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential sources added=[] removed=[] 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32f4a15a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_dests= new_dests= 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32f4a15a80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential dests added=[] removed=[] 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.315+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5629478b7800 con 0x5629473e3c00 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.316+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v30'14 uv14 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.316+0000 7f32f4a15a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.316+0000 7f32f4a15a80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.316+0000 7f32f4a15a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.316+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94735293319424 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5629478b7c00 con 0x5629473e3c00 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.316+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== watch-notify(notify (1) cookie 94735291919616 notify 128849018896 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x56294791e000 con 0x5629473e3c00 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.316+0000 7f32ed1b4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94735291919616 notifier 4637 bl.length()=533 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.316+0000 7f32ed1b4700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.316+0000 7f32ed1b4700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.316+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(70 notify.4 [notify cookie 94735293319424 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.316+0000 7f32ed1b4700 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56294791c400 con 0x5629473e3c00 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.317+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.317+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== watch-notify(notify_complete (2) cookie 94735293319424 notify 128849018896 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56294779c9c0 con 0x5629473e3c00 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:42.329 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 1, 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:42.330 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:42.331 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:42.332 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:42.332 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:42.332 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:42.332 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:42.332 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:42.332 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:42.332 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:42.332 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:42.332 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:42.332 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:42.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.317+0000 7f32d998d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:42.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.317+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94735293317120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947719800 con 0x5629473e3c00 2024-04-19T23:45:42.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.318+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94735293317120] v30'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.318+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94735291915008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718400 con 0x562947781800 2024-04-19T23:45:42.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.319+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94735291915008] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.319+0000 7f32f4a15a80 20 remove_watcher() i=0 2024-04-19T23:45:42.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.319+0000 7f32f4a15a80 2 removed watcher, disabling cache 2024-04-19T23:45:42.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.319+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94735291916160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718800 con 0x5629473e3c00 2024-04-19T23:45:42.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.321+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94735291916160] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.321+0000 7f32f4a15a80 20 remove_watcher() i=1 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.321+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94735291917312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562947718c00 con 0x562947781400 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.321+0000 7f32f29bf700 1 -- 172.21.15.155:0/2165924381 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94735291917312] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477ef200 con 0x562947781400 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.321+0000 7f32f4a15a80 20 remove_watcher() i=2 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.321+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94735291918464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56294791c800 con 0x562947781800 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.322+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94735291918464] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477ef440 con 0x562947781800 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.322+0000 7f32f4a15a80 20 remove_watcher() i=3 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.322+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94735291919616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56294791cc00 con 0x5629473e3c00 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.324+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94735291919616] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x5629473e3c00 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.324+0000 7f32f4a15a80 20 remove_watcher() i=4 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.324+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94735291920768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56294791d000 con 0x562947780400 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.325+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94735291920768] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.325+0000 7f32f4a15a80 20 remove_watcher() i=5 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.325+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94735291921920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56294791d400 con 0x562947780400 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.326+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94735291921920] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.326+0000 7f32f4a15a80 20 remove_watcher() i=6 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.326+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94735291923072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56294791d800 con 0x562947780400 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f31c0700 1 -- 172.21.15.155:0/2165924381 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94735291923072] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629477eeb40 con 0x562947780400 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 20 remove_watcher() i=7 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562947780400 msgr2=0x5629476cd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x562947780400 0x5629476cd180 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5629473e3c00 msgr2=0x5629476cbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5629473e3c00 0x5629476cbb80 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562947781800 msgr2=0x5629476ccc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x562947781800 0x5629476ccc00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562947781400 msgr2=0x5629476cc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x562947781400 0x5629476cc100 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562947780c00 msgr2=0x5629476cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x562947780c00 0x5629476cb600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x5629481b2030 tx=0x5629477266c0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 msgr2=0x5629476cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x56294825c330 tx=0x562947726720 comp rx=0 tx=0).stop 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f21be700 1 -- 172.21.15.155:0/2165924381 reap_dead start 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 shutdown_connections 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/2165924381 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e3800 0x5629476cab00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 >> 172.21.15.155:0/2165924381 conn(0x5629473e2c00 msgr2=0x5629474cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 shutdown_connections 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/2165924381 wait complete. 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/4128195636 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629478b6000 msgr2=0x5629476cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/4128195636 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629478b6000 0x5629476cd700 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x562947821f20 tx=0x562947727380 comp rx=0 tx=0).stop 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 -- 172.21.15.155:0/4128195636 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 msgr2=0x5629476cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.327+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/4128195636 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x5629478202d0 tx=0x562947727620 comp rx=0 tx=0).stop 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 -- 172.21.15.155:0/4128195636 shutdown_connections 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/4128195636 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629478b6000 0x5629476cd700 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/4128195636 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562947781c00 0x5629476cc680 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 -- 172.21.15.155:0/4128195636 >> 172.21.15.155:0/4128195636 conn(0x562947781000 msgr2=0x5629474d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 -- 172.21.15.155:0/4128195636 shutdown_connections 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 -- 172.21.15.155:0/4128195636 wait complete. 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 -- 172.21.15.155:0/379711622 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629473e3400 msgr2=0x5629476cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/379711622 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629473e3400 0x5629476cb080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x5629481b3fb0 tx=0x562947726540 comp rx=0 tx=0).stop 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 -- 172.21.15.155:0/379711622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 msgr2=0x5629476ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/379711622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x5629481b3ec0 tx=0x5629474d3920 comp rx=0 tx=0).stop 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 -- 172.21.15.155:0/379711622 shutdown_connections 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/379711622 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5629473e3400 0x5629476cb080 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 --2- 172.21.15.155:0/379711622 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5629473e2800 0x5629476ca580 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 -- 172.21.15.155:0/379711622 >> 172.21.15.155:0/379711622 conn(0x5629473e2400 msgr2=0x5629474cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 -- 172.21.15.155:0/379711622 shutdown_connections 2024-04-19T23:45:42.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.328+0000 7f32f4a15a80 1 -- 172.21.15.155:0/379711622 wait complete. 2024-04-19T23:45:42.342 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:42.344 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-19T23:45:42.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-19T23:45:42.344 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-19T23:45:42.389 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:42.389 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.390+0000 7f3265b6ba80 1 Processor -- start 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.390+0000 7f3265b6ba80 1 -- start start 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.390+0000 7f3265b6ba80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x564e9da92c00 0x564e9dd7a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.390+0000 7f3265b6ba80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564e9ddbd500 con 0x564e9da92800 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.390+0000 7f3265b6ba80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x564e9db34a00 con 0x564e9da92c00 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.390+0000 7f3263314700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x564e9da92c00 0x564e9dd7a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.390+0000 7f3263b15700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x564e9da92800 0x564e9db7e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:46870/0 (socket says 172.21.15.155:46870) 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.390+0000 7f3263b15700 1 -- 172.21.15.155:0/4217218283 learned_addr learned my addr 172.21.15.155:0/4217218283 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.390+0000 7f3263314700 1 -- 172.21.15.155:0/4217218283 >> v1:172.21.15.76:6789/0 conn(0x564e9da92800 legacy=0x564e9db7e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3263314700 1 -- 172.21.15.155:0/4217218283 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e9dabbd40 con 0x564e9da92c00 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3262b13700 1 -- 172.21.15.155:0/4217218283 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682214367 0 0) 0x564e9e860000 con 0x564e9da92800 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3263314700 1 --2- 172.21.15.155:0/4217218283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92c00 0x564e9dd7a580 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x564e9dd75890 tx=0x564e9db83920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad95f8a3ebd50fb server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3262b13700 1 -- 172.21.15.155:0/4217218283 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9db4b4a0 con 0x564e9da92c00 2024-04-19T23:45:42.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3262b13700 1 -- 172.21.15.155:0/4217218283 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564e9ddbd800 con 0x564e9da92c00 2024-04-19T23:45:42.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3262b13700 1 -- 172.21.15.155:0/4217218283 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9db4b600 con 0x564e9da92c00 2024-04-19T23:45:42.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3265b6ba80 1 -- 172.21.15.155:0/4217218283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92c00 msgr2=0x564e9dd7a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/4217218283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92c00 0x564e9dd7a580 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x564e9dd75890 tx=0x564e9db83920 comp rx=0 tx=0).stop 2024-04-19T23:45:42.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3265b6ba80 1 -- 172.21.15.155:0/4217218283 shutdown_connections 2024-04-19T23:45:42.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/4217218283 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92c00 0x564e9dd7a580 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3265b6ba80 1 -- 172.21.15.155:0/4217218283 >> 172.21.15.155:0/4217218283 conn(0x564e9da92400 msgr2=0x564e9db7e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3265b6ba80 1 -- 172.21.15.155:0/4217218283 shutdown_connections 2024-04-19T23:45:42.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.391+0000 7f3265b6ba80 1 -- 172.21.15.155:0/4217218283 wait complete. 2024-04-19T23:45:42.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.392+0000 7f3265b6ba80 1 Processor -- start 2024-04-19T23:45:42.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.392+0000 7f3265b6ba80 1 -- start start 2024-04-19T23:45:42.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.392+0000 7f3265b6ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.392+0000 7f3265b6ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9db34500 con 0x564e9da92800 2024-04-19T23:45:42.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.392+0000 7f3263b15700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.392+0000 7f3263b15700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36746/0 (socket says 172.21.15.155:36746) 2024-04-19T23:45:42.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.392+0000 7f3263b15700 1 -- 172.21.15.155:0/3013595291 learned_addr learned my addr 172.21.15.155:0/3013595291 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3263b15700 1 -- 172.21.15.155:0/3013595291 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e9dabbba0 con 0x564e9da92800 2024-04-19T23:45:42.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3263b15700 1 --2- 172.21.15.155:0/3013595291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x564e9e863770 tx=0x564e9db83b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d548cf09e9016228 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3262312700 1 -- 172.21.15.155:0/3013595291 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9db4b1e0 con 0x564e9da92800 2024-04-19T23:45:42.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3262312700 1 -- 172.21.15.155:0/3013595291 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564e9ddbdb00 con 0x564e9da92800 2024-04-19T23:45:42.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3262312700 1 -- 172.21.15.155:0/3013595291 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9db4b4a0 con 0x564e9da92800 2024-04-19T23:45:42.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3013595291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 msgr2=0x564e9dd7a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3013595291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x564e9e863770 tx=0x564e9db83b60 comp rx=0 tx=0).stop 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3013595291 shutdown_connections 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3013595291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3013595291 >> 172.21.15.155:0/3013595291 conn(0x564e9da92400 msgr2=0x564e9db7f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3013595291 shutdown_connections 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.393+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3013595291 wait complete. 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.394+0000 7f3265b6ba80 1 Processor -- start 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.394+0000 7f3265b6ba80 1 -- start start 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.394+0000 7f3265b6ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.394+0000 7f3265b6ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9db343c0 con 0x564e9da92800 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.394+0000 7f3263b15700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.394+0000 7f3263b15700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36754/0 (socket says 172.21.15.155:36754) 2024-04-19T23:45:42.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.394+0000 7f3263b15700 1 -- 172.21.15.155:0/666319677 learned_addr learned my addr 172.21.15.155:0/666319677 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.394+0000 7f3263b15700 1 -- 172.21.15.155:0/666319677 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e9dabba00 con 0x564e9da92800 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.394+0000 7f3263b15700 1 --2- 172.21.15.155:0/666319677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x564e9e863e30 tx=0x564e9db83a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3260b0f700 1 -- 172.21.15.155:0/666319677 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9db4b600 con 0x564e9da92800 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3260b0f700 1 -- 172.21.15.155:0/666319677 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564e9db33c80 con 0x564e9da92800 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3265b6ba80 1 -- 172.21.15.155:0/666319677 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564e9dabb860 con 0x564e9da92800 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3260b0f700 1 -- 172.21.15.155:0/666319677 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9db4b1e0 con 0x564e9da92800 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3265b6ba80 1 -- 172.21.15.155:0/666319677 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e9dabb6c0 con 0x564e9da92800 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3265b6ba80 1 Processor -- start 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3260b0f700 1 -- 172.21.15.155:0/666319677 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x564e9e834b00 con 0x564e9da92800 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3265b6ba80 1 -- start start 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3260b0f700 1 --2- 172.21.15.155:0/666319677 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9da93400 0x564e9dd7b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3265b6ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 0x564e9dd7ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3265b6ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9dace640 con 0x564e9da93800 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.395+0000 7f3260b0f700 1 -- 172.21.15.155:0/666319677 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x564e9db0d180 con 0x564e9da92800 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f3264316700 1 --2- 172.21.15.155:0/666319677 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9da93400 0x564e9dd7b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f3263b15700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 0x564e9dd7ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f3263b15700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 0x564e9dd7ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36768/0 (socket says 172.21.15.155:36768) 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f3263b15700 1 -- 172.21.15.155:0/3009926578 learned_addr learned my addr 172.21.15.155:0/3009926578 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f3263b15700 1 -- 172.21.15.155:0/3009926578 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e9daba000 con 0x564e9da93800 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f3264316700 1 --2- 172.21.15.155:0/666319677 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9da93400 0x564e9dd7b080 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x564e9e863890 tx=0x564e9ddde060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f3263b15700 1 --2- 172.21.15.155:0/3009926578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 0x564e9dd7ab00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x564e9e920330 tx=0x564e9ddde240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16311405076eb0dc server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f325e30a700 1 -- 172.21.15.155:0/3009926578 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9db4b4a0 con 0x564e9da93800 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f325e30a700 1 -- 172.21.15.155:0/3009926578 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564e9ddbc300 con 0x564e9da93800 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f325e30a700 1 -- 172.21.15.155:0/3009926578 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9db4b8c0 con 0x564e9da93800 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3009926578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 msgr2=0x564e9dd7ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.396+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3009926578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 0x564e9dd7ab00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x564e9e920330 tx=0x564e9ddde240 comp rx=0 tx=0).stop 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3009926578 shutdown_connections 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3009926578 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 0x564e9dd7ab00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3009926578 >> 172.21.15.155:0/3009926578 conn(0x564e9da92c00 msgr2=0x564e9db7f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3009926578 shutdown_connections 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3009926578 wait complete. 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3265b6ba80 1 Processor -- start 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3265b6ba80 1 -- start start 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3265b6ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 0x564e9dd7ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3265b6ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9dace8c0 con 0x564e9da93800 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3263b15700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 0x564e9dd7ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3263b15700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 0x564e9dd7ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36774/0 (socket says 172.21.15.155:36774) 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 learned_addr learned my addr 172.21.15.155:0/3143586542 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.397+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e9dabaea0 con 0x564e9da93800 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.398+0000 7f3263b15700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 0x564e9dd7ab00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x564e9de30c30 tx=0x564e9ddde8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.398+0000 7f325cb07700 1 -- 172.21.15.155:0/3143586542 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9db4b4a0 con 0x564e9da93800 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.398+0000 7f325cb07700 1 -- 172.21.15.155:0/3143586542 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564e9db33e00 con 0x564e9da93800 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.398+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564e9daba820 con 0x564e9da93800 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.398+0000 7f325cb07700 1 -- 172.21.15.155:0/3143586542 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9db4b8c0 con 0x564e9da93800 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.398+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e9daba9c0 con 0x564e9da93800 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.398+0000 7f325cb07700 1 -- 172.21.15.155:0/3143586542 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x564e9e834dc0 con 0x564e9da93800 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f325cb07700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9de34c00 0x564e9dd7b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f325cb07700 1 -- 172.21.15.155:0/3143586542 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x564e9db0d340 con 0x564e9da93800 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f3263314700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9de34c00 0x564e9dd7b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564e9da93c00 0x564e9dd7bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de35000 con 0x564e9da93c00 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f3264316700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564e9da93c00 0x564e9dd7bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f3263314700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9de34c00 0x564e9dd7b600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x564e9dd75890 tx=0x564e9db83800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f3264316700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564e9da93c00 0x564e9dd7bb80 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f3265b6ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f3265b6ba80 20 realm 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.399+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de35400 con 0x564e9da93c00 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de35800 con 0x564e9da93c00 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de35c00 con 0x564e9da93c00 2024-04-19T23:45:42.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de35000 con 0x564e9da93c00 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.400+0000 7f3265b6ba80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.401+0000 7f3265b6ba80 20 searching for the correct realm 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.401+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x564e9de35400 0x564e9dd7c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.401+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de35800 con 0x564e9de35400 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.401+0000 7f3263b15700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x564e9de35400 0x564e9dd7c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.401+0000 7f3263b15700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x564e9de35400 0x564e9dd7c100 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.401+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.401+0000 7f3263b15700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x564e9de35800 0x564e9dd7cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.401+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de34400 con 0x564e9de35800 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.402+0000 7f3263314700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x564e9de35800 0x564e9dd7cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.402+0000 7f3263314700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x564e9de35800 0x564e9dd7cc00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.402+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.402+0000 7f3263314700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564e9de34400 0x564e9dd7d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.402+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de34400 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.402+0000 7f3264316700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564e9de34400 0x564e9dd7d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.402+0000 7f3264316700 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564e9de34400 0x564e9dd7d180 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.403+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.403+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9da93c00 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.403+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.403+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9da93c00 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.403+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.403+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de34400 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.403+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.403+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de34400 2024-04-19T23:45:42.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.404+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.404+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35800 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.404+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.404+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35400 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.404+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.404+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9da93c00 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.404+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.404+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de34400 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.405+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.405+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9da93c00 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.405+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.405+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35800 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.405+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.405+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35400 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.405+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.405+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35400 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.405+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.405+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de34400 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.406+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.406+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35400 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.406+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.406+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35400 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.406+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.406+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9da93c00 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.407+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.407+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9da93c00 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.407+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.407+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de34400 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.407+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.407+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35400 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.407+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.407+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35800 2024-04-19T23:45:42.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.408+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.408+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9da93c00 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.408+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.408+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de34400 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.408+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.408+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35400 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.408+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.408+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de34400 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.409+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.409+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35800 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.409+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.409+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35400 2024-04-19T23:45:42.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.409+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.409+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de34400 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.409+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.409+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9da93c00 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35800 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de35c00 con 0x564e9da93c00 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de35000 con 0x564e9da93c00 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.410+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe400 con 0x564e9de35800 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 20 zone default found 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 4 Realm: () 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 20 zonegroup default 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe800 con 0x564e9de34400 2024-04-19T23:45:42.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debec00 con 0x564e9de35400 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debf000 con 0x564e9de35400 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.411+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.412+0000 7f3265b6ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.412+0000 7f3265b6ba80 20 started sync module instance, tier type = 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.412+0000 7f3265b6ba80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.412+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debf400 con 0x564e9de35800 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.412+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.412+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94895655557888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debf800 con 0x564e9de35800 2024-04-19T23:45:42.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.412+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debfc00 con 0x564e9da93c00 2024-04-19T23:45:42.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.413+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94895655557888] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.414+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.414+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94895655559040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe800 con 0x564e9da93c00 2024-04-19T23:45:42.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.414+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debfc00 con 0x564e9de35400 2024-04-19T23:45:42.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.415+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94895655559040] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.415+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.415+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94895655560192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de35400 2024-04-19T23:45:42.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.415+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe400 con 0x564e9de35800 2024-04-19T23:45:42.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.416+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94895655560192] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.416+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.416+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94895655561344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debf400 con 0x564e9de35800 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.416+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de35c00 con 0x564e9da93c00 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.417+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.417+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94895655562496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de35000 con 0x564e9da93c00 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.417+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debec00 con 0x564e9de34400 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.417+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94895655561344] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.419+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.419+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94895655563648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debf000 con 0x564e9de34400 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.419+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debfc00 con 0x564e9de34400 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.419+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94895655562496] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.421+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94895655563648] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.421+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.421+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94895655564800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9de34400 2024-04-19T23:45:42.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.421+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe800 con 0x564e9de34400 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.422+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94895655564800] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.422+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.422+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94895655565952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debec00 con 0x564e9de34400 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.422+0000 7f3265b6ba80 20 add_watcher() i=0 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.422+0000 7f3265b6ba80 20 add_watcher() i=1 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.422+0000 7f3265b6ba80 20 add_watcher() i=2 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.422+0000 7f3265b6ba80 20 add_watcher() i=3 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.422+0000 7f3265b6ba80 20 add_watcher() i=4 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.422+0000 7f3265b6ba80 20 add_watcher() i=5 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.422+0000 7f3265b6ba80 20 add_watcher() i=6 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.423+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94895655565952] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.423+0000 7f3265b6ba80 20 add_watcher() i=7 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.423+0000 7f3265b6ba80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:42.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.423+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debf000 con 0x564e9da93c00 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.423+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.423+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94895656976384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9de35c00 con 0x564e9da93c00 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.424+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94895656976384] v30'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.424+0000 7f324aae3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.424+0000 7f3265b6ba80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.424+0000 7f3265b6ba80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.425+0000 7f3265b6ba80 1 Processor -- start 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.425+0000 7f3265b6ba80 1 -- start start 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.425+0000 7f3265b6ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.425+0000 7f3265b6ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9db343c0 con 0x564e9de35c00 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.425+0000 7f3263314700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.425+0000 7f3263314700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36788/0 (socket says 172.21.15.155:36788) 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.425+0000 7f3263314700 1 -- 172.21.15.155:0/4066172390 learned_addr learned my addr 172.21.15.155:0/4066172390 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.425+0000 7f3263314700 1 -- 172.21.15.155:0/4066172390 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e9dabab60 con 0x564e9de35c00 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.426+0000 7f3263314700 1 --2- 172.21.15.155:0/4066172390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x564e9de514d0 tx=0x564e9ddde1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49804457e20e1b6e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.426+0000 7f324a2e2700 1 -- 172.21.15.155:0/4066172390 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9db4b760 con 0x564e9de35c00 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.426+0000 7f324a2e2700 1 -- 172.21.15.155:0/4066172390 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564e9dee4000 con 0x564e9de35c00 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.426+0000 7f324a2e2700 1 -- 172.21.15.155:0/4066172390 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9deca160 con 0x564e9de35c00 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.426+0000 7f3265b6ba80 1 -- 172.21.15.155:0/4066172390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 msgr2=0x564e9dd7c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.426+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/4066172390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x564e9de514d0 tx=0x564e9ddde1e0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3265b6ba80 1 -- 172.21.15.155:0/4066172390 shutdown_connections 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/4066172390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3265b6ba80 1 -- 172.21.15.155:0/4066172390 >> 172.21.15.155:0/4066172390 conn(0x564e9de35000 msgr2=0x564e9db80000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3265b6ba80 1 -- 172.21.15.155:0/4066172390 shutdown_connections 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3265b6ba80 1 -- 172.21.15.155:0/4066172390 wait complete. 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3265b6ba80 1 Processor -- start 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3265b6ba80 1 -- start start 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3265b6ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3265b6ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9db34500 con 0x564e9de35c00 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3263314700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3263314700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:36794/0 (socket says 172.21.15.155:36794) 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.427+0000 7f3263314700 1 -- 172.21.15.155:0/1100410296 learned_addr learned my addr 172.21.15.155:0/1100410296 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.428+0000 7f3263314700 1 -- 172.21.15.155:0/1100410296 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e9dabad00 con 0x564e9de35c00 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.428+0000 7f3263314700 1 --2- 172.21.15.155:0/1100410296 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x564e9dedc1e0 tx=0x564e9dddf740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.428+0000 7f3248adf700 1 -- 172.21.15.155:0/1100410296 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9deca2c0 con 0x564e9de35c00 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.428+0000 7f3248adf700 1 -- 172.21.15.155:0/1100410296 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564e9dee4180 con 0x564e9de35c00 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.428+0000 7f3248adf700 1 -- 172.21.15.155:0/1100410296 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564e9deca420 con 0x564e9de35c00 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.428+0000 7f3265b6ba80 1 -- 172.21.15.155:0/1100410296 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564e9daba340 con 0x564e9de35c00 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.428+0000 7f3265b6ba80 1 -- 172.21.15.155:0/1100410296 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e9dabbd40 con 0x564e9de35c00 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.429+0000 7f3248adf700 1 -- 172.21.15.155:0/1100410296 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x564e9e835b80 con 0x564e9de35c00 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.429+0000 7f3248adf700 1 --2- 172.21.15.155:0/1100410296 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9df66000 0x564e9dd7d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.429+0000 7f3248adf700 1 -- 172.21.15.155:0/1100410296 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x564e9db0d6c0 con 0x564e9de35c00 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.429+0000 7f3265b6ba80 5 note: GC not initialized 2024-04-19T23:45:42.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.429+0000 7f3264316700 1 --2- 172.21.15.155:0/1100410296 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9df66000 0x564e9dd7d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.429+0000 7f3264316700 1 --2- 172.21.15.155:0/1100410296 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9df66000 0x564e9dd7d700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x564e9deddda0 tx=0x564e9ddde900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.430+0000 7f32462da700 20 reqs_thread_entry: start 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.430+0000 7f3265b6ba80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.430+0000 7f3265b6ba80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.430+0000 7f32442d6700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:12 2024 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.430+0000 7f3243ab4700 20 reqs_thread_entry: start 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.430+0000 7f3265b6ba80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.430+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.430+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe000 con 0x564e9da93c00 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.431+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv14 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.431+0000 7f3265b6ba80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.431+0000 7f3265b6ba80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.431+0000 7f3265b6ba80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:42.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.431+0000 7f3265b6ba80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.431+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe800 con 0x564e9de35800 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.431+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.431+0000 7f3265b6ba80 20 enabling bucket name=myfoo 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.431+0000 7f3265b6ba80 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.431+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.431+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debec00 con 0x564e9de35800 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 : miss 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debf000 con 0x564e9da93c00 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:42.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.432+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 8.a 8:572cbafc:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9df66800 con 0x564e9da93c00 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.433+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(66 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'7 uv7 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.433+0000 7f3265b6ba80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.433+0000 7f3265b6ba80 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.433+0000 7f3265b6ba80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.433+0000 7f3265b6ba80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1, ofs0, ns] 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.433+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94895656978688 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9df67000 con 0x564e9de35400 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 94895655560192 notify 128849018892 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x564e9de54b60 con 0x564e9de35400 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f325e30a700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94895655560192 notifier 4645 bl.length()=725 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(67 notify.2 [notify cookie 94895656978688 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f325e30a700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 info.flags=0x17 2024-04-19T23:45:42.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f325e30a700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1 to cache LRU end 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f325e30a700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f325e30a700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9dfcc000 con 0x564e9de35400 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== watch-notify(notify_complete (2) cookie 94895656978688 notify 128849018892 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564e9de54d00 con 0x564e9de35400 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f3265b6ba80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_sources= new_sources= 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f3265b6ba80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential sources added=[] removed=[] 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f3265b6ba80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): orig_dests= new_dests= 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f3265b6ba80 20 handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1]): potential dests added=[] removed=[] 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.434+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9df67800 con 0x564e9da93c00 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.435+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v30'15 uv15 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.435+0000 7f3265b6ba80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.435+0000 7f3265b6ba80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.435+0000 7f3265b6ba80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.435+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94895656978688 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9df67c00 con 0x564e9da93c00 2024-04-19T23:45:42.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.435+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== watch-notify(notify (1) cookie 94895655562496 notify 128849018897 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x564e9dfce000 con 0x564e9da93c00 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.436+0000 7f325e30a700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94895655562496 notifier 4645 bl.length()=533 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.436+0000 7f325e30a700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.436+0000 7f325e30a700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.436+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(70 notify.4 [notify cookie 94895656978688 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.436+0000 7f325e30a700 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9dfcc400 con 0x564e9da93c00 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.436+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== watch-notify(notify_complete (2) cookie 94895656978688 notify 128849018897 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564e9de54b60 con 0x564e9da93c00 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.436+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:42.447 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:42.448 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:42.449 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:42.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.436+0000 7f324aae3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:42.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.436+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94895656976384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debf800 con 0x564e9da93c00 2024-04-19T23:45:42.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.437+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94895656976384] v30'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.437+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94895655557888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe400 con 0x564e9de35800 2024-04-19T23:45:42.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.438+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94895655557888] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.438+0000 7f3265b6ba80 20 remove_watcher() i=0 2024-04-19T23:45:42.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.438+0000 7f3265b6ba80 2 removed watcher, disabling cache 2024-04-19T23:45:42.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.439+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94895655559040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debe800 con 0x564e9da93c00 2024-04-19T23:45:42.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.440+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94895655559040] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.440+0000 7f3265b6ba80 20 remove_watcher() i=1 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.440+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94895655560192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9debec00 con 0x564e9de35400 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.441+0000 7f3263b15700 1 -- 172.21.15.155:0/3143586542 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94895655560192] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaf200 con 0x564e9de35400 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.441+0000 7f3265b6ba80 20 remove_watcher() i=2 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.441+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94895655561344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9dfcc800 con 0x564e9de35800 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.442+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94895655561344] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaf440 con 0x564e9de35800 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.442+0000 7f3265b6ba80 20 remove_watcher() i=3 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.442+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94895655562496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9dfccc00 con 0x564e9da93c00 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.442+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94895655562496] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9da93c00 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.442+0000 7f3265b6ba80 20 remove_watcher() i=4 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.442+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94895655563648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9dfcd000 con 0x564e9de34400 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.444+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94895655563648] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.444+0000 7f3265b6ba80 20 remove_watcher() i=5 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.444+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94895655564800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9dfcd400 con 0x564e9de34400 2024-04-19T23:45:42.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.445+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94895655564800] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.445+0000 7f3265b6ba80 20 remove_watcher() i=6 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.445+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94895655565952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564e9dfcd800 con 0x564e9de34400 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.445+0000 7f3264316700 1 -- 172.21.15.155:0/3143586542 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94895655565952] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564e9deaeb40 con 0x564e9de34400 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 20 remove_watcher() i=7 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564e9de34400 msgr2=0x564e9dd7d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x564e9de34400 0x564e9dd7d180 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564e9da93c00 msgr2=0x564e9dd7bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x564e9da93c00 0x564e9dd7bb80 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x564e9de35800 msgr2=0x564e9dd7cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x564e9de35800 0x564e9dd7cc00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x564e9de35400 msgr2=0x564e9dd7c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x564e9de35400 0x564e9dd7c100 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9de34c00 msgr2=0x564e9dd7b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9de34c00 0x564e9dd7b600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x564e9dd75890 tx=0x564e9db83800 comp rx=0 tx=0).stop 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 msgr2=0x564e9dd7ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/3143586542 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da93800 0x564e9dd7ab00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x564e9de30c30 tx=0x564e9ddde8a0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 reap_dead start 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3263314700 1 -- 172.21.15.155:0/3143586542 reap_dead start 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 shutdown_connections 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 >> 172.21.15.155:0/3143586542 conn(0x564e9da92c00 msgr2=0x564e9db7f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 shutdown_connections 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/3143586542 wait complete. 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/1100410296 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9df66000 msgr2=0x564e9dd7d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/1100410296 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9df66000 0x564e9dd7d700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x564e9deddda0 tx=0x564e9ddde900 comp rx=0 tx=0).stop 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/1100410296 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 msgr2=0x564e9dd7c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/1100410296 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x564e9dedc1e0 tx=0x564e9dddf740 comp rx=0 tx=0).stop 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/1100410296 shutdown_connections 2024-04-19T23:45:42.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/1100410296 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9df66000 0x564e9dd7d700 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/1100410296 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9de35c00 0x564e9dd7c680 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/1100410296 >> 172.21.15.155:0/1100410296 conn(0x564e9de35000 msgr2=0x564e9db80000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/1100410296 shutdown_connections 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.446+0000 7f3265b6ba80 1 -- 172.21.15.155:0/1100410296 wait complete. 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.447+0000 7f3265b6ba80 1 -- 172.21.15.155:0/666319677 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9da93400 msgr2=0x564e9dd7b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.447+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/666319677 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9da93400 0x564e9dd7b080 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x564e9e863890 tx=0x564e9ddde060 comp rx=0 tx=0).stop 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.447+0000 7f3265b6ba80 1 -- 172.21.15.155:0/666319677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 msgr2=0x564e9dd7a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.447+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/666319677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x564e9e863e30 tx=0x564e9db83a40 comp rx=0 tx=0).stop 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.447+0000 7f3265b6ba80 1 -- 172.21.15.155:0/666319677 shutdown_connections 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.447+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/666319677 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x564e9da93400 0x564e9dd7b080 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.447+0000 7f3265b6ba80 1 --2- 172.21.15.155:0/666319677 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x564e9da92800 0x564e9dd7a580 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.447+0000 7f3265b6ba80 1 -- 172.21.15.155:0/666319677 >> 172.21.15.155:0/666319677 conn(0x564e9da92400 msgr2=0x564e9db7f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.447+0000 7f3265b6ba80 1 -- 172.21.15.155:0/666319677 shutdown_connections 2024-04-19T23:45:42.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:42.447+0000 7f3265b6ba80 1 -- 172.21.15.155:0/666319677 wait complete. 2024-04-19T23:45:42.460 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:42.502 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-19T23:45:42.743 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-04-19T23:45:42.750 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:57.751 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-19T23:45:57.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-19T23:45:57.752 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-19T23:45:57.805 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:57.806 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:57.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.807+0000 7ff16bd75a80 1 Processor -- start 2024-04-19T23:45:57.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.807+0000 7ff16bd75a80 1 -- start start 2024-04-19T23:45:57.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.808+0000 7ff16bd75a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5613b224c800 0x5613b2534580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.808+0000 7ff16bd75a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5613b2577500 con 0x5613b224cc00 2024-04-19T23:45:57.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.808+0000 7ff16bd75a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5613b22eea00 con 0x5613b224c800 2024-04-19T23:45:57.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.808+0000 7ff169d1f700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5613b224c800 0x5613b2534580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.808+0000 7ff16951e700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5613b224cc00 0x5613b2338800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:33514/0 (socket says 172.21.15.155:33514) 2024-04-19T23:45:57.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.808+0000 7ff16951e700 1 -- 172.21.15.155:0/255511938 learned_addr learned my addr 172.21.15.155:0/255511938 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:57.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.808+0000 7ff169d1f700 1 -- 172.21.15.155:0/255511938 >> v1:172.21.15.76:6789/0 conn(0x5613b224cc00 legacy=0x5613b2338800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.808+0000 7ff169d1f700 1 -- 172.21.15.155:0/255511938 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613b2275d40 con 0x5613b224c800 2024-04-19T23:45:57.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.808+0000 7ff169d1f700 1 --2- 172.21.15.155:0/255511938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x5613b252f9e0 tx=0x5613b233d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f79cdf98d9cea9e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.809+0000 7ff168d1d700 1 -- 172.21.15.155:0/255511938 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b23054a0 con 0x5613b224c800 2024-04-19T23:45:57.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.809+0000 7ff168d1d700 1 -- 172.21.15.155:0/255511938 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613b2577800 con 0x5613b224c800 2024-04-19T23:45:57.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.809+0000 7ff168d1d700 1 -- 172.21.15.155:0/255511938 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b2305600 con 0x5613b224c800 2024-04-19T23:45:57.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.809+0000 7ff16bd75a80 1 -- 172.21.15.155:0/255511938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 msgr2=0x5613b2534580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.809+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/255511938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x5613b252f9e0 tx=0x5613b233d920 comp rx=0 tx=0).stop 2024-04-19T23:45:57.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.809+0000 7ff16bd75a80 1 -- 172.21.15.155:0/255511938 shutdown_connections 2024-04-19T23:45:57.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.809+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/255511938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.809+0000 7ff16bd75a80 1 -- 172.21.15.155:0/255511938 >> 172.21.15.155:0/255511938 conn(0x5613b224c400 msgr2=0x5613b2338000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:57.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.809+0000 7ff16bd75a80 1 -- 172.21.15.155:0/255511938 shutdown_connections 2024-04-19T23:45:57.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.809+0000 7ff16bd75a80 1 -- 172.21.15.155:0/255511938 wait complete. 2024-04-19T23:45:57.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.810+0000 7ff16bd75a80 1 Processor -- start 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.810+0000 7ff16bd75a80 1 -- start start 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.810+0000 7ff16bd75a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.810+0000 7ff16bd75a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b22ee500 con 0x5613b224c800 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.810+0000 7ff169d1f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.810+0000 7ff169d1f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34838/0 (socket says 172.21.15.155:34838) 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.810+0000 7ff169d1f700 1 -- 172.21.15.155:0/889698550 learned_addr learned my addr 172.21.15.155:0/889698550 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.811+0000 7ff169d1f700 1 -- 172.21.15.155:0/889698550 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613b2275ba0 con 0x5613b224c800 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.811+0000 7ff169d1f700 1 --2- 172.21.15.155:0/889698550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x5613b30240c0 tx=0x5613b233d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b67770d7dd50239 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.811+0000 7ff16851c700 1 -- 172.21.15.155:0/889698550 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b2305760 con 0x5613b224c800 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.811+0000 7ff16851c700 1 -- 172.21.15.155:0/889698550 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613b2577b00 con 0x5613b224c800 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.811+0000 7ff16851c700 1 -- 172.21.15.155:0/889698550 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b23054a0 con 0x5613b224c800 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.811+0000 7ff16bd75a80 1 -- 172.21.15.155:0/889698550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 msgr2=0x5613b2534580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.811+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/889698550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x5613b30240c0 tx=0x5613b233d800 comp rx=0 tx=0).stop 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.811+0000 7ff16bd75a80 1 -- 172.21.15.155:0/889698550 shutdown_connections 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.812+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/889698550 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.812+0000 7ff16bd75a80 1 -- 172.21.15.155:0/889698550 >> 172.21.15.155:0/889698550 conn(0x5613b224c400 msgr2=0x5613b2339000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.812+0000 7ff16bd75a80 1 -- 172.21.15.155:0/889698550 shutdown_connections 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.812+0000 7ff16bd75a80 1 -- 172.21.15.155:0/889698550 wait complete. 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.812+0000 7ff16bd75a80 1 Processor -- start 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.812+0000 7ff16bd75a80 1 -- start start 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.812+0000 7ff16bd75a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.812+0000 7ff16bd75a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b22ee3c0 con 0x5613b224c800 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.812+0000 7ff169d1f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.812+0000 7ff169d1f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34846/0 (socket says 172.21.15.155:34846) 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.812+0000 7ff169d1f700 1 -- 172.21.15.155:0/2566509361 learned_addr learned my addr 172.21.15.155:0/2566509361 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:57.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.813+0000 7ff169d1f700 1 -- 172.21.15.155:0/2566509361 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613b2275a00 con 0x5613b224c800 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.813+0000 7ff169d1f700 1 --2- 172.21.15.155:0/2566509361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x5613b30258f0 tx=0x5613b233d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.813+0000 7ff166d19700 1 -- 172.21.15.155:0/2566509361 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b2305600 con 0x5613b224c800 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.813+0000 7ff166d19700 1 -- 172.21.15.155:0/2566509361 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613b2577c80 con 0x5613b224c800 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.813+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2566509361 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613b2275860 con 0x5613b224c800 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.813+0000 7ff166d19700 1 -- 172.21.15.155:0/2566509361 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b23058c0 con 0x5613b224c800 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.813+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2566509361 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613b22756c0 con 0x5613b224c800 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.814+0000 7ff16bd75a80 1 Processor -- start 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.814+0000 7ff166d19700 1 -- 172.21.15.155:0/2566509361 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5613b2feeb00 con 0x5613b224c800 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.814+0000 7ff16bd75a80 1 -- start start 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.814+0000 7ff16bd75a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 0x5613b2534b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.814+0000 7ff166d19700 1 --2- 172.21.15.155:0/2566509361 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b25ca000 0x5613b2535080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.814+0000 7ff16bd75a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b22ee000 con 0x5613b224d400 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.814+0000 7ff166d19700 1 -- 172.21.15.155:0/2566509361 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5613b22c7180 con 0x5613b224c800 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.814+0000 7ff169d1f700 1 --2- 172.21.15.155:0/2566509361 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b25ca000 0x5613b2535080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.814+0000 7ff16a520700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 0x5613b2534b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.814+0000 7ff16a520700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 0x5613b2534b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34850/0 (socket says 172.21.15.155:34850) 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.814+0000 7ff16a520700 1 -- 172.21.15.155:0/2793648632 learned_addr learned my addr 172.21.15.155:0/2793648632 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff16a520700 1 -- 172.21.15.155:0/2793648632 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613b2274000 con 0x5613b224d400 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff169d1f700 1 --2- 172.21.15.155:0/2566509361 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b25ca000 0x5613b2535080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5613b30d8ed0 tx=0x5613b2590540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff16a520700 1 --2- 172.21.15.155:0/2793648632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 0x5613b2534b00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x5613b30d8360 tx=0x5613b2590720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d265063a836d8df server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff164514700 1 -- 172.21.15.155:0/2793648632 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b2305600 con 0x5613b224d400 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff164514700 1 -- 172.21.15.155:0/2793648632 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613b22edc80 con 0x5613b224d400 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff164514700 1 -- 172.21.15.155:0/2793648632 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b23058c0 con 0x5613b224d400 2024-04-19T23:45:57.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2793648632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 msgr2=0x5613b2534b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/2793648632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 0x5613b2534b00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x5613b30d8360 tx=0x5613b2590720 comp rx=0 tx=0).stop 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2793648632 shutdown_connections 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/2793648632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 0x5613b2534b00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2793648632 >> 172.21.15.155:0/2793648632 conn(0x5613b224cc00 msgr2=0x5613b2339800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2793648632 shutdown_connections 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.815+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2793648632 wait complete. 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.816+0000 7ff16bd75a80 1 Processor -- start 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.816+0000 7ff16bd75a80 1 -- start start 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.816+0000 7ff16bd75a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 0x5613b2534b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.816+0000 7ff16bd75a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2288640 con 0x5613b224d400 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.816+0000 7ff16a520700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 0x5613b2534b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.816+0000 7ff16a520700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 0x5613b2534b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34860/0 (socket says 172.21.15.155:34860) 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.816+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 learned_addr learned my addr 172.21.15.155:0/3247391365 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.816+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613b2274ea0 con 0x5613b224d400 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.817+0000 7ff16a520700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 0x5613b2534b00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x5613b30d9e60 tx=0x5613b233d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.817+0000 7ff162d11700 1 -- 172.21.15.155:0/3247391365 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b2305760 con 0x5613b224d400 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.817+0000 7ff162d11700 1 -- 172.21.15.155:0/3247391365 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613b22edb00 con 0x5613b224d400 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.817+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613b2274820 con 0x5613b224d400 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.817+0000 7ff162d11700 1 -- 172.21.15.155:0/3247391365 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b2305600 con 0x5613b224d400 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.817+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613b22749c0 con 0x5613b224d400 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.818+0000 7ff162d11700 1 -- 172.21.15.155:0/3247391365 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5613b2feedc0 con 0x5613b224d400 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.818+0000 7ff16bd75a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.818+0000 7ff162d11700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b25cac00 0x5613b2535600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.818+0000 7ff162d11700 1 -- 172.21.15.155:0/3247391365 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5613b22c7340 con 0x5613b224d400 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.818+0000 7ff16951e700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b25cac00 0x5613b2535600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.818+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5613b224d800 0x5613b2535b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.818+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b224dc00 con 0x5613b224d800 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.818+0000 7ff16a520700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5613b224d800 0x5613b2535b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16951e700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b25cac00 0x5613b2535600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5613b25dbd70 tx=0x5613b2591320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16a520700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5613b224d800 0x5613b2535b80 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16bd75a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16bd75a80 20 realm 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16bd75a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cb000 con 0x5613b224d800 2024-04-19T23:45:57.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16bd75a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16bd75a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16bd75a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.819+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cb400 con 0x5613b224d800 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16bd75a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16bd75a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cb800 con 0x5613b224d800 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16bd75a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16bd75a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cbc00 con 0x5613b224d800 2024-04-19T23:45:57.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16bd75a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:57.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16bd75a80 20 searching for the correct realm 2024-04-19T23:45:57.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5613b25cb000 0x5613b2536100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.820+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cb400 con 0x5613b25cb000 2024-04-19T23:45:57.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.821+0000 7ff169d1f700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5613b25cb000 0x5613b2536100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.821+0000 7ff169d1f700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5613b25cb000 0x5613b2536100 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.821+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.821+0000 7ff169d1f700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5613b25cb400 0x5613b2536c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.821+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2000 con 0x5613b25cb400 2024-04-19T23:45:57.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.821+0000 7ff16951e700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5613b25cb400 0x5613b2536c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.822+0000 7ff16951e700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5613b25cb400 0x5613b2536c00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.822+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.822+0000 7ff16951e700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5613b30f2000 0x5613b2537180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.822+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b30f2000 2024-04-19T23:45:57.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.822+0000 7ff16a520700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5613b30f2000 0x5613b2537180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.823+0000 7ff16a520700 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5613b30f2000 0x5613b2537180 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.823+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.823+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b224d800 2024-04-19T23:45:57.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.823+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.823+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b224d800 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.824+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.824+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b30f2000 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.824+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.824+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b30f2000 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.824+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.824+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb400 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.824+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.824+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb000 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.825+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.825+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b224d800 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.825+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.825+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b30f2000 2024-04-19T23:45:57.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.825+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.825+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b224d800 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.826+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.826+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb400 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.826+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.826+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb000 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.826+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.826+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb000 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.826+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.826+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b30f2000 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.827+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.827+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb000 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.827+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.827+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb000 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.827+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.827+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b224d800 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.827+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.827+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b224d800 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.828+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.828+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b30f2000 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.828+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.828+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb000 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.828+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.828+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb400 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.829+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.829+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b224d800 2024-04-19T23:45:57.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.829+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.829+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b30f2000 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.829+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.829+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb000 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.829+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.829+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b30f2000 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.830+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.830+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb400 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.830+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.830+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb000 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.830+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.830+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b30f2000 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.831+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.831+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b224d800 2024-04-19T23:45:57.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.831+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.831+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb400 2024-04-19T23:45:57.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:57.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:57.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:57.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:57.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:57.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b224dc00 con 0x5613b224d800 2024-04-19T23:45:57.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2c00 con 0x5613b224d800 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.832+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3000 con 0x5613b25cb400 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 20 zone default found 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 4 Realm: () 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:57.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 20 zonegroup default 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3400 con 0x5613b30f2000 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3800 con 0x5613b25cb000 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.833+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3c00 con 0x5613b25cb000 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.834+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.834+0000 7ff16bd75a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:57.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.834+0000 7ff16bd75a80 20 started sync module instance, tier type = 2024-04-19T23:45:57.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.834+0000 7ff16bd75a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:57.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.834+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2c00 con 0x5613b25cb400 2024-04-19T23:45:57.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.835+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.835+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94642596133632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b224dc00 con 0x5613b25cb400 2024-04-19T23:45:57.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.835+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cb800 con 0x5613b224d800 2024-04-19T23:45:57.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.836+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94642596133632] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.836+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.836+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94642596134784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cbc00 con 0x5613b224d800 2024-04-19T23:45:57.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.836+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b25cb000 2024-04-19T23:45:57.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.838+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94642596134784] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.838+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.838+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94642596135936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3000 con 0x5613b25cb000 2024-04-19T23:45:57.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.838+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2c00 con 0x5613b25cb400 2024-04-19T23:45:57.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.839+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94642596135936] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.839+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.839+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94642596137088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2400 con 0x5613b25cb400 2024-04-19T23:45:57.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.839+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3800 con 0x5613b224d800 2024-04-19T23:45:57.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.840+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94642596137088] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.840+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.840+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94642596138240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3c00 con 0x5613b224d800 2024-04-19T23:45:57.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.840+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2800 con 0x5613b30f2000 2024-04-19T23:45:57.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.842+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94642596138240] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.842+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.842+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94642596139392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3400 con 0x5613b30f2000 2024-04-19T23:45:57.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.842+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3800 con 0x5613b30f2000 2024-04-19T23:45:57.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.843+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94642596139392] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.843+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.843+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94642596140544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3c00 con 0x5613b30f2000 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.843+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cb800 con 0x5613b30f2000 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.844+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94642596140544] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.844+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.844+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94642596141696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cbc00 con 0x5613b30f2000 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.844+0000 7ff16bd75a80 20 add_watcher() i=0 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.844+0000 7ff16bd75a80 20 add_watcher() i=1 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.844+0000 7ff16bd75a80 20 add_watcher() i=2 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.844+0000 7ff16bd75a80 20 add_watcher() i=3 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.844+0000 7ff16bd75a80 20 add_watcher() i=4 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.844+0000 7ff16bd75a80 20 add_watcher() i=5 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.844+0000 7ff16bd75a80 20 add_watcher() i=6 2024-04-19T23:45:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.845+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94642596141696] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.845+0000 7ff16bd75a80 20 add_watcher() i=7 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.845+0000 7ff16bd75a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.845+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cb800 con 0x5613b224d800 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.846+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.846+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94642597658624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cbc00 con 0x5613b224d800 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.847+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94642597658624] v30'153 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.847+0000 7ff150ced700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.847+0000 7ff16bd75a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.847+0000 7ff16bd75a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.847+0000 7ff16bd75a80 1 Processor -- start 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.847+0000 7ff16bd75a80 1 -- start start 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.847+0000 7ff16bd75a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.848+0000 7ff16bd75a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2288780 con 0x5613b30f3400 2024-04-19T23:45:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.848+0000 7ff16951e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.848+0000 7ff16951e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34870/0 (socket says 172.21.15.155:34870) 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.848+0000 7ff16951e700 1 -- 172.21.15.155:0/189280339 learned_addr learned my addr 172.21.15.155:0/189280339 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.848+0000 7ff16951e700 1 -- 172.21.15.155:0/189280339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613b2274b60 con 0x5613b30f3400 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.848+0000 7ff16951e700 1 --2- 172.21.15.155:0/189280339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x5613b26a46c0 tx=0x5613b2591680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d168d7ef2ef5063 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.848+0000 7ff1504ec700 1 -- 172.21.15.155:0/189280339 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b26b8000 con 0x5613b30f3400 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.849+0000 7ff1504ec700 1 -- 172.21.15.155:0/189280339 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613b26ba000 con 0x5613b30f3400 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.849+0000 7ff1504ec700 1 -- 172.21.15.155:0/189280339 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b26b8160 con 0x5613b30f3400 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.849+0000 7ff16bd75a80 1 -- 172.21.15.155:0/189280339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 msgr2=0x5613b2536680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.849+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/189280339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x5613b26a46c0 tx=0x5613b2591680 comp rx=0 tx=0).stop 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.849+0000 7ff16bd75a80 1 -- 172.21.15.155:0/189280339 shutdown_connections 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.849+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/189280339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.849+0000 7ff16bd75a80 1 -- 172.21.15.155:0/189280339 >> 172.21.15.155:0/189280339 conn(0x5613b30f2800 msgr2=0x5613b233a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.849+0000 7ff16bd75a80 1 -- 172.21.15.155:0/189280339 shutdown_connections 2024-04-19T23:45:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.849+0000 7ff16bd75a80 1 -- 172.21.15.155:0/189280339 wait complete. 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.850+0000 7ff16bd75a80 1 Processor -- start 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.850+0000 7ff16bd75a80 1 -- start start 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.850+0000 7ff16bd75a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.850+0000 7ff16bd75a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b22ee000 con 0x5613b30f3400 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.850+0000 7ff16951e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.850+0000 7ff16951e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34876/0 (socket says 172.21.15.155:34876) 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.850+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 learned_addr learned my addr 172.21.15.155:0/1674338878 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.850+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613b2274d00 con 0x5613b30f3400 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.851+0000 7ff16951e700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x5613b26a5380 tx=0x5613b25917a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.851+0000 7ff14ece9700 1 -- 172.21.15.155:0/1674338878 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b26b82c0 con 0x5613b30f3400 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.851+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613b2274340 con 0x5613b30f3400 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.851+0000 7ff14ece9700 1 -- 172.21.15.155:0/1674338878 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613b26ba180 con 0x5613b30f3400 2024-04-19T23:45:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.851+0000 7ff14ece9700 1 -- 172.21.15.155:0/1674338878 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5613b26b8000 con 0x5613b30f3400 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.851+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613b2274b60 con 0x5613b30f3400 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.852+0000 7ff14ece9700 1 -- 172.21.15.155:0/1674338878 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5613b2fefb80 con 0x5613b30f3400 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.852+0000 7ff14ece9700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b273a000 0x5613b2537700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.852+0000 7ff14ece9700 1 -- 172.21.15.155:0/1674338878 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5613b22c7500 con 0x5613b30f3400 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.852+0000 7ff16a520700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b273a000 0x5613b2537700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.852+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5613b30f3800 0x5613b2750000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.852+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3c00 con 0x5613b30f3800 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.852+0000 7ff169d1f700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5613b30f3800 0x5613b2750000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.852+0000 7ff16a520700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b273a000 0x5613b2537700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5613b2635e30 tx=0x5613b25914a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.852+0000 7ff169d1f700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5613b30f3800 0x5613b2750000 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.854+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.854+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5613b273a400 0x5613b2750580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.854+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273a800 con 0x5613b273a400 2024-04-19T23:45:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.854+0000 7ff16951e700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5613b273a400 0x5613b2750580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.854+0000 7ff16951e700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5613b273a400 0x5613b2750580 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.855+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.855+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5613b273ac00 0x5613b2750b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.856+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b000 con 0x5613b273ac00 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.856+0000 7ff16a520700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5613b273ac00 0x5613b2750b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.856+0000 7ff16a520700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5613b273ac00 0x5613b2750b00 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.857+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.857+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b400 con 0x5613b30f3800 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.858+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'154 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.858+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5613b273b800 0x5613b2751080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.858+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273bc00 con 0x5613b273b800 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.858+0000 7ff169d1f700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5613b273b800 0x5613b2751080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.858+0000 7ff169d1f700 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5613b273b800 0x5613b2751080 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.859+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'44 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.859+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e000 con 0x5613b273ac00 2024-04-19T23:45:57.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.860+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'29 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.860+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e400 con 0x5613b30f3800 2024-04-19T23:45:57.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.862+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.862+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e800 con 0x5613b273a400 2024-04-19T23:45:57.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.863+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'29 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.863+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275ec00 con 0x5613b273b800 2024-04-19T23:45:57.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.864+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.864+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f000 con 0x5613b273ac00 2024-04-19T23:45:57.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.865+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.865+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f400 con 0x5613b273b800 2024-04-19T23:45:57.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.866+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'45 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.866+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f800 con 0x5613b273a400 2024-04-19T23:45:57.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.867+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.867+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275fc00 con 0x5613b273b800 2024-04-19T23:45:57.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.868+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.868+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e800 con 0x5613b273a400 2024-04-19T23:45:57.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.869+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'38 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.869+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e400 con 0x5613b30f3800 2024-04-19T23:45:57.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.870+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'155 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.870+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273a800 con 0x5613b273ac00 2024-04-19T23:45:57.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.871+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'42 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.871+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b400 con 0x5613b273b800 2024-04-19T23:45:57.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.872+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'46 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.872+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273bc00 con 0x5613b273ac00 2024-04-19T23:45:57.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.873+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.873+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2c00 con 0x5613b30f3800 2024-04-19T23:45:57.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.874+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.874+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3000 con 0x5613b30f3800 2024-04-19T23:45:57.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.875+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'156 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.875+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3c00 con 0x5613b273ac00 2024-04-19T23:45:57.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.876+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'43 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.876+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b224dc00 con 0x5613b273b800 2024-04-19T23:45:57.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.877+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.877+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b400 con 0x5613b273ac00 2024-04-19T23:45:57.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.878+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.878+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b000 con 0x5613b273ac00 2024-04-19T23:45:57.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.879+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.879+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273a800 con 0x5613b273ac00 2024-04-19T23:45:57.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.880+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.880+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273bc00 con 0x5613b273ac00 2024-04-19T23:45:57.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.881+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.881+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275ec00 con 0x5613b273a400 2024-04-19T23:45:57.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.882+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.882+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f400 con 0x5613b273ac00 2024-04-19T23:45:57.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.883+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.883+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275fc00 con 0x5613b273a400 2024-04-19T23:45:57.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.884+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.884+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e400 con 0x5613b273ac00 2024-04-19T23:45:57.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.885+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'44 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.885+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e000 con 0x5613b273a400 2024-04-19T23:45:57.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.886+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'39 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.886+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f000 con 0x5613b273b800 2024-04-19T23:45:57.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.888+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.888+0000 7ff14c4e4700 20 reqs_thread_entry: start 2024-04-19T23:45:57.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.889+0000 7ff16bd75a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:57.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.889+0000 7ff16bd75a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:57.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.889+0000 7ff14a4e0700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:28 2024 2024-04-19T23:45:57.889 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:57.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.889+0000 7ff149cbe700 20 reqs_thread_entry: start 2024-04-19T23:45:57.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.889+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:33 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cbc00 con 0x5613b30f3800 2024-04-19T23:45:57.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.889+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(33 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.889+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:34 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2c00 con 0x5613b30f3800 2024-04-19T23:45:57.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.889+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(34 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.889+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:35 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f800 con 0x5613b30f3800 2024-04-19T23:45:57.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.890+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(35 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.890+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:36 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e800 con 0x5613b273a400 2024-04-19T23:45:57.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.890+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(36 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.890+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:37 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275ec00 con 0x5613b273a400 2024-04-19T23:45:57.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.890+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(37 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.890+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:38 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275fc00 con 0x5613b273a400 2024-04-19T23:45:57.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.891+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(38 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.891+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:39 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e000 con 0x5613b273ac00 2024-04-19T23:45:57.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.891+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(39 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.891+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:40 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f400 con 0x5613b273ac00 2024-04-19T23:45:57.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.891+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(40 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.891+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:41 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e400 con 0x5613b273ac00 2024-04-19T23:45:57.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.892+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(41 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.892+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:42 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e000 con 0x5613b30f3800 2024-04-19T23:45:57.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.892+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(42 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.892+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:43 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b400 con 0x5613b30f3800 2024-04-19T23:45:57.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.892+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(43 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.892+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:44 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b000 con 0x5613b30f3800 2024-04-19T23:45:57.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.892+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(44 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.892+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273a800 con 0x5613b273b800 2024-04-19T23:45:57.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.893+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(45 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.893+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:46 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273bc00 con 0x5613b273b800 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.893+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(46 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.893+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:47 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3c00 con 0x5613b273b800 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.893+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(47 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.893+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f000 con 0x5613b273ac00 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.893+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(48 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.893+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f800 con 0x5613b273ac00 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.894+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(49 gc.5 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.894+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:50 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e000 con 0x5613b273ac00 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.894+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(50 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.894+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:51 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3000 con 0x5613b30f3800 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.894+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(51 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.894+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2c00 con 0x5613b30f3800 2024-04-19T23:45:57.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.895+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(52 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.895+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cbc00 con 0x5613b30f3800 2024-04-19T23:45:57.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.895+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(53 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.895+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b224dc00 con 0x5613b273a400 2024-04-19T23:45:57.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.895+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.895+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cbc00 con 0x5613b273a400 2024-04-19T23:45:57.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.895+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.896+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3c00 con 0x5613b273a400 2024-04-19T23:45:57.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.896+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.896+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:57 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3000 con 0x5613b273b800 2024-04-19T23:45:57.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.896+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(57 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.896+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:58 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2c00 con 0x5613b273b800 2024-04-19T23:45:57.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.896+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(58 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.896+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:59 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b400 con 0x5613b273b800 2024-04-19T23:45:57.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.897+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(59 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.897+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:60 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b000 con 0x5613b273ac00 2024-04-19T23:45:57.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.897+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(60 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.897+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:61 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273a800 con 0x5613b273ac00 2024-04-19T23:45:57.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.897+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(61 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.897+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:62 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273bc00 con 0x5613b273ac00 2024-04-19T23:45:57.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.897+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(62 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.897+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3c00 con 0x5613b273b800 2024-04-19T23:45:57.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.898+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(63 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.898+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cbc00 con 0x5613b273b800 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.898+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(64 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.898+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b224dc00 con 0x5613b273b800 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.898+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(65 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.898+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:66 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e800 con 0x5613b273a400 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.898+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(66 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.898+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275ec00 con 0x5613b273a400 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.899+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(67 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.899+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:68 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275fc00 con 0x5613b273a400 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.899+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(68 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.899+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6000 con 0x5613b273b800 2024-04-19T23:45:57.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.899+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(69 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.899+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6400 con 0x5613b273b800 2024-04-19T23:45:57.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.900+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(70 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.900+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6800 con 0x5613b273b800 2024-04-19T23:45:57.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.900+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(71 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.900+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6c00 con 0x5613b273a400 2024-04-19T23:45:57.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.900+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(72 gc.13 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.900+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f7000 con 0x5613b273a400 2024-04-19T23:45:57.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.900+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(73 gc.13 [call out=24b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.901+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f7400 con 0x5613b273a400 2024-04-19T23:45:57.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.901+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(74 gc.13 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.901+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f7800 con 0x5613b30f3800 2024-04-19T23:45:57.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.901+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(75 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.901+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f7c00 con 0x5613b30f3800 2024-04-19T23:45:57.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.901+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(76 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.901+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:77 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6000 con 0x5613b30f3800 2024-04-19T23:45:57.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.902+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(77 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.902+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:78 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6400 con 0x5613b273ac00 2024-04-19T23:45:57.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.902+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== osd_op_reply(78 gc.15 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.902+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:79 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6800 con 0x5613b273ac00 2024-04-19T23:45:57.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.902+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(79 gc.15 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.902+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:80 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b224dc00 con 0x5613b273ac00 2024-04-19T23:45:57.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.902+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(80 gc.15 [call out=1702b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+1702 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.902+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:81 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cbc00 con 0x5613b273b800 2024-04-19T23:45:57.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.903+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 20 ==== osd_op_reply(81 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.903+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:82 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3000 con 0x5613b273b800 2024-04-19T23:45:57.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.903+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 21 ==== osd_op_reply(82 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.903+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:83 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2c00 con 0x5613b273b800 2024-04-19T23:45:57.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.903+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 22 ==== osd_op_reply(83 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.903+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:84 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3c00 con 0x5613b273ac00 2024-04-19T23:45:57.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.903+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 25 ==== osd_op_reply(84 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.903+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:85 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b400 con 0x5613b273ac00 2024-04-19T23:45:57.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.904+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 26 ==== osd_op_reply(85 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.904+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:86 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6400 con 0x5613b273ac00 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.904+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 27 ==== osd_op_reply(86 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.904+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:87 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b000 con 0x5613b30f3800 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.904+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(87 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.904+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:88 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273a800 con 0x5613b30f3800 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.904+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(88 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.904+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:89 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273bc00 con 0x5613b30f3800 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.905+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(89 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.905+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:90 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f400 con 0x5613b30f3800 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.905+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(90 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.905+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:91 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e400 con 0x5613b30f3800 2024-04-19T23:45:57.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.905+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(91 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.905+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:92 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f000 con 0x5613b30f3800 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.905+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(92 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b30f3800 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.905+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:93 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f800 con 0x5613b273ac00 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.906+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 28 ==== osd_op_reply(93 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.906+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e000 con 0x5613b273ac00 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.906+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 29 ==== osd_op_reply(94 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.906+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f400 con 0x5613b273ac00 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.906+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 30 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.906+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:96 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b000 con 0x5613b273b800 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.906+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 23 ==== osd_op_reply(96 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.906+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:97 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273a800 con 0x5613b273b800 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.907+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 24 ==== osd_op_reply(97 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.907+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:98 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273bc00 con 0x5613b273b800 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.907+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 25 ==== osd_op_reply(98 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.907+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:99 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3000 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.907+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 31 ==== osd_op_reply(99 gc.22 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.907+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:100 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2c00 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.907+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 32 ==== osd_op_reply(100 gc.22 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.907+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:101 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cbc00 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.908+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 33 ==== osd_op_reply(101 gc.22 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.908+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:102 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f7800 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.908+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 34 ==== osd_op_reply(102 gc.23 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.908+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:103 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f7c00 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.908+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 35 ==== osd_op_reply(103 gc.23 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.908+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:104 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6000 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.908+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 36 ==== osd_op_reply(104 gc.23 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.908+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3c00 con 0x5613b273ac00 2024-04-19T23:45:57.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.909+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 37 ==== osd_op_reply(105 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.909+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:106 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3000 con 0x5613b273ac00 2024-04-19T23:45:57.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.909+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 38 ==== osd_op_reply(106 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.909+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:107 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2c00 con 0x5613b273ac00 2024-04-19T23:45:57.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.909+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 39 ==== osd_op_reply(107 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.909+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f800 con 0x5613b273ac00 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.909+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 40 ==== osd_op_reply(108 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.909+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e000 con 0x5613b273ac00 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.910+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 41 ==== osd_op_reply(109 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.910+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f400 con 0x5613b273ac00 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.910+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 42 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.910+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:111 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6800 con 0x5613b273a400 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.910+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(111 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.910+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6400 con 0x5613b273a400 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.911+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(112 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.911+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b273b400 con 0x5613b273a400 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.911+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.911+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b224dc00 con 0x5613b273ac00 2024-04-19T23:45:57.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.912+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 43 ==== osd_op_reply(114 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.912+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f7800 con 0x5613b273ac00 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.912+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 44 ==== osd_op_reply(115 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.912+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f7c00 con 0x5613b273ac00 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.912+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 45 ==== osd_op_reply(116 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.912+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6000 con 0x5613b273a400 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.912+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(117 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.912+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6c00 con 0x5613b273a400 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.913+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(118 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.913+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f7000 con 0x5613b273a400 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.913+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(119 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.913+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:120 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f7400 con 0x5613b273ac00 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.913+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 46 ==== osd_op_reply(120 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.913+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:121 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6800 con 0x5613b273ac00 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.914+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 47 ==== osd_op_reply(121 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.914+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:122 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f800 con 0x5613b273ac00 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.914+0000 7ff16a520700 1 -- 172.21.15.155:0/1674338878 <== osd.3 v2:172.21.15.155:6808/41835 48 ==== osd_op_reply(122 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267a900 con 0x5613b273ac00 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.914+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:123 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e000 con 0x5613b273a400 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.914+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(123 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.914+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:124 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f400 con 0x5613b273a400 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.914+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(124 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.914+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:125 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e800 con 0x5613b273a400 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.915+0000 7ff16951e700 1 -- 172.21.15.155:0/1674338878 <== osd.0 v2:172.21.15.76:6800/39408 28 ==== osd_op_reply(125 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267b200 con 0x5613b273a400 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.915+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:126 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275ec00 con 0x5613b273b800 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.915+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 26 ==== osd_op_reply(126 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.915+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:127 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275fc00 con 0x5613b273b800 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.915+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 27 ==== osd_op_reply(127 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.915+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:128 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b224dc00 con 0x5613b273b800 2024-04-19T23:45:57.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.915+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 <== osd.2 v2:172.21.15.155:6812/41834 28 ==== osd_op_reply(128 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x5613b267afc0 con 0x5613b273b800 2024-04-19T23:45:57.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.916+0000 7ff150ced700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:57.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.916+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94642597658624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3c00 con 0x5613b224d800 2024-04-19T23:45:57.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.917+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 data_loggenerations_metadata [watch unwatch cookie 94642597658624] v30'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.917+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94642596133632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f3000 con 0x5613b25cb400 2024-04-19T23:45:57.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.918+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 notify.0 [watch unwatch cookie 94642596133632] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.918+0000 7ff16bd75a80 20 remove_watcher() i=0 2024-04-19T23:45:57.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.918+0000 7ff16bd75a80 2 removed watcher, disabling cache 2024-04-19T23:45:57.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.918+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94642596134784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b30f2c00 con 0x5613b224d800 2024-04-19T23:45:57.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.919+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 notify.1 [watch unwatch cookie 94642596134784] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.919+0000 7ff16bd75a80 20 remove_watcher() i=1 2024-04-19T23:45:57.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.919+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94642596135936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b25cbc00 con 0x5613b25cb000 2024-04-19T23:45:57.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.921+0000 7ff169d1f700 1 -- 172.21.15.155:0/3247391365 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(65 notify.2 [watch unwatch cookie 94642596135936] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267afc0 con 0x5613b25cb000 2024-04-19T23:45:57.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.921+0000 7ff16bd75a80 20 remove_watcher() i=2 2024-04-19T23:45:57.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.921+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94642596137088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e000 con 0x5613b25cb400 2024-04-19T23:45:57.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.921+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(66 notify.3 [watch unwatch cookie 94642596137088] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267b200 con 0x5613b25cb400 2024-04-19T23:45:57.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.922+0000 7ff16bd75a80 20 remove_watcher() i=3 2024-04-19T23:45:57.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.922+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94642596138240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275f400 con 0x5613b224d800 2024-04-19T23:45:57.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.923+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(67 notify.4 [watch unwatch cookie 94642596138240] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b224d800 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.923+0000 7ff16bd75a80 20 remove_watcher() i=4 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.923+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94642596139392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b275e800 con 0x5613b30f2000 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.924+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(68 notify.5 [watch unwatch cookie 94642596139392] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.924+0000 7ff16bd75a80 20 remove_watcher() i=5 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.924+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94642596140544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6400 con 0x5613b30f2000 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.925+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(69 notify.6 [watch unwatch cookie 94642596140544] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.925+0000 7ff16bd75a80 20 remove_watcher() i=6 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.925+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94642596141696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613b27f6000 con 0x5613b30f2000 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16a520700 1 -- 172.21.15.155:0/3247391365 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(70 notify.7 [watch unwatch cookie 94642596141696] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5613b267a900 con 0x5613b30f2000 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 20 remove_watcher() i=7 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5613b30f2000 msgr2=0x5613b2537180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5613b30f2000 0x5613b2537180 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5613b224d800 msgr2=0x5613b2535b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5613b224d800 0x5613b2535b80 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5613b25cb400 msgr2=0x5613b2536c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5613b25cb400 0x5613b2536c00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5613b25cb000 msgr2=0x5613b2536100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5613b25cb000 0x5613b2536100 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b25cac00 msgr2=0x5613b2535600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b25cac00 0x5613b2535600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5613b25dbd70 tx=0x5613b2591320 comp rx=0 tx=0).stop 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 msgr2=0x5613b2534b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/3247391365 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224d400 0x5613b2534b00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x5613b30d9e60 tx=0x5613b233d8c0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 reap_dead start 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16951e700 1 -- 172.21.15.155:0/3247391365 reap_dead start 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 shutdown_connections 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.926+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 >> 172.21.15.155:0/3247391365 conn(0x5613b224cc00 msgr2=0x5613b2339800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:57.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 shutdown_connections 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/3247391365 wait complete. 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5613b273a400 msgr2=0x5613b2750580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5613b273a400 0x5613b2750580 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5613b30f3800 msgr2=0x5613b2750000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5613b30f3800 0x5613b2750000 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5613b273b800 msgr2=0x5613b2751080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5613b273b800 0x5613b2751080 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5613b273ac00 msgr2=0x5613b2750b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5613b273ac00 0x5613b2750b00 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b273a000 msgr2=0x5613b2537700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b273a000 0x5613b2537700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5613b2635e30 tx=0x5613b25914a0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 msgr2=0x5613b2536680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x5613b26a5380 tx=0x5613b25917a0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff169d1f700 1 -- 172.21.15.155:0/1674338878 reap_dead start 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 shutdown_connections 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/1674338878 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b30f3400 0x5613b2536680 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 >> 172.21.15.155:0/1674338878 conn(0x5613b30f2800 msgr2=0x5613b233a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 shutdown_connections 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/1674338878 wait complete. 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2566509361 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b25ca000 msgr2=0x5613b2535080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/2566509361 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b25ca000 0x5613b2535080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5613b30d8ed0 tx=0x5613b2590540 comp rx=0 tx=0).stop 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2566509361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 msgr2=0x5613b2534580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/2566509361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x5613b30258f0 tx=0x5613b233d920 comp rx=0 tx=0).stop 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2566509361 shutdown_connections 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/2566509361 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5613b25ca000 0x5613b2535080 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 --2- 172.21.15.155:0/2566509361 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5613b224c800 0x5613b2534580 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.927+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2566509361 >> 172.21.15.155:0/2566509361 conn(0x5613b224c400 msgr2=0x5613b2339000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:57.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.928+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2566509361 shutdown_connections 2024-04-19T23:45:57.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.928+0000 7ff16bd75a80 1 -- 172.21.15.155:0/2566509361 wait complete. 2024-04-19T23:45:57.934 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: "tag": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4221.16278617288898541022\u0000", 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:45:57.750478+0000", 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: "objs": [ 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: "pool": "default.rgw.buckets.data", 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: "oid": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_1", 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "", 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: "instance": "" 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: "pool": "default.rgw.buckets.data", 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: "oid": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_2", 2024-04-19T23:45:57.935 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "", 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: "instance": "" 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: "pool": "default.rgw.buckets.data", 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: "oid": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_3", 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "", 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: "instance": "" 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: "pool": "default.rgw.buckets.data", 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: "oid": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_4", 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "", 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: "instance": "" 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:57.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: "pool": "default.rgw.buckets.data", 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: "oid": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_5", 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "", 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: "instance": "" 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: "pool": "default.rgw.buckets.data", 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: "oid": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_6", 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "", 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: "instance": "" 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: "pool": "default.rgw.buckets.data", 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: "oid": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_7", 2024-04-19T23:45:57.937 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "", 2024-04-19T23:45:57.938 INFO:teuthology.orchestra.run.smithi155.stdout: "instance": "" 2024-04-19T23:45:57.938 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:57.938 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:45:57.938 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:57.938 INFO:teuthology.orchestra.run.smithi155.stdout:] 2024-04-19T23:45:57.938 DEBUG:tasks.util.rgw: json result: [{'tag': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4221.16278617288898541022\x00', 'time': '2024-04-19T23:45:57.750478+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_7', 'key': '', 'instance': ''}]}] 2024-04-19T23:45:57.938 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-04-19T23:45:57.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-04-19T23:45:57.939 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-04-19T23:45:57.982 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:57.982 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:57.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.984+0000 7fe636417a80 1 Processor -- start 2024-04-19T23:45:57.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.984+0000 7fe636417a80 1 -- start start 2024-04-19T23:45:57.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.984+0000 7fe636417a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x558804f54800 0x55880523c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.984+0000 7fe636417a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55880527f500 con 0x558804f54c00 2024-04-19T23:45:57.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.984+0000 7fe636417a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x558804ff6a00 con 0x558804f54800 2024-04-19T23:45:57.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.984+0000 7fe6343c1700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x558804f54800 0x55880523c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.985+0000 7fe633bc0700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x558804f54c00 0x558805040800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:33516/0 (socket says 172.21.15.155:33516) 2024-04-19T23:45:57.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.985+0000 7fe633bc0700 1 -- 172.21.15.155:0/2385069595 learned_addr learned my addr 172.21.15.155:0/2385069595 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:57.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.985+0000 7fe6343c1700 1 -- 172.21.15.155:0/2385069595 >> v1:172.21.15.76:6789/0 conn(0x558804f54c00 legacy=0x558805040800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.985+0000 7fe6343c1700 1 -- 172.21.15.155:0/2385069595 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558804f7dd40 con 0x558804f54800 2024-04-19T23:45:57.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.985+0000 7fe6343c1700 1 --2- 172.21.15.155:0/2385069595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x5588052379e0 tx=0x558805045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f81dc6a8f896be server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.985+0000 7fe6333bf700 1 -- 172.21.15.155:0/2385069595 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55880500d4a0 con 0x558804f54800 2024-04-19T23:45:57.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.985+0000 7fe6333bf700 1 -- 172.21.15.155:0/2385069595 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55880527f800 con 0x558804f54800 2024-04-19T23:45:57.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.985+0000 7fe6333bf700 1 -- 172.21.15.155:0/2385069595 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55880500d600 con 0x558804f54800 2024-04-19T23:45:57.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.986+0000 7fe636417a80 1 -- 172.21.15.155:0/2385069595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 msgr2=0x55880523c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.986+0000 7fe636417a80 1 --2- 172.21.15.155:0/2385069595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x5588052379e0 tx=0x558805045920 comp rx=0 tx=0).stop 2024-04-19T23:45:57.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.986+0000 7fe636417a80 1 -- 172.21.15.155:0/2385069595 shutdown_connections 2024-04-19T23:45:57.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.986+0000 7fe636417a80 1 --2- 172.21.15.155:0/2385069595 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:57.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.986+0000 7fe636417a80 1 -- 172.21.15.155:0/2385069595 >> 172.21.15.155:0/2385069595 conn(0x558804f54400 msgr2=0x558805040000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:57.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.986+0000 7fe636417a80 1 -- 172.21.15.155:0/2385069595 shutdown_connections 2024-04-19T23:45:57.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.986+0000 7fe636417a80 1 -- 172.21.15.155:0/2385069595 wait complete. 2024-04-19T23:45:57.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.986+0000 7fe636417a80 1 Processor -- start 2024-04-19T23:45:57.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.986+0000 7fe636417a80 1 -- start start 2024-04-19T23:45:57.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.986+0000 7fe636417a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.986+0000 7fe636417a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804ff6500 con 0x558804f54800 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.987+0000 7fe6343c1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.987+0000 7fe6343c1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34898/0 (socket says 172.21.15.155:34898) 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.987+0000 7fe6343c1700 1 -- 172.21.15.155:0/986440530 learned_addr learned my addr 172.21.15.155:0/986440530 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.987+0000 7fe6343c1700 1 -- 172.21.15.155:0/986440530 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558804f7dba0 con 0x558804f54800 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.987+0000 7fe6343c1700 1 --2- 172.21.15.155:0/986440530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x558805d2d740 tx=0x558805045800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f516fd83a02c34 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.987+0000 7fe632bbe700 1 -- 172.21.15.155:0/986440530 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55880500d760 con 0x558804f54800 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.987+0000 7fe632bbe700 1 -- 172.21.15.155:0/986440530 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55880527fb00 con 0x558804f54800 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.987+0000 7fe632bbe700 1 -- 172.21.15.155:0/986440530 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55880500d1e0 con 0x558804f54800 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe636417a80 1 -- 172.21.15.155:0/986440530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 msgr2=0x55880523c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe636417a80 1 --2- 172.21.15.155:0/986440530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x558805d2d740 tx=0x558805045800 comp rx=0 tx=0).stop 2024-04-19T23:45:57.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe636417a80 1 -- 172.21.15.155:0/986440530 shutdown_connections 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe636417a80 1 --2- 172.21.15.155:0/986440530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe636417a80 1 -- 172.21.15.155:0/986440530 >> 172.21.15.155:0/986440530 conn(0x558804f54400 msgr2=0x558805041000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe636417a80 1 -- 172.21.15.155:0/986440530 shutdown_connections 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe636417a80 1 -- 172.21.15.155:0/986440530 wait complete. 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe636417a80 1 Processor -- start 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe636417a80 1 -- start start 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe636417a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe636417a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804ff63c0 con 0x558804f54800 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe6343c1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe6343c1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34910/0 (socket says 172.21.15.155:34910) 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.988+0000 7fe6343c1700 1 -- 172.21.15.155:0/2497114416 learned_addr learned my addr 172.21.15.155:0/2497114416 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.989+0000 7fe6343c1700 1 -- 172.21.15.155:0/2497114416 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558804f7da00 con 0x558804f54800 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.989+0000 7fe6343c1700 1 --2- 172.21.15.155:0/2497114416 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x558805d2d5f0 tx=0x558805045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.989+0000 7fe6313bb700 1 -- 172.21.15.155:0/2497114416 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55880500d4a0 con 0x558804f54800 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.989+0000 7fe6313bb700 1 -- 172.21.15.155:0/2497114416 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55880527fc80 con 0x558804f54800 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.989+0000 7fe636417a80 1 -- 172.21.15.155:0/2497114416 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558804f7d860 con 0x558804f54800 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.989+0000 7fe6313bb700 1 -- 172.21.15.155:0/2497114416 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55880500d600 con 0x558804f54800 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.989+0000 7fe636417a80 1 -- 172.21.15.155:0/2497114416 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558804f7d6c0 con 0x558804f54800 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe636417a80 1 Processor -- start 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe636417a80 1 -- start start 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe636417a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 0x55880523cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe636417a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804f90640 con 0x558804f55400 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe6313bb700 1 -- 172.21.15.155:0/2497114416 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558805cf6b00 con 0x558804f54800 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe634bc2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 0x55880523cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe6313bb700 1 --2- 172.21.15.155:0/2497114416 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5588052d8000 0x55880523d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe634bc2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 0x55880523cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34922/0 (socket says 172.21.15.155:34922) 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe634bc2700 1 -- 172.21.15.155:0/1128421918 learned_addr learned my addr 172.21.15.155:0/1128421918 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe6313bb700 1 -- 172.21.15.155:0/2497114416 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558804fcf180 con 0x558804f54800 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe6343c1700 1 --2- 172.21.15.155:0/2497114416 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5588052d8000 0x55880523d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe634bc2700 1 -- 172.21.15.155:0/1128421918 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558804f7c000 con 0x558804f55400 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe6343c1700 1 --2- 172.21.15.155:0/2497114416 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5588052d8000 0x55880523d080 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x558805de6f00 tx=0x55880529a540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.990+0000 7fe634bc2700 1 --2- 172.21.15.155:0/1128421918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 0x55880523cb00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x5588052da060 tx=0x558805045800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221478b653b0acdd server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe62ebb6700 1 -- 172.21.15.155:0/1128421918 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55880500d4a0 con 0x558804f55400 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe62ebb6700 1 -- 172.21.15.155:0/1128421918 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558804ff5c80 con 0x558804f55400 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe62ebb6700 1 -- 172.21.15.155:0/1128421918 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55880500d600 con 0x558804f55400 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe636417a80 1 -- 172.21.15.155:0/1128421918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 msgr2=0x55880523cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe636417a80 1 --2- 172.21.15.155:0/1128421918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 0x55880523cb00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x5588052da060 tx=0x558805045800 comp rx=0 tx=0).stop 2024-04-19T23:45:58.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe636417a80 1 -- 172.21.15.155:0/1128421918 shutdown_connections 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe636417a80 1 --2- 172.21.15.155:0/1128421918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 0x55880523cb00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe636417a80 1 -- 172.21.15.155:0/1128421918 >> 172.21.15.155:0/1128421918 conn(0x558804f54c00 msgr2=0x558805041800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe636417a80 1 -- 172.21.15.155:0/1128421918 shutdown_connections 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe636417a80 1 -- 172.21.15.155:0/1128421918 wait complete. 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe636417a80 1 Processor -- start 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.991+0000 7fe636417a80 1 -- start start 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.992+0000 7fe636417a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 0x55880523cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.992+0000 7fe636417a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804f908c0 con 0x558804f55400 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.992+0000 7fe634bc2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 0x55880523cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.992+0000 7fe634bc2700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 0x55880523cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34930/0 (socket says 172.21.15.155:34930) 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.992+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 learned_addr learned my addr 172.21.15.155:0/1766663672 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.992+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558804f7cea0 con 0x558804f55400 2024-04-19T23:45:58.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.993+0000 7fe634bc2700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 0x55880523cb00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x5588052da5a0 tx=0x558805045b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.993+0000 7fe62d3b3700 1 -- 172.21.15.155:0/1766663672 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55880500d760 con 0x558804f55400 2024-04-19T23:45:58.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.993+0000 7fe62d3b3700 1 -- 172.21.15.155:0/1766663672 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558804ff5b00 con 0x558804f55400 2024-04-19T23:45:58.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.993+0000 7fe62d3b3700 1 -- 172.21.15.155:0/1766663672 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55880500d4a0 con 0x558804f55400 2024-04-19T23:45:58.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.993+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558804f7c820 con 0x558804f55400 2024-04-19T23:45:58.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.993+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558804f7c9c0 con 0x558804f55400 2024-04-19T23:45:58.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.994+0000 7fe636417a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.994+0000 7fe62d3b3700 1 -- 172.21.15.155:0/1766663672 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558805cf7080 con 0x558804f55400 2024-04-19T23:45:58.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.994+0000 7fe62d3b3700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5588052d8c00 0x55880523d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.994+0000 7fe62d3b3700 1 -- 172.21.15.155:0/1766663672 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558804fcf340 con 0x558804f55400 2024-04-19T23:45:58.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.994+0000 7fe633bc0700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5588052d8c00 0x55880523d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.994+0000 7fe636417a80 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558804f55800 0x55880523db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.994+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x558804f55800 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.994+0000 7fe634bc2700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558804f55800 0x55880523db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.994+0000 7fe633bc0700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5588052d8c00 0x55880523d600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x558805d2dec0 tx=0x55880529b380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe634bc2700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558804f55800 0x55880523db80 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe636417a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe636417a80 20 realm 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe636417a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9000 con 0x558804f55800 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe636417a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe636417a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe636417a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9400 con 0x558804f55800 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe636417a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe636417a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.995+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9800 con 0x558804f55800 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.996+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.996+0000 7fe636417a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.996+0000 7fe636417a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.996+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x558804f55800 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.996+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.996+0000 7fe636417a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.996+0000 7fe636417a80 20 searching for the correct realm 2024-04-19T23:45:58.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.996+0000 7fe636417a80 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5588052d9000 0x55880523e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.996+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9400 con 0x5588052d9000 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.996+0000 7fe6343c1700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5588052d9000 0x55880523e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.996+0000 7fe6343c1700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5588052d9000 0x55880523e100 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.997+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.997+0000 7fe6343c1700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5588052d9400 0x55880523ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.997+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e000 con 0x5588052d9400 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.997+0000 7fe633bc0700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5588052d9400 0x55880523ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.997+0000 7fe633bc0700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5588052d9400 0x55880523ec00 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.997+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363440 con 0x5588052d9400 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.997+0000 7fe633bc0700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55880539e000 0x55880523f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.997+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x55880539e000 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.998+0000 7fe634bc2700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55880539e000 0x55880523f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.998+0000 7fe634bc2700 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55880539e000 0x55880523f180 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.998+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.998+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x558804f55800 2024-04-19T23:45:58.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.999+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.999+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x558804f55800 2024-04-19T23:45:58.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.999+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.999+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x55880539e000 2024-04-19T23:45:58.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.999+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.999+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x55880539e000 2024-04-19T23:45:58.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.999+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:57.999+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9400 2024-04-19T23:45:58.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.000+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363440 con 0x5588052d9400 2024-04-19T23:45:58.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.000+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9000 2024-04-19T23:45:58.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.000+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.000+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x558804f55800 2024-04-19T23:45:58.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.000+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.000+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x55880539e000 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.000+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.000+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x558804f55800 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.000+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.001+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9400 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.001+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363440 con 0x5588052d9400 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.001+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9000 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.001+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.001+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9000 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.001+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.001+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x55880539e000 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.001+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.001+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9000 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.002+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.002+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9000 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.002+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.002+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x558804f55800 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.002+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.002+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x558804f55800 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.002+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.002+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x55880539e000 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.003+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.003+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9000 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.003+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.003+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9400 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.003+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363440 con 0x5588052d9400 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.003+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x558804f55800 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.003+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.003+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x55880539e000 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.003+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.004+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9000 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.004+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.004+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x55880539e000 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.004+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.004+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9400 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.004+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363440 con 0x5588052d9400 2024-04-19T23:45:58.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.004+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9000 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.005+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.005+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x55880539e000 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.005+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.005+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x558804f55800 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.005+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.005+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9400 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x558805363440 con 0x5588052d9400 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x558804f55800 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539ec00 con 0x558804f55800 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x5588052d9400 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x558805363440 con 0x5588052d9400 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 zone default found 2024-04-19T23:45:58.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 4 Realm: () 2024-04-19T23:45:58.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:58.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:58.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:58.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 zonegroup default 2024-04-19T23:45:58.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.006+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f400 con 0x55880539e000 2024-04-19T23:45:58.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe636417a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe636417a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f800 con 0x5588052d9000 2024-04-19T23:45:58.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe636417a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe636417a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x5588052d9000 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe636417a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe636417a80 20 started sync module instance, tier type = 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe636417a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.007+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539ec00 con 0x5588052d9400 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.008+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805363440 con 0x5588052d9400 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.008+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94042690108160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x5588052d9400 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.008+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9800 con 0x558804f55800 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.009+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94042690108160] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805363440 con 0x5588052d9400 2024-04-19T23:45:58.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.010+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.010+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94042690109312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x558804f55800 2024-04-19T23:45:58.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.010+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x5588052d9000 2024-04-19T23:45:58.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.011+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94042690109312] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.011+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.011+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94042690110464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x5588052d9000 2024-04-19T23:45:58.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.011+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539ec00 con 0x5588052d9400 2024-04-19T23:45:58.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.012+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805363440 con 0x5588052d9400 2024-04-19T23:45:58.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.012+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94042690111616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e400 con 0x5588052d9400 2024-04-19T23:45:58.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.012+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f800 con 0x558804f55800 2024-04-19T23:45:58.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.012+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94042690110464] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.013+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94042690111616] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805363440 con 0x5588052d9400 2024-04-19T23:45:58.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.013+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.013+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94042690112768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x558804f55800 2024-04-19T23:45:58.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.013+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539e800 con 0x55880539e000 2024-04-19T23:45:58.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.014+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.014+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94042690113920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f400 con 0x55880539e000 2024-04-19T23:45:58.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.014+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f800 con 0x55880539e000 2024-04-19T23:45:58.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.014+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94042690112768] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.015+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94042690113920] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.015+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.015+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94042690115072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x55880539e000 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.015+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9800 con 0x55880539e000 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.017+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94042690115072] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.017+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.017+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94042690116224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x55880539e000 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.017+0000 7fe636417a80 20 add_watcher() i=0 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.017+0000 7fe636417a80 20 add_watcher() i=1 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.017+0000 7fe636417a80 20 add_watcher() i=2 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.017+0000 7fe636417a80 20 add_watcher() i=3 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.017+0000 7fe636417a80 20 add_watcher() i=4 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.017+0000 7fe636417a80 20 add_watcher() i=5 2024-04-19T23:45:58.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.017+0000 7fe636417a80 20 add_watcher() i=6 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.018+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94042690116224] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.018+0000 7fe636417a80 20 add_watcher() i=7 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.018+0000 7fe636417a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.018+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9800 con 0x558804f55800 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.018+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.018+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94042691641344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x558804f55800 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.019+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94042691641344] v30'158 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.019+0000 7fe61b38f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.019+0000 7fe636417a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.019+0000 7fe636417a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.019+0000 7fe636417a80 1 Processor -- start 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.019+0000 7fe636417a80 1 -- start start 2024-04-19T23:45:58.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.019+0000 7fe636417a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 0x55880523e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.019+0000 7fe636417a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804ff63c0 con 0x55880539f400 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.020+0000 7fe633bc0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 0x55880523e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.020+0000 7fe633bc0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 0x55880523e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34944/0 (socket says 172.21.15.155:34944) 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.020+0000 7fe633bc0700 1 -- 172.21.15.155:0/3249885782 learned_addr learned my addr 172.21.15.155:0/3249885782 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.020+0000 7fe633bc0700 1 -- 172.21.15.155:0/3249885782 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558804f7cb60 con 0x55880539f400 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.020+0000 7fe633bc0700 1 --2- 172.21.15.155:0/3249885782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 0x55880523e680 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x5588053b6000 tx=0x55880529b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ea669d6044f887 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.020+0000 7fe61ab8e700 1 -- 172.21.15.155:0/3249885782 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5588053c2000 con 0x55880539f400 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.020+0000 7fe61ab8e700 1 -- 172.21.15.155:0/3249885782 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588053ca000 con 0x55880539f400 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.020+0000 7fe61ab8e700 1 -- 172.21.15.155:0/3249885782 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5588053c2160 con 0x55880539f400 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.021+0000 7fe636417a80 1 -- 172.21.15.155:0/3249885782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 msgr2=0x55880523e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.021+0000 7fe636417a80 1 --2- 172.21.15.155:0/3249885782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 0x55880523e680 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x5588053b6000 tx=0x55880529b680 comp rx=0 tx=0).stop 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.021+0000 7fe636417a80 1 -- 172.21.15.155:0/3249885782 shutdown_connections 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.021+0000 7fe636417a80 1 --2- 172.21.15.155:0/3249885782 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 0x55880523e680 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.021+0000 7fe636417a80 1 -- 172.21.15.155:0/3249885782 >> 172.21.15.155:0/3249885782 conn(0x55880539e800 msgr2=0x558805042000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.021+0000 7fe636417a80 1 -- 172.21.15.155:0/3249885782 shutdown_connections 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.021+0000 7fe636417a80 1 -- 172.21.15.155:0/3249885782 wait complete. 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.021+0000 7fe636417a80 1 Processor -- start 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.021+0000 7fe636417a80 1 -- start start 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.021+0000 7fe636417a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 0x55880523e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.021+0000 7fe636417a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804ff6500 con 0x55880539f400 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.022+0000 7fe633bc0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 0x55880523e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.022+0000 7fe633bc0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 0x55880523e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34958/0 (socket says 172.21.15.155:34958) 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.022+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 learned_addr learned my addr 172.21.15.155:0/1394652939 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.022+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558804f7cd00 con 0x55880539f400 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.022+0000 7fe633bc0700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 0x55880523e680 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x5588053b61e0 tx=0x55880529b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.022+0000 7fe61938b700 1 -- 172.21.15.155:0/1394652939 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5588053c22c0 con 0x55880539f400 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.022+0000 7fe61938b700 1 -- 172.21.15.155:0/1394652939 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588053ca180 con 0x55880539f400 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.022+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558804f7c340 con 0x55880539f400 2024-04-19T23:45:58.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.022+0000 7fe61938b700 1 -- 172.21.15.155:0/1394652939 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5588053c2000 con 0x55880539f400 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.022+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558804f7cb60 con 0x55880539f400 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.023+0000 7fe61938b700 1 -- 172.21.15.155:0/1394652939 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558805cf7b80 con 0x55880539f400 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.023+0000 7fe61938b700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558805442000 0x55880523f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.023+0000 7fe61938b700 1 -- 172.21.15.155:0/1394652939 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x558804fcf500 con 0x55880539f400 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.023+0000 7fe634bc2700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558805442000 0x55880523f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.023+0000 7fe636417a80 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55880539f800 0x558805456000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.023+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x55880539f800 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.024+0000 7fe6343c1700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55880539f800 0x558805456000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.024+0000 7fe634bc2700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558805442000 0x55880523f700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x558805333c50 tx=0x55880529b4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.024+0000 7fe6343c1700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55880539f800 0x558805456000 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.025+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.025+0000 7fe636417a80 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558805442400 0x558805456580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.025+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805442800 con 0x558805442400 2024-04-19T23:45:58.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.025+0000 7fe633bc0700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558805442400 0x558805456580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.025+0000 7fe633bc0700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558805442400 0x558805456580 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.027+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.027+0000 7fe636417a80 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558805442c00 0x558805456b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.027+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x558805442c00 2024-04-19T23:45:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.027+0000 7fe634bc2700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558805442c00 0x558805456b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.027+0000 7fe634bc2700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558805442c00 0x558805456b00 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.028+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.028+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443400 con 0x55880539f800 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.029+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'159 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.029+0000 7fe636417a80 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558805443800 0x558805457080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.029+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443c00 con 0x558805443800 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.029+0000 7fe6343c1700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558805443800 0x558805457080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.029+0000 7fe6343c1700 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558805443800 0x558805457080 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.030+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'47 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.030+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474000 con 0x558805442c00 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.031+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'31 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.031+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x55880539f800 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.032+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.032+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x558805442400 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.033+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'31 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.033+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474c00 con 0x558805443800 2024-04-19T23:45:58.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.034+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.034+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475000 con 0x558805442c00 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.035+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'25 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.035+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475400 con 0x558805443800 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.036+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'48 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.036+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x558805442400 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.037+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.037+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475c00 con 0x558805443800 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.038+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.038+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x558805442400 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.039+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'40 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.039+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x55880539f800 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.040+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'160 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.040+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805442800 con 0x558805442c00 2024-04-19T23:45:58.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.041+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'45 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.041+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443400 con 0x558805443800 2024-04-19T23:45:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.042+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'49 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.042+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443c00 con 0x558805442c00 2024-04-19T23:45:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.043+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.043+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539ec00 con 0x55880539f800 2024-04-19T23:45:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.044+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.044+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x55880539f800 2024-04-19T23:45:58.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.045+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'161 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.045+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x558805442c00 2024-04-19T23:45:58.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.046+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'46 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.046+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x558805443800 2024-04-19T23:45:58.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.047+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.047+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443400 con 0x558805442c00 2024-04-19T23:45:58.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.048+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.048+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x558805442c00 2024-04-19T23:45:58.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.049+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'25 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.049+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805442800 con 0x558805442c00 2024-04-19T23:45:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.050+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.050+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443c00 con 0x558805442c00 2024-04-19T23:45:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.050+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.050+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474c00 con 0x558805442400 2024-04-19T23:45:58.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.052+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.052+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475400 con 0x558805442c00 2024-04-19T23:45:58.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.053+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.053+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475c00 con 0x558805442400 2024-04-19T23:45:58.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.054+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.054+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x558805442c00 2024-04-19T23:45:58.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.055+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'47 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.055+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474000 con 0x558805442400 2024-04-19T23:45:58.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.056+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'41 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.056+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475000 con 0x558805443800 2024-04-19T23:45:58.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.057+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.058+0000 7fe616b86700 20 reqs_thread_entry: start 2024-04-19T23:45:58.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.058+0000 7fe636417a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:58.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.058+0000 7fe636417a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:58.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.058+0000 7fe614b82700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:28 2024 2024-04-19T23:45:58.058 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:58.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.059+0000 7fe614360700 20 reqs_thread_entry: start 2024-04-19T23:45:58.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.059+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-04-19T23:45:58.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.059+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:33 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x55880539f800 2024-04-19T23:45:58.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.060+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(33 gc.3 [call] v30'162 uv162 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.060+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:34 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539ec00 con 0x55880539f800 2024-04-19T23:45:58.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.060+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(34 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.060+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.060+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:35 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x55880539f800 2024-04-19T23:45:58.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.060+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(35 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.060+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x55880539f800 2024-04-19T23:45:58.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.060+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(36 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.060+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.060+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:37 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474c00 con 0x55880539f800 2024-04-19T23:45:58.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.061+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(37 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.061+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.061+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475c00 con 0x55880539f800 2024-04-19T23:45:58.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.061+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(38 gc.3 [call] v30'163 uv163 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.061+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.061+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:39 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474000 con 0x558805443800 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.062+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(39 gc.4 [call] v30'50 uv50 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.062+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475000 con 0x558805443800 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.063+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(40 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.063+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.063+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:41 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x558805443800 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.063+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(41 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.063+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:42 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x558805443800 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.063+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(42 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.063+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.063+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:43 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x558805443800 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.063+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(43 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.063+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.063+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539ec00 con 0x558805443800 2024-04-19T23:45:58.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.064+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(44 gc.4 [call] v30'51 uv51 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.064+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.064+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:45 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x558805442c00 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.065+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(45 gc.5 [call] v30'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.065+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:46 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x558805442c00 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.065+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(46 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.065+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.065+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:47 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x558805442c00 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.065+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(47 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.065+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x558805442c00 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.066+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(48 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.066+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.066+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539ec00 con 0x558805442c00 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.066+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(49 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.066+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.066+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:50 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x558805442c00 2024-04-19T23:45:58.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.067+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(50 gc.5 [call] v30'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.067+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-04-19T23:45:58.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.067+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:51 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443400 con 0x55880539f800 2024-04-19T23:45:58.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.068+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(51 gc.6 [call] v30'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.068+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x55880539f800 2024-04-19T23:45:58.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.068+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(52 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.069+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.069+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805442800 con 0x55880539f800 2024-04-19T23:45:58.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.069+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(53 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.069+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:54 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443c00 con 0x55880539f800 2024-04-19T23:45:58.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.069+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(54 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.069+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.069+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:55 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474000 con 0x55880539f800 2024-04-19T23:45:58.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.069+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(55 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.069+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.069+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:56 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x55880539f800 2024-04-19T23:45:58.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.070+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(56 gc.6 [call] v30'24 uv24 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.070+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-04-19T23:45:58.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.070+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x558805442400 2024-04-19T23:45:58.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.072+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(57 gc.7 [call] v30'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.072+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474c00 con 0x558805442400 2024-04-19T23:45:58.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.072+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(58 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.072+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.072+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475000 con 0x558805442400 2024-04-19T23:45:58.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.072+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(59 gc.7 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.071 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.072+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:60 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475400 con 0x558805442400 2024-04-19T23:45:58.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.073+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(60 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.073+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.073+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:61 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x558805442400 2024-04-19T23:45:58.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.073+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(61 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.073+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.073+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475c00 con 0x558805442400 2024-04-19T23:45:58.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.074+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(62 gc.7 [call] v30'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.074+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-04-19T23:45:58.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.074+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x558805443800 2024-04-19T23:45:58.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.076+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(63 gc.8 [call] v30'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.076+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474c00 con 0x558805443800 2024-04-19T23:45:58.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.076+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(64 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.076+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.076+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475000 con 0x558805443800 2024-04-19T23:45:58.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.076+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(65 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.076+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475400 con 0x558805443800 2024-04-19T23:45:58.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.077+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(66 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.077+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.077+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x558805443800 2024-04-19T23:45:58.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.077+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(67 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.077+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.077+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475c00 con 0x558805443800 2024-04-19T23:45:58.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.078+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(68 gc.8 [call] v30'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.078+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-04-19T23:45:58.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.078+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474000 con 0x558805442c00 2024-04-19T23:45:58.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.079+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(69 gc.9 [call] v30'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.079+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:70 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x558805442c00 2024-04-19T23:45:58.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.080+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(70 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.080+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.080+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x558805442c00 2024-04-19T23:45:58.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.080+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(71 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.080+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:72 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474c00 con 0x558805442c00 2024-04-19T23:45:58.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.080+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== osd_op_reply(72 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.080+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.080+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475000 con 0x558805442c00 2024-04-19T23:45:58.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.080+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(73 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.080+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.080+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:74 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443400 con 0x558805442c00 2024-04-19T23:45:58.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.081+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(74 gc.9 [call] v30'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.081+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-04-19T23:45:58.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.081+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:75 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x558805443800 2024-04-19T23:45:58.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.082+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 20 ==== osd_op_reply(75 gc.10 [call] v30'52 uv52 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.082+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:76 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805442800 con 0x558805443800 2024-04-19T23:45:58.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.082+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 21 ==== osd_op_reply(76 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.082+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.082+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:77 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443c00 con 0x558805443800 2024-04-19T23:45:58.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.083+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 22 ==== osd_op_reply(77 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.083+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:78 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474000 con 0x558805443800 2024-04-19T23:45:58.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.083+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 23 ==== osd_op_reply(78 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.083+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.083+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:79 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x558805443800 2024-04-19T23:45:58.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.083+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 24 ==== osd_op_reply(79 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.083+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.083+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:80 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x558805443800 2024-04-19T23:45:58.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.084+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 25 ==== osd_op_reply(80 gc.10 [call] v30'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.084+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-04-19T23:45:58.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.084+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:81 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474c00 con 0x558805442400 2024-04-19T23:45:58.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.085+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(81 gc.11 [call] v30'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.085+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:82 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x558805442400 2024-04-19T23:45:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.085+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(82 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.085+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.085+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:83 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x558805442400 2024-04-19T23:45:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.085+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(83 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805363440 con 0x558805442400 2024-04-19T23:45:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.086+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:84 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x558805442400 2024-04-19T23:45:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.086+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(84 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.086+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.086+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:85 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539ec00 con 0x558805442400 2024-04-19T23:45:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.086+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(85 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.086+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.086+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:86 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x558805442400 2024-04-19T23:45:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.087+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(86 gc.11 [call] v30'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.087+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-04-19T23:45:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.087+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:87 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502000 con 0x558805443800 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.088+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 26 ==== osd_op_reply(87 gc.12 [call] v30'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.088+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:88 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502400 con 0x558805443800 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.088+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 27 ==== osd_op_reply(88 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.088+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.088+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:89 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502800 con 0x558805443800 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.088+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 28 ==== osd_op_reply(89 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.088+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:90 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502c00 con 0x558805443800 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.089+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 29 ==== osd_op_reply(90 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.089+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.089+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:91 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503000 con 0x558805443800 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.089+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 30 ==== osd_op_reply(91 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.089+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.089+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:92 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503400 con 0x558805443800 2024-04-19T23:45:58.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.090+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 31 ==== osd_op_reply(92 gc.12 [call] v30'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.090+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-04-19T23:45:58.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.090+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:93 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503800 con 0x558805442400 2024-04-19T23:45:58.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.091+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(93 gc.13 [call] v30'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.091+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:94 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503c00 con 0x558805442400 2024-04-19T23:45:58.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.091+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(94 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.091+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.091+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:95 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503800 con 0x558805442400 2024-04-19T23:45:58.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.091+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(95 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.091+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:96 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502000 con 0x558805442400 2024-04-19T23:45:58.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.092+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(96 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.092+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.092+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:97 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474c00 con 0x558805442400 2024-04-19T23:45:58.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.092+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(97 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.092+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.092+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:98 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475400 con 0x558805442400 2024-04-19T23:45:58.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.093+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(98 gc.13 [call] v30'43 uv43 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.093+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-04-19T23:45:58.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.093+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:99 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x55880539f800 2024-04-19T23:45:58.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.094+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(99 gc.14 [call] v30'164 uv164 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.094+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:100 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475c00 con 0x55880539f800 2024-04-19T23:45:58.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.094+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(100 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.094+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.094+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:101 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474000 con 0x55880539f800 2024-04-19T23:45:58.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.094+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(101 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.094+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:102 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x55880539f800 2024-04-19T23:45:58.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.095+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(102 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.095+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.095+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:103 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x55880539f800 2024-04-19T23:45:58.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.095+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(103 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.095+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.095+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:104 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x55880539f800 2024-04-19T23:45:58.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.096+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(104 gc.14 [call] v30'165 uv165 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.096+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-04-19T23:45:58.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.096+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:105 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805442800 con 0x558805442c00 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.097+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 25 ==== osd_op_reply(105 gc.15 [call] v30'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.097+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:106 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443c00 con 0x558805442c00 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.097+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 26 ==== osd_op_reply(106 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.097+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.097+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:107 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x558805442c00 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.097+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 27 ==== osd_op_reply(107 gc.15 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.097+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:108 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x558805442c00 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 28 ==== osd_op_reply(108 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:109 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x558805442c00 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 29 ==== osd_op_reply(109 gc.15 [call out=1702b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+1702 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 20 garbage collection: RGWGC::process iterating over entry tag='1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4221.16278617288898541022', time=2024-04-19T23:45:57.750478+0000, chain.objs.size()=7 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_1 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:110 3.3c 3:3fb8fe9d:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539ec00 con 0x558805443800 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_2 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:111 3.38 3:1d3dee2e:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x558805442400 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_3 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:112 3.11 3:8b8200d7:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x558805442c00 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_4 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:113 3.9 3:939d97b9:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x558805442c00 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_5 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:114 3.1c 3:3bbddfd1:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475c00 con 0x55880539f800 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_6 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:115 3.38 3:1c157da5:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474000 con 0x558805442400 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_7 2024-04-19T23:45:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.098+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:116 3.18 3:193931b0:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x558805442c00 2024-04-19T23:45:58.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.101+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 30 ==== osd_op_reply(116 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_7 [call] v30'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.101+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 31 ==== osd_op_reply(112 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_3 [call] v30'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.101+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 32 ==== osd_op_reply(110 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_1 [call] v30'3 uv3 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.102+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 32 ==== osd_op_reply(113 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_4 [call] v30'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.102+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(114 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_5 [call] v30'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.102+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(111 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_2 [call] v30'3 uv3 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.102+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(115 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.1__shadow_.KfgRZAQuuCF6oiZN-bvIBaJXZrLh162_6 [call] v30'4 uv4 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.102+0000 7fe636417a80 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-19T23:45:58.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.102+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:117 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x558805442c00 2024-04-19T23:45:58.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.103+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 33 ==== osd_op_reply(117 gc.15 [call] v30'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.103+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:118 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502400 con 0x558805442c00 2024-04-19T23:45:58.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.106+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 34 ==== osd_op_reply(118 gc.15 [call] v30'50 uv50 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.106+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-04-19T23:45:58.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.106+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:119 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502800 con 0x558805443800 2024-04-19T23:45:58.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.107+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 33 ==== osd_op_reply(119 gc.16 [call] v30'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.107+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:120 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502c00 con 0x558805443800 2024-04-19T23:45:58.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.107+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 34 ==== osd_op_reply(120 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.107+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.107+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:121 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503000 con 0x558805443800 2024-04-19T23:45:58.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.108+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 35 ==== osd_op_reply(121 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.108+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:122 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503400 con 0x558805443800 2024-04-19T23:45:58.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.108+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 36 ==== osd_op_reply(122 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.108+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.108+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:123 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475000 con 0x558805443800 2024-04-19T23:45:58.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.108+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 37 ==== osd_op_reply(123 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.108+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.108+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:124 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x558805443800 2024-04-19T23:45:58.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.109+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 38 ==== osd_op_reply(124 gc.16 [call] v30'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.109+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-04-19T23:45:58.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.109+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:125 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x558805442c00 2024-04-19T23:45:58.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.110+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 35 ==== osd_op_reply(125 gc.17 [call] v30'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.110+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:126 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443400 con 0x558805442c00 2024-04-19T23:45:58.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.110+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 36 ==== osd_op_reply(126 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.110+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.110+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:127 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805442800 con 0x558805442c00 2024-04-19T23:45:58.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.110+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 37 ==== osd_op_reply(127 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.110+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:128 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443c00 con 0x558805442c00 2024-04-19T23:45:58.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.111+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 38 ==== osd_op_reply(128 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.111+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.111+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:129 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x558805442c00 2024-04-19T23:45:58.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.111+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 39 ==== osd_op_reply(129 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.111+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.111+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:130 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x558805442c00 2024-04-19T23:45:58.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.112+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 40 ==== osd_op_reply(130 gc.17 [call] v30'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.112+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-04-19T23:45:58.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.112+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:131 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x55880539f800 2024-04-19T23:45:58.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.113+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(131 gc.18 [call] v30'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.113+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:132 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x55880539f800 2024-04-19T23:45:58.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.114+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(132 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.114+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.114+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:133 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880548c000 con 0x55880539f800 2024-04-19T23:45:58.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.114+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(133 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.114+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:134 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880548c400 con 0x55880539f800 2024-04-19T23:45:58.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.114+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(134 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.114+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.114+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:135 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880548c800 con 0x55880539f800 2024-04-19T23:45:58.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.114+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(135 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.114+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.114+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:136 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880548cc00 con 0x55880539f800 2024-04-19T23:45:58.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.116+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(136 gc.18 [call] v30'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.116+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-04-19T23:45:58.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.116+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:137 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880548d000 con 0x55880539f800 2024-04-19T23:45:58.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.116+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(137 gc.19 [call] v30'166 uv166 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.116+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:138 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880548d400 con 0x55880539f800 2024-04-19T23:45:58.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.117+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 33 ==== osd_op_reply(138 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.117+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.117+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:139 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880548d800 con 0x55880539f800 2024-04-19T23:45:58.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.117+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 34 ==== osd_op_reply(139 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.117+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:140 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880548dc00 con 0x55880539f800 2024-04-19T23:45:58.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.117+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 35 ==== osd_op_reply(140 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.117+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.117+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:141 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880548c000 con 0x55880539f800 2024-04-19T23:45:58.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.117+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 36 ==== osd_op_reply(141 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.117+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.117+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:142 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880548c400 con 0x55880539f800 2024-04-19T23:45:58.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.118+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 37 ==== osd_op_reply(142 gc.19 [call] v30'167 uv167 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.118+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-04-19T23:45:58.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.118+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:143 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x558805442c00 2024-04-19T23:45:58.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.119+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 41 ==== osd_op_reply(143 gc.20 [call] v30'51 uv51 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.119+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:144 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539ec00 con 0x558805442c00 2024-04-19T23:45:58.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.120+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 42 ==== osd_op_reply(144 gc.20 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.120+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.120+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:145 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x558805442c00 2024-04-19T23:45:58.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.120+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 43 ==== osd_op_reply(145 gc.20 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.120+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:146 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475c00 con 0x558805442c00 2024-04-19T23:45:58.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.120+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 44 ==== osd_op_reply(146 gc.20 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.120+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.120+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:147 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475000 con 0x558805442c00 2024-04-19T23:45:58.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.120+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 45 ==== osd_op_reply(147 gc.20 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.120+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.120+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:148 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x558805442c00 2024-04-19T23:45:58.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.122+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 46 ==== osd_op_reply(148 gc.20 [call] v30'52 uv52 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.122+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-04-19T23:45:58.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.122+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:149 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502800 con 0x558805443800 2024-04-19T23:45:58.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.123+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 39 ==== osd_op_reply(149 gc.21 [call] v30'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.123+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:150 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502c00 con 0x558805443800 2024-04-19T23:45:58.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.123+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 40 ==== osd_op_reply(150 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.123+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.123+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:151 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503000 con 0x558805443800 2024-04-19T23:45:58.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.123+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 41 ==== osd_op_reply(151 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.123+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:152 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503400 con 0x558805443800 2024-04-19T23:45:58.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.123+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 42 ==== osd_op_reply(152 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.123+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.123+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:153 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x558805443800 2024-04-19T23:45:58.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.124+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 43 ==== osd_op_reply(153 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.124+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.124+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:154 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539ec00 con 0x558805443800 2024-04-19T23:45:58.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.125+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 44 ==== osd_op_reply(154 gc.21 [call] v30'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.125+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-04-19T23:45:58.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.125+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:155 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x558805442c00 2024-04-19T23:45:58.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.125+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 47 ==== osd_op_reply(155 gc.22 [call] v30'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.125+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:156 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x558805442c00 2024-04-19T23:45:58.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.126+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 48 ==== osd_op_reply(156 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.126+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.126+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:157 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443400 con 0x558805442c00 2024-04-19T23:45:58.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.126+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 49 ==== osd_op_reply(157 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.126+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:158 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805442800 con 0x558805442c00 2024-04-19T23:45:58.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.126+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 50 ==== osd_op_reply(158 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.126+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.126+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:159 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443c00 con 0x558805442c00 2024-04-19T23:45:58.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.126+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 51 ==== osd_op_reply(159 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.126+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.126+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x558805442c00 2024-04-19T23:45:58.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.127+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 52 ==== osd_op_reply(160 gc.22 [call] v30'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.127+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-04-19T23:45:58.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.127+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:161 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x558805442c00 2024-04-19T23:45:58.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.128+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 53 ==== osd_op_reply(161 gc.23 [call] v30'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.128+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:162 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x558805442c00 2024-04-19T23:45:58.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.128+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 54 ==== osd_op_reply(162 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.128+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.128+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502400 con 0x558805442c00 2024-04-19T23:45:58.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.129+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 55 ==== osd_op_reply(163 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.129+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x558805442c00 2024-04-19T23:45:58.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.129+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 56 ==== osd_op_reply(164 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.129+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.129+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x558805442c00 2024-04-19T23:45:58.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.129+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 57 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.129+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.129+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:166 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502400 con 0x558805442c00 2024-04-19T23:45:58.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.130+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 58 ==== osd_op_reply(166 gc.23 [call] v30'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.130+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.130+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502800 con 0x558805442c00 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 59 ==== osd_op_reply(167 gc.24 [call] v30'16 uv16 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502c00 con 0x558805442c00 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 60 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:169 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503000 con 0x558805442c00 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 61 ==== osd_op_reply(169 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:170 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503400 con 0x558805442c00 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 62 ==== osd_op_reply(170 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:171 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475c00 con 0x558805442c00 2024-04-19T23:45:58.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 63 ==== osd_op_reply(171 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.131+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:172 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475000 con 0x558805442c00 2024-04-19T23:45:58.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.132+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 64 ==== osd_op_reply(172 gc.24 [call] v30'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.132+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-04-19T23:45:58.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.132+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:173 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x558805442c00 2024-04-19T23:45:58.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.133+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 65 ==== osd_op_reply(173 gc.25 [call] v30'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.133+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:174 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x558805442c00 2024-04-19T23:45:58.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.134+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 66 ==== osd_op_reply(174 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.134+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.134+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:175 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x558805442c00 2024-04-19T23:45:58.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.134+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 67 ==== osd_op_reply(175 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.134+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:176 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443400 con 0x558805442c00 2024-04-19T23:45:58.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.134+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 68 ==== osd_op_reply(176 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.134+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.134+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:177 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805442800 con 0x558805442c00 2024-04-19T23:45:58.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.134+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 69 ==== osd_op_reply(177 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.134+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.134+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:178 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443c00 con 0x558805442c00 2024-04-19T23:45:58.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.135+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 70 ==== osd_op_reply(178 gc.25 [call] v30'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.135+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-04-19T23:45:58.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.135+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:179 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x558805442400 2024-04-19T23:45:58.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.136+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 28 ==== osd_op_reply(179 gc.26 [call] v30'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.136+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:180 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x558805442400 2024-04-19T23:45:58.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.137+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 29 ==== osd_op_reply(180 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.137+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.137+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:181 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x558805442400 2024-04-19T23:45:58.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.137+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 30 ==== osd_op_reply(181 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.137+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:182 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443400 con 0x558805442400 2024-04-19T23:45:58.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.137+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 31 ==== osd_op_reply(182 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.137+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.137+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:183 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x558805442400 2024-04-19T23:45:58.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.138+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 32 ==== osd_op_reply(183 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.138+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.138+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:184 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x558805442400 2024-04-19T23:45:58.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.139+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 33 ==== osd_op_reply(184 gc.26 [call] v30'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.139+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-04-19T23:45:58.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.139+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:185 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x558805442c00 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.140+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 71 ==== osd_op_reply(185 gc.27 [call] v30'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.140+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:186 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502000 con 0x558805442c00 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.140+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 72 ==== osd_op_reply(186 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.140+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.140+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:187 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502400 con 0x558805442c00 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.140+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 73 ==== osd_op_reply(187 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.140+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:188 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502800 con 0x558805442c00 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.140+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 74 ==== osd_op_reply(188 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.140+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.140+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:189 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502c00 con 0x558805442c00 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.141+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 75 ==== osd_op_reply(189 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.141+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.141+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:190 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503000 con 0x558805442c00 2024-04-19T23:45:58.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.142+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 76 ==== osd_op_reply(190 gc.27 [call] v30'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.142+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-04-19T23:45:58.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.142+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:191 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503400 con 0x558805442400 2024-04-19T23:45:58.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.143+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 34 ==== osd_op_reply(191 gc.28 [call] v30'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.143+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:192 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503800 con 0x558805442400 2024-04-19T23:45:58.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.143+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 35 ==== osd_op_reply(192 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.143+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.143+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:193 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503c00 con 0x558805442400 2024-04-19T23:45:58.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.144+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 36 ==== osd_op_reply(193 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.144+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:194 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474000 con 0x558805442400 2024-04-19T23:45:58.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.144+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 37 ==== osd_op_reply(194 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.143 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.144+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.144+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:195 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x558805442400 2024-04-19T23:45:58.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.144+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 38 ==== osd_op_reply(195 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.144+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.144+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:196 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x558805442400 2024-04-19T23:45:58.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.145+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 39 ==== osd_op_reply(196 gc.28 [call] v30'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.145+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-04-19T23:45:58.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.145+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:197 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474c00 con 0x558805442c00 2024-04-19T23:45:58.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.146+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 77 ==== osd_op_reply(197 gc.29 [call] v30'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.146+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:198 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475000 con 0x558805442c00 2024-04-19T23:45:58.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.146+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 78 ==== osd_op_reply(198 gc.29 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.146+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.147+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:199 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475400 con 0x558805442c00 2024-04-19T23:45:58.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.147+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 79 ==== osd_op_reply(199 gc.29 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.147+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:200 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x558805442c00 2024-04-19T23:45:58.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.147+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 80 ==== osd_op_reply(200 gc.29 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.147+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.147+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:201 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475c00 con 0x558805442c00 2024-04-19T23:45:58.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.147+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 81 ==== osd_op_reply(201 gc.29 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.147+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.147+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:202 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474000 con 0x558805442c00 2024-04-19T23:45:58.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.148+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 82 ==== osd_op_reply(202 gc.29 [call] v30'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.148+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-04-19T23:45:58.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.148+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:203 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503400 con 0x558805442400 2024-04-19T23:45:58.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.150+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 40 ==== osd_op_reply(203 gc.30 [call] v30'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.150+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:204 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503800 con 0x558805442400 2024-04-19T23:45:58.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.150+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 41 ==== osd_op_reply(204 gc.30 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.150+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.150+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:205 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503c00 con 0x558805442400 2024-04-19T23:45:58.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.150+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 42 ==== osd_op_reply(205 gc.30 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.150+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:206 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x558805442400 2024-04-19T23:45:58.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.151+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 43 ==== osd_op_reply(206 gc.30 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.151+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.151+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:207 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x558805442400 2024-04-19T23:45:58.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.151+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 44 ==== osd_op_reply(207 gc.30 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.151+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.151+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:208 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x558805442400 2024-04-19T23:45:58.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.152+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 45 ==== osd_op_reply(208 gc.30 [call] v30'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.152+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-04-19T23:45:58.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.152+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:209 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443400 con 0x558805443800 2024-04-19T23:45:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.153+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 45 ==== osd_op_reply(209 gc.31 [call] v30'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.153+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:210 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558804f55c00 con 0x558805443800 2024-04-19T23:45:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.153+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 46 ==== osd_op_reply(210 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.153+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.153+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:211 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474c00 con 0x558805443800 2024-04-19T23:45:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.154+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 47 ==== osd_op_reply(211 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.154+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:212 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475000 con 0x558805443800 2024-04-19T23:45:58.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.154+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 48 ==== osd_op_reply(212 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.154+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.154+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:213 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475400 con 0x558805443800 2024-04-19T23:45:58.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.154+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 49 ==== osd_op_reply(213 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.154+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.154+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:214 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475800 con 0x558805443800 2024-04-19T23:45:58.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.155+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.2 v2:172.21.15.155:6812/41834 50 ==== osd_op_reply(214 gc.31 [call] v30'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x558805363200 con 0x558805443800 2024-04-19T23:45:58.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.155+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-04-19T23:45:58.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.155+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:215 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805475c00 con 0x55880539f800 2024-04-19T23:45:58.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.156+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 38 ==== osd_op_reply(215 gc.0 [call] v30'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.156+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:216 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474000 con 0x55880539f800 2024-04-19T23:45:58.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.157+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 39 ==== osd_op_reply(216 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.157+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.157+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:217 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502000 con 0x55880539f800 2024-04-19T23:45:58.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.157+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 40 ==== osd_op_reply(217 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.157+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:218 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502400 con 0x55880539f800 2024-04-19T23:45:58.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.157+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 41 ==== osd_op_reply(218 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.157+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.157+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:219 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502800 con 0x55880539f800 2024-04-19T23:45:58.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.157+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 42 ==== osd_op_reply(219 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.157+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.157+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:220 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805502c00 con 0x55880539f800 2024-04-19T23:45:58.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.158+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 <== osd.1 v2:172.21.15.155:6800/41833 43 ==== osd_op_reply(220 gc.0 [call] v30'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805363200 con 0x55880539f800 2024-04-19T23:45:58.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.158+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-04-19T23:45:58.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.158+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:221 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503000 con 0x558805442400 2024-04-19T23:45:58.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.160+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 46 ==== osd_op_reply(221 gc.1 [call] v30'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.160+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:222 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x558805442400 2024-04-19T23:45:58.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.160+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 47 ==== osd_op_reply(222 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.160+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.160+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:223 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805442800 con 0x558805442400 2024-04-19T23:45:58.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.160+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 48 ==== osd_op_reply(223 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.160+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:224 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443c00 con 0x558805442400 2024-04-19T23:45:58.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.160+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 49 ==== osd_op_reply(224 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.160+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.160+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:225 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5588052d9c00 con 0x558805442400 2024-04-19T23:45:58.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.161+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 50 ==== osd_op_reply(225 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.161+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.161+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:226 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503400 con 0x558805442400 2024-04-19T23:45:58.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.162+0000 7fe633bc0700 1 -- 172.21.15.155:0/1394652939 <== osd.0 v2:172.21.15.76:6800/39408 51 ==== osd_op_reply(226 gc.1 [call] v30'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55880544c240 con 0x558805442400 2024-04-19T23:45:58.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.162+0000 7fe636417a80 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-04-19T23:45:58.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.162+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:227 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503800 con 0x558805442c00 2024-04-19T23:45:58.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.163+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 83 ==== osd_op_reply(227 gc.2 [call] v30'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.163+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:228 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503c00 con 0x558805442c00 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.163+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 84 ==== osd_op_reply(228 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.163+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.163+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:229 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805503000 con 0x558805442c00 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.163+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 85 ==== osd_op_reply(229 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.163+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:230 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805443000 con 0x558805442c00 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.163+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 86 ==== osd_op_reply(230 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.163+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.163+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:231 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539f000 con 0x558805442c00 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.164+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 87 ==== osd_op_reply(231 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.164+0000 7fe636417a80 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-19T23:45:58.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.164+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:232 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55880539fc00 con 0x558805442c00 2024-04-19T23:45:58.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.165+0000 7fe634bc2700 1 -- 172.21.15.155:0/1394652939 <== osd.3 v2:172.21.15.155:6808/41835 88 ==== osd_op_reply(232 gc.2 [call] v30'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x558805362b40 con 0x558805442c00 2024-04-19T23:45:58.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.165+0000 7fe61b38f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:58.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.165+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94042691641344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474400 con 0x558804f55800 2024-04-19T23:45:58.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.166+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 data_loggenerations_metadata [watch unwatch cookie 94042691641344] v30'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.166+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94042690108160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805474800 con 0x5588052d9400 2024-04-19T23:45:58.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.167+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 notify.0 [watch unwatch cookie 94042690108160] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55880544c240 con 0x5588052d9400 2024-04-19T23:45:58.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.167+0000 7fe636417a80 20 remove_watcher() i=0 2024-04-19T23:45:58.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.167+0000 7fe636417a80 2 removed watcher, disabling cache 2024-04-19T23:45:58.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.167+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94042690109312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805328000 con 0x558804f55800 2024-04-19T23:45:58.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.168+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 notify.1 [watch unwatch cookie 94042690109312] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.168+0000 7fe636417a80 20 remove_watcher() i=1 2024-04-19T23:45:58.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.168+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94042690110464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805328400 con 0x5588052d9000 2024-04-19T23:45:58.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.169+0000 7fe6343c1700 1 -- 172.21.15.155:0/1766663672 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(65 notify.2 [watch unwatch cookie 94042690110464] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805363200 con 0x5588052d9000 2024-04-19T23:45:58.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.169+0000 7fe636417a80 20 remove_watcher() i=2 2024-04-19T23:45:58.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.169+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94042690111616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805328800 con 0x5588052d9400 2024-04-19T23:45:58.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.170+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(66 notify.3 [watch unwatch cookie 94042690111616] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55880544c240 con 0x5588052d9400 2024-04-19T23:45:58.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.170+0000 7fe636417a80 20 remove_watcher() i=3 2024-04-19T23:45:58.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.170+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94042690112768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805328c00 con 0x558804f55800 2024-04-19T23:45:58.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.172+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(67 notify.4 [watch unwatch cookie 94042690112768] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x558804f55800 2024-04-19T23:45:58.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.172+0000 7fe636417a80 20 remove_watcher() i=4 2024-04-19T23:45:58.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.172+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94042690113920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805329000 con 0x55880539e000 2024-04-19T23:45:58.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.173+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(68 notify.5 [watch unwatch cookie 94042690113920] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.173+0000 7fe636417a80 20 remove_watcher() i=5 2024-04-19T23:45:58.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.173+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94042690115072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805329400 con 0x55880539e000 2024-04-19T23:45:58.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.174+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(69 notify.6 [watch unwatch cookie 94042690115072] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.174+0000 7fe636417a80 20 remove_watcher() i=6 2024-04-19T23:45:58.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.174+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94042690116224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558805329800 con 0x55880539e000 2024-04-19T23:45:58.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe634bc2700 1 -- 172.21.15.155:0/1766663672 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(70 notify.7 [watch unwatch cookie 94042690116224] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558805362b40 con 0x55880539e000 2024-04-19T23:45:58.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 20 remove_watcher() i=7 2024-04-19T23:45:58.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55880539e000 msgr2=0x55880523f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55880539e000 0x55880523f180 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558804f55800 msgr2=0x55880523db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558804f55800 0x55880523db80 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5588052d9400 msgr2=0x55880523ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5588052d9400 0x55880523ec00 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5588052d9000 msgr2=0x55880523e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5588052d9000 0x55880523e100 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5588052d8c00 msgr2=0x55880523d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5588052d8c00 0x55880523d600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x558805d2dec0 tx=0x55880529b380 comp rx=0 tx=0).stop 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 msgr2=0x55880523cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 --2- 172.21.15.155:0/1766663672 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f55400 0x55880523cb00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x5588052da5a0 tx=0x558805045b60 comp rx=0 tx=0).stop 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 reap_dead start 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe633bc0700 1 -- 172.21.15.155:0/1766663672 reap_dead start 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 shutdown_connections 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 >> 172.21.15.155:0/1766663672 conn(0x558804f54c00 msgr2=0x558805041800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.175+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 shutdown_connections 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/1766663672 wait complete. 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558805442400 msgr2=0x558805456580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x558805442400 0x558805456580 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55880539f800 msgr2=0x558805456000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55880539f800 0x558805456000 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558805443800 msgr2=0x558805457080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x558805443800 0x558805457080 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558805442c00 msgr2=0x558805456b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x558805442c00 0x558805456b00 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558805442000 msgr2=0x55880523f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558805442000 0x55880523f700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x558805333c50 tx=0x55880529b4a0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 msgr2=0x55880523e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 --2- 172.21.15.155:0/1394652939 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55880539f400 0x55880523e680 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x5588053b61e0 tx=0x55880529b7a0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 reap_dead start 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe6343c1700 1 -- 172.21.15.155:0/1394652939 reap_dead start 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 shutdown_connections 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 >> 172.21.15.155:0/1394652939 conn(0x55880539e800 msgr2=0x558805042000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 shutdown_connections 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/1394652939 wait complete. 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/2497114416 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5588052d8000 msgr2=0x55880523d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 --2- 172.21.15.155:0/2497114416 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5588052d8000 0x55880523d080 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x558805de6f00 tx=0x55880529a540 comp rx=0 tx=0).stop 2024-04-19T23:45:58.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/2497114416 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 msgr2=0x55880523c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 --2- 172.21.15.155:0/2497114416 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x558805d2d5f0 tx=0x558805045920 comp rx=0 tx=0).stop 2024-04-19T23:45:58.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/2497114416 shutdown_connections 2024-04-19T23:45:58.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 --2- 172.21.15.155:0/2497114416 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5588052d8000 0x55880523d080 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 --2- 172.21.15.155:0/2497114416 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x558804f54800 0x55880523c580 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.176+0000 7fe636417a80 1 -- 172.21.15.155:0/2497114416 >> 172.21.15.155:0/2497114416 conn(0x558804f54400 msgr2=0x558805041000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.177+0000 7fe636417a80 1 -- 172.21.15.155:0/2497114416 shutdown_connections 2024-04-19T23:45:58.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.177+0000 7fe636417a80 1 -- 172.21.15.155:0/2497114416 wait complete. 2024-04-19T23:45:58.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-19T23:45:58.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-19T23:45:58.181 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-19T23:45:58.266 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:58.266 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:58.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.268+0000 7fa687e7ba80 1 Processor -- start 2024-04-19T23:45:58.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.268+0000 7fa687e7ba80 1 -- start start 2024-04-19T23:45:58.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.269+0000 7fa687e7ba80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56118c30c800 0x56118c5f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.269+0000 7fa687e7ba80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56118c637500 con 0x56118c30cc00 2024-04-19T23:45:58.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.269+0000 7fa687e7ba80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x56118c3aea00 con 0x56118c30c800 2024-04-19T23:45:58.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.269+0000 7fa685624700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x56118c30cc00 0x56118c3f8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:33532/0 (socket says 172.21.15.155:33532) 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.269+0000 7fa685624700 1 -- 172.21.15.155:0/2593223920 learned_addr learned my addr 172.21.15.155:0/2593223920 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.269+0000 7fa685e25700 1 --2- 172.21.15.155:0/2593223920 >> v2:172.21.15.76:3300/0 conn(0x56118c30c800 0x56118c5f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.269+0000 7fa684e23700 1 -- 172.21.15.155:0/2593223920 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989478588 0 0) 0x56118d0da000 con 0x56118c30cc00 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.269+0000 7fa684e23700 1 -- 172.21.15.155:0/2593223920 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x56118c637680 con 0x56118c30cc00 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.269+0000 7fa685e25700 1 -- 172.21.15.155:0/2593223920 >> v1:172.21.15.76:6789/0 conn(0x56118c30cc00 legacy=0x56118c3f8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.269+0000 7fa685e25700 1 -- 172.21.15.155:0/2593223920 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56118c335d40 con 0x56118c30c800 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.269+0000 7fa685e25700 1 --2- 172.21.15.155:0/2593223920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x56118c5ef9e0 tx=0x56118c3fd980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66dd3a86f113086 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.270+0000 7fa684e23700 1 -- 172.21.15.155:0/2593223920 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c3c54a0 con 0x56118c30c800 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.270+0000 7fa684e23700 1 -- 172.21.15.155:0/2593223920 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56118c637680 con 0x56118c30c800 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.270+0000 7fa684e23700 1 -- 172.21.15.155:0/2593223920 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c3c5600 con 0x56118c30c800 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.270+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2593223920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 msgr2=0x56118c5f4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.270+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/2593223920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x56118c5ef9e0 tx=0x56118c3fd980 comp rx=0 tx=0).stop 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.270+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2593223920 shutdown_connections 2024-04-19T23:45:58.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.270+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/2593223920 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.270+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2593223920 >> 172.21.15.155:0/2593223920 conn(0x56118c30c400 msgr2=0x56118c3f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.270+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2593223920 shutdown_connections 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.270+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2593223920 wait complete. 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.271+0000 7fa687e7ba80 1 Processor -- start 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.271+0000 7fa687e7ba80 1 -- start start 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.271+0000 7fa687e7ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.271+0000 7fa687e7ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118c3ae500 con 0x56118c30c800 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.271+0000 7fa685e25700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.271+0000 7fa685e25700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34986/0 (socket says 172.21.15.155:34986) 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.271+0000 7fa685e25700 1 -- 172.21.15.155:0/561324820 learned_addr learned my addr 172.21.15.155:0/561324820 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.271+0000 7fa685e25700 1 -- 172.21.15.155:0/561324820 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56118c335ba0 con 0x56118c30c800 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa685e25700 1 --2- 172.21.15.155:0/561324820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x56118d0dd800 tx=0x56118c3fd800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880b0f037be3789a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa684622700 1 -- 172.21.15.155:0/561324820 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c3c5760 con 0x56118c30c800 2024-04-19T23:45:58.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa684622700 1 -- 172.21.15.155:0/561324820 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56118c637980 con 0x56118c30c800 2024-04-19T23:45:58.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa684622700 1 -- 172.21.15.155:0/561324820 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c3c54a0 con 0x56118c30c800 2024-04-19T23:45:58.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa687e7ba80 1 -- 172.21.15.155:0/561324820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 msgr2=0x56118c5f4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/561324820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x56118d0dd800 tx=0x56118c3fd800 comp rx=0 tx=0).stop 2024-04-19T23:45:58.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa687e7ba80 1 -- 172.21.15.155:0/561324820 shutdown_connections 2024-04-19T23:45:58.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/561324820 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa687e7ba80 1 -- 172.21.15.155:0/561324820 >> 172.21.15.155:0/561324820 conn(0x56118c30c400 msgr2=0x56118c3f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa687e7ba80 1 -- 172.21.15.155:0/561324820 shutdown_connections 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa687e7ba80 1 -- 172.21.15.155:0/561324820 wait complete. 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.272+0000 7fa687e7ba80 1 Processor -- start 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.273+0000 7fa687e7ba80 1 -- start start 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.273+0000 7fa687e7ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.273+0000 7fa687e7ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118c3ae3c0 con 0x56118c30c800 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.273+0000 7fa685e25700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.273+0000 7fa685e25700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:34996/0 (socket says 172.21.15.155:34996) 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.273+0000 7fa685e25700 1 -- 172.21.15.155:0/2588476007 learned_addr learned my addr 172.21.15.155:0/2588476007 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.273+0000 7fa685e25700 1 -- 172.21.15.155:0/2588476007 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56118c335a00 con 0x56118c30c800 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.273+0000 7fa685e25700 1 --2- 172.21.15.155:0/2588476007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x56118d0ddec0 tx=0x56118c3fd980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.274+0000 7fa682e1f700 1 -- 172.21.15.155:0/2588476007 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c3c5600 con 0x56118c30c800 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.274+0000 7fa682e1f700 1 -- 172.21.15.155:0/2588476007 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56118c637b00 con 0x56118c30c800 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.274+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2588476007 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56118c335860 con 0x56118c30c800 2024-04-19T23:45:58.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.274+0000 7fa682e1f700 1 -- 172.21.15.155:0/2588476007 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c3c58c0 con 0x56118c30c800 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.274+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2588476007 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56118c3356c0 con 0x56118c30c800 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.274+0000 7fa687e7ba80 1 Processor -- start 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.274+0000 7fa687e7ba80 1 -- start start 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.274+0000 7fa687e7ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 0x56118c5f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.274+0000 7fa687e7ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118c3ae000 con 0x56118c30d400 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.274+0000 7fa682e1f700 1 -- 172.21.15.155:0/2588476007 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56118d0aeb00 con 0x56118c30c800 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa682e1f700 1 --2- 172.21.15.155:0/2588476007 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c68a000 0x56118c5f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa682e1f700 1 -- 172.21.15.155:0/2588476007 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56118c387180 con 0x56118c30c800 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa686626700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 0x56118c5f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa686626700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 0x56118c5f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35012/0 (socket says 172.21.15.155:35012) 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa686626700 1 -- 172.21.15.155:0/2568571311 learned_addr learned my addr 172.21.15.155:0/2568571311 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa685e25700 1 --2- 172.21.15.155:0/2588476007 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c68a000 0x56118c5f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa685e25700 1 --2- 172.21.15.155:0/2588476007 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c68a000 0x56118c5f5080 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x56118d19efc0 tx=0x56118c652540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa686626700 1 -- 172.21.15.155:0/2568571311 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56118c334000 con 0x56118c30d400 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa686626700 1 --2- 172.21.15.155:0/2568571311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 0x56118c5f4b00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x56118d19e8d0 tx=0x56118c652720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d7eef5d7b50c66 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa68061a700 1 -- 172.21.15.155:0/2568571311 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c3c5600 con 0x56118c30d400 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa68061a700 1 -- 172.21.15.155:0/2568571311 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56118c3adc80 con 0x56118c30d400 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.275+0000 7fa68061a700 1 -- 172.21.15.155:0/2568571311 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c3c58c0 con 0x56118c30d400 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2568571311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 msgr2=0x56118c5f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/2568571311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 0x56118c5f4b00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x56118d19e8d0 tx=0x56118c652720 comp rx=0 tx=0).stop 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2568571311 shutdown_connections 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/2568571311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 0x56118c5f4b00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2568571311 >> 172.21.15.155:0/2568571311 conn(0x56118c30cc00 msgr2=0x56118c3f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2568571311 shutdown_connections 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2568571311 wait complete. 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa687e7ba80 1 Processor -- start 2024-04-19T23:45:58.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa687e7ba80 1 -- start start 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa687e7ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 0x56118c5f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa687e7ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118c348640 con 0x56118c30d400 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa686626700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 0x56118c5f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.276+0000 7fa686626700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 0x56118c5f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35022/0 (socket says 172.21.15.155:35022) 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.277+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 learned_addr learned my addr 172.21.15.155:0/1492488395 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.277+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56118c334ea0 con 0x56118c30d400 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.277+0000 7fa686626700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 0x56118c5f4b00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x56118d0dd9b0 tx=0x56118c3fdce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.277+0000 7fa67ee17700 1 -- 172.21.15.155:0/1492488395 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c3c5760 con 0x56118c30d400 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.277+0000 7fa67ee17700 1 -- 172.21.15.155:0/1492488395 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56118c3adb00 con 0x56118c30d400 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.277+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56118c334820 con 0x56118c30d400 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.277+0000 7fa67ee17700 1 -- 172.21.15.155:0/1492488395 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c3c5600 con 0x56118c30d400 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.277+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56118c3349c0 con 0x56118c30d400 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.278+0000 7fa687e7ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.278+0000 7fa67ee17700 1 -- 172.21.15.155:0/1492488395 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56118d0aedc0 con 0x56118c30d400 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.278+0000 7fa67ee17700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c68ac00 0x56118c5f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.278+0000 7fa67ee17700 1 -- 172.21.15.155:0/1492488395 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56118c387340 con 0x56118c30d400 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.278+0000 7fa685624700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c68ac00 0x56118c5f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.278+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56118c30d800 0x56118c5f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c30dc00 con 0x56118c30d800 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa686626700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56118c30d800 0x56118c5f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa685624700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c68ac00 0x56118c5f5600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56118d0dc030 tx=0x56118c653320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa686626700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56118c30d800 0x56118c5f5b80 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa687e7ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa687e7ba80 20 realm 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa687e7ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68b000 con 0x56118c30d800 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa687e7ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa687e7ba80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa687e7ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.279+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68b400 con 0x56118c30d800 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa687e7ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa687e7ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68b800 con 0x56118c30d800 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa687e7ba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa687e7ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68bc00 con 0x56118c30d800 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa687e7ba80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:58.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa687e7ba80 20 searching for the correct realm 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56118c68b000 0x56118c5f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68b400 con 0x56118c68b000 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.280+0000 7fa685e25700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56118c68b000 0x56118c5f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.281+0000 7fa685e25700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56118c68b000 0x56118c5f6100 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.281+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.281+0000 7fa685e25700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56118c68b400 0x56118c5f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.281+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198000 con 0x56118c68b400 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.281+0000 7fa685624700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56118c68b400 0x56118c5f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.281+0000 7fa685624700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56118c68b400 0x56118c5f6c00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.282+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.282+0000 7fa685624700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56118d198000 0x56118c5f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.282+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118d198000 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.282+0000 7fa686626700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56118d198000 0x56118c5f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.282+0000 7fa686626700 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56118d198000 0x56118c5f7180 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.283+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.283+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c30d800 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.283+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.283+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c30d800 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.283+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.283+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118d198000 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.283+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.283+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118d198000 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.284+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.284+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b400 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.284+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.284+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b000 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.284+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.284+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c30d800 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.284+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.284+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118d198000 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.285+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.285+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c30d800 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.285+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.285+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b400 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.285+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.285+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b000 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.285+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.285+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b000 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.285+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.285+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118d198000 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.286+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.286+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b000 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.286+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.286+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b000 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.286+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.286+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c30d800 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.286+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.286+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c30d800 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.286+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.286+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118d198000 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.287+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.287+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b000 2024-04-19T23:45:58.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.287+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.287+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b400 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.287+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.287+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c30d800 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.287+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.287+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118d198000 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.288+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.288+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b000 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.288+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.288+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118d198000 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.288+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.288+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b400 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b000 2024-04-19T23:45:58.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118d198000 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c30d800 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b400 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa687e7ba80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa687e7ba80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa687e7ba80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa687e7ba80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa687e7ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.289+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c30dc00 con 0x56118c30d800 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198c00 con 0x56118c30d800 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199000 con 0x56118c68b400 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 20 zone default found 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 4 Realm: () 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:58.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 20 zonegroup default 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.290+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199400 con 0x56118d198000 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa687e7ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa687e7ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199800 con 0x56118c68b000 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa687e7ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa687e7ba80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199c00 con 0x56118c68b000 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa687e7ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa687e7ba80 20 started sync module instance, tier type = 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa687e7ba80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:58.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.291+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198c00 con 0x56118c68b400 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.292+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.292+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94633369451264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c30dc00 con 0x56118c68b400 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.292+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68b800 con 0x56118c30d800 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.293+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94633369451264] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.293+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.293+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94633369452416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68bc00 con 0x56118c30d800 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.293+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118c68b000 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.295+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94633369452416] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.295+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.295+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94633369453568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199000 con 0x56118c68b000 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.295+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198c00 con 0x56118c68b400 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.296+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.296+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94633369454720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198400 con 0x56118c68b400 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.296+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199800 con 0x56118c30d800 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.296+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94633369453568] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.297+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94633369454720] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.297+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.297+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94633369455872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199c00 con 0x56118c30d800 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.297+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198800 con 0x56118d198000 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.298+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.298+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94633369457024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199400 con 0x56118d198000 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.298+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199800 con 0x56118d198000 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.298+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94633369455872] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.299+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94633369457024] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.299+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.299+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94633369458176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199c00 con 0x56118d198000 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.299+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68b800 con 0x56118d198000 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.300+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.300+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94633369459328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68bc00 con 0x56118d198000 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.300+0000 7fa687e7ba80 20 add_watcher() i=0 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.300+0000 7fa687e7ba80 20 add_watcher() i=1 2024-04-19T23:45:58.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.300+0000 7fa687e7ba80 20 add_watcher() i=2 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.300+0000 7fa687e7ba80 20 add_watcher() i=3 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.300+0000 7fa687e7ba80 20 add_watcher() i=4 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.300+0000 7fa687e7ba80 20 add_watcher() i=5 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.301+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94633369458176] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.301+0000 7fa687e7ba80 20 add_watcher() i=6 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.301+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94633369459328] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.301+0000 7fa687e7ba80 20 add_watcher() i=7 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.301+0000 7fa687e7ba80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.301+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68b800 con 0x56118c30d800 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.302+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.302+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94633370968064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68bc00 con 0x56118c30d800 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.303+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94633370968064] v30'169 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.303+0000 7fa66cdf3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.303+0000 7fa687e7ba80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:58.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.303+0000 7fa687e7ba80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.303+0000 7fa687e7ba80 1 Processor -- start 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.303+0000 7fa687e7ba80 1 -- start start 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.303+0000 7fa687e7ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 0x56118c5f6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.303+0000 7fa687e7ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118c348780 con 0x56118d199400 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.304+0000 7fa685624700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 0x56118c5f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.304+0000 7fa685624700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 0x56118c5f6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35028/0 (socket says 172.21.15.155:35028) 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.304+0000 7fa685624700 1 -- 172.21.15.155:0/4290347015 learned_addr learned my addr 172.21.15.155:0/4290347015 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.304+0000 7fa685624700 1 -- 172.21.15.155:0/4290347015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56118c334b60 con 0x56118d199400 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.304+0000 7fa685624700 1 --2- 172.21.15.155:0/4290347015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 0x56118c5f6680 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x56118c7660c0 tx=0x56118c653680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69d2abf365228f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.304+0000 7fa66c5f2700 1 -- 172.21.15.155:0/4290347015 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c778000 con 0x56118d199400 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.304+0000 7fa66c5f2700 1 -- 172.21.15.155:0/4290347015 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56118c76c180 con 0x56118d199400 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.304+0000 7fa66c5f2700 1 -- 172.21.15.155:0/4290347015 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c778160 con 0x56118d199400 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.305+0000 7fa687e7ba80 1 -- 172.21.15.155:0/4290347015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 msgr2=0x56118c5f6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.305+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/4290347015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 0x56118c5f6680 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x56118c7660c0 tx=0x56118c653680 comp rx=0 tx=0).stop 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.305+0000 7fa687e7ba80 1 -- 172.21.15.155:0/4290347015 shutdown_connections 2024-04-19T23:45:58.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.305+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/4290347015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 0x56118c5f6680 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.305+0000 7fa687e7ba80 1 -- 172.21.15.155:0/4290347015 >> 172.21.15.155:0/4290347015 conn(0x56118d198800 msgr2=0x56118c3fa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.305+0000 7fa687e7ba80 1 -- 172.21.15.155:0/4290347015 shutdown_connections 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.305+0000 7fa687e7ba80 1 -- 172.21.15.155:0/4290347015 wait complete. 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.305+0000 7fa687e7ba80 1 Processor -- start 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.305+0000 7fa687e7ba80 1 -- start start 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa687e7ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 0x56118c5f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa687e7ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118c3ae000 con 0x56118d199400 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa685624700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 0x56118c5f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa685624700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 0x56118c5f6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35040/0 (socket says 172.21.15.155:35040) 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 learned_addr learned my addr 172.21.15.155:0/3238166758 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56118c334d00 con 0x56118d199400 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa685624700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 0x56118c5f6680 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x56118c7662d0 tx=0x56118c6537a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa66adef700 1 -- 172.21.15.155:0/3238166758 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c7782c0 con 0x56118d199400 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa66adef700 1 -- 172.21.15.155:0/3238166758 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56118c76c300 con 0x56118d199400 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56118c334340 con 0x56118d199400 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa66adef700 1 -- 172.21.15.155:0/3238166758 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56118c778000 con 0x56118d199400 2024-04-19T23:45:58.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.306+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56118c334b60 con 0x56118d199400 2024-04-19T23:45:58.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.307+0000 7fa66adef700 1 -- 172.21.15.155:0/3238166758 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56118d0afb80 con 0x56118d199400 2024-04-19T23:45:58.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.307+0000 7fa66adef700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c7fa000 0x56118c5f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.307+0000 7fa66adef700 1 -- 172.21.15.155:0/3238166758 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x56118c387500 con 0x56118d199400 2024-04-19T23:45:58.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.307+0000 7fa686626700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c7fa000 0x56118c5f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.307+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56118d199800 0x56118c80e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.308+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199c00 con 0x56118d199800 2024-04-19T23:45:58.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.308+0000 7fa685e25700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56118d199800 0x56118c80e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.308+0000 7fa686626700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c7fa000 0x56118c5f7700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x56118c6f5c80 tx=0x56118c6534a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.308+0000 7fa685e25700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56118d199800 0x56118c80e000 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.309+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.309+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56118c7fa400 0x56118c80e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.309+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fa800 con 0x56118c7fa400 2024-04-19T23:45:58.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.309+0000 7fa685624700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56118c7fa400 0x56118c80e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.310+0000 7fa685624700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56118c7fa400 0x56118c80e580 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.311+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.311+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56118c7fac00 0x56118c80eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.311+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb000 con 0x56118c7fac00 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.311+0000 7fa686626700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56118c7fac00 0x56118c80eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.311+0000 7fa686626700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56118c7fac00 0x56118c80eb00 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.312+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.312+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb400 con 0x56118d199800 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.313+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'170 uv163 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.313+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56118c7fb800 0x56118c80f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.313+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fbc00 con 0x56118c7fb800 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.313+0000 7fa685e25700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56118c7fb800 0x56118c80f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.313+0000 7fa685e25700 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56118c7fb800 0x56118c80f080 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.314+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'56 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.314+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820000 con 0x56118c7fac00 2024-04-19T23:45:58.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.315+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.315+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820400 con 0x56118d199800 2024-04-19T23:45:58.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.316+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.316+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820800 con 0x56118c7fa400 2024-04-19T23:45:58.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.318+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.318+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820c00 con 0x56118c7fb800 2024-04-19T23:45:58.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.319+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.319+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821000 con 0x56118c7fac00 2024-04-19T23:45:58.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.320+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.320+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821400 con 0x56118c7fb800 2024-04-19T23:45:58.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.320+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'57 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.320+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821800 con 0x56118c7fa400 2024-04-19T23:45:58.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.321+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.321+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821c00 con 0x56118c7fb800 2024-04-19T23:45:58.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.322+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.322+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820800 con 0x56118c7fa400 2024-04-19T23:45:58.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.324+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'46 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.324+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820400 con 0x56118d199800 2024-04-19T23:45:58.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.325+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'171 uv165 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.325+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fa800 con 0x56118c7fac00 2024-04-19T23:45:58.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.326+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'55 uv50 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.326+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb400 con 0x56118c7fb800 2024-04-19T23:45:58.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.327+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'58 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.327+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fbc00 con 0x56118c7fac00 2024-04-19T23:45:58.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.327+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.328+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198c00 con 0x56118d199800 2024-04-19T23:45:58.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.329+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.329+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199000 con 0x56118d199800 2024-04-19T23:45:58.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.329+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'172 uv167 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.329+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199c00 con 0x56118c7fac00 2024-04-19T23:45:58.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.331+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'56 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.331+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c30dc00 con 0x56118c7fb800 2024-04-19T23:45:58.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.332+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'32 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.332+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb400 con 0x56118c7fac00 2024-04-19T23:45:58.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.332+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.332+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb000 con 0x56118c7fac00 2024-04-19T23:45:58.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.333+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.333+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fa800 con 0x56118c7fac00 2024-04-19T23:45:58.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.334+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'18 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.334+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fbc00 con 0x56118c7fac00 2024-04-19T23:45:58.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.335+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.335+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820c00 con 0x56118c7fa400 2024-04-19T23:45:58.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.336+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.336+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821400 con 0x56118c7fac00 2024-04-19T23:45:58.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.337+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.337+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821c00 con 0x56118c7fa400 2024-04-19T23:45:58.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.338+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.338+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820400 con 0x56118c7fac00 2024-04-19T23:45:58.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.339+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'57 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.339+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820000 con 0x56118c7fa400 2024-04-19T23:45:58.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.341+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'47 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.341+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821000 con 0x56118c7fb800 2024-04-19T23:45:58.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.342+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.343+0000 7fa6685ea700 20 reqs_thread_entry: start 2024-04-19T23:45:58.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.343+0000 7fa687e7ba80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:58.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.343+0000 7fa687e7ba80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:58.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.343+0000 7fa6665e6700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:28 2024 2024-04-19T23:45:58.343 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:58.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.343+0000 7fa665dc4700 20 reqs_thread_entry: start 2024-04-19T23:45:58.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.343+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:33 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68bc00 con 0x56118d199800 2024-04-19T23:45:58.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.344+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(33 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.344+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:34 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198c00 con 0x56118d199800 2024-04-19T23:45:58.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.344+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(34 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.344+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:35 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821800 con 0x56118d199800 2024-04-19T23:45:58.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.344+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(35 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.344+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:36 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820800 con 0x56118c7fa400 2024-04-19T23:45:58.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.344+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(36 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.344+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:37 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820c00 con 0x56118c7fa400 2024-04-19T23:45:58.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.345+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(37 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.345+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:38 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821c00 con 0x56118c7fa400 2024-04-19T23:45:58.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.345+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(38 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.345+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:39 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820000 con 0x56118c7fac00 2024-04-19T23:45:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.345+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(39 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.346+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:40 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821400 con 0x56118c7fac00 2024-04-19T23:45:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.346+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(40 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.346+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:41 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820400 con 0x56118c7fac00 2024-04-19T23:45:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.346+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(41 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.346+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:42 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820000 con 0x56118d199800 2024-04-19T23:45:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.346+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(42 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.346+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:43 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb400 con 0x56118d199800 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.347+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(43 gc.3 [call out=24b] v0'0 uv163 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.347+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:44 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb000 con 0x56118d199800 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.347+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(44 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.347+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fa800 con 0x56118c7fb800 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.347+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(45 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.347+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:46 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fbc00 con 0x56118c7fb800 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.347+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(46 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.347+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:47 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199c00 con 0x56118c7fb800 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.348+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(47 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.348+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821000 con 0x56118c7fac00 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.348+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(48 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.348+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821800 con 0x56118c7fac00 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.348+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(49 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.348+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:50 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820000 con 0x56118c7fac00 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.348+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(50 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.348+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:51 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199000 con 0x56118d199800 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.349+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(51 gc.6 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.349+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198c00 con 0x56118d199800 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.349+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(52 gc.6 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.349+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68bc00 con 0x56118d199800 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.349+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(53 gc.6 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.349+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c30dc00 con 0x56118c7fa400 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.350+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.350+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68bc00 con 0x56118c7fa400 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.350+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.350+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199c00 con 0x56118c7fa400 2024-04-19T23:45:58.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.350+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.350+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:57 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199000 con 0x56118c7fb800 2024-04-19T23:45:58.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.351+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(57 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.351+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:58 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198c00 con 0x56118c7fb800 2024-04-19T23:45:58.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.351+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(58 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.351+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:59 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb400 con 0x56118c7fb800 2024-04-19T23:45:58.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.351+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(59 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.351+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:60 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb000 con 0x56118c7fac00 2024-04-19T23:45:58.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.351+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(60 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.351+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:61 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fa800 con 0x56118c7fac00 2024-04-19T23:45:58.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.351+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(61 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.351+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:62 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fbc00 con 0x56118c7fac00 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.352+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(62 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.352+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199c00 con 0x56118c7fb800 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.352+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(63 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.352+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68bc00 con 0x56118c7fb800 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.352+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(64 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.352+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c30dc00 con 0x56118c7fb800 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.352+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(65 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.352+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:66 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820800 con 0x56118c7fa400 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.353+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(66 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.353+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820c00 con 0x56118c7fa400 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.353+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(67 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.353+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:68 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821c00 con 0x56118c7fa400 2024-04-19T23:45:58.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.354+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(68 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.354+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4000 con 0x56118c7fb800 2024-04-19T23:45:58.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.354+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(69 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.354+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4400 con 0x56118c7fb800 2024-04-19T23:45:58.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.354+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(70 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.354+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4800 con 0x56118c7fb800 2024-04-19T23:45:58.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.354+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(71 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.354+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4c00 con 0x56118c7fa400 2024-04-19T23:45:58.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.355+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(72 gc.13 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.355+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c5000 con 0x56118c7fa400 2024-04-19T23:45:58.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.355+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(73 gc.13 [call out=24b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.355+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c5400 con 0x56118c7fa400 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.355+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(74 gc.13 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.355+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c5800 con 0x56118d199800 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.356+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(75 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.356+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c5c00 con 0x56118d199800 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.356+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(76 gc.14 [call out=24b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.356+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:77 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4000 con 0x56118d199800 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.356+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(77 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.356+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:78 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4400 con 0x56118c7fac00 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.356+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== osd_op_reply(78 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.356+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:79 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4800 con 0x56118c7fac00 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.357+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(79 gc.15 [call out=24b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.357+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:80 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c30dc00 con 0x56118c7fac00 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.357+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(80 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.357+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:81 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68bc00 con 0x56118c7fb800 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.357+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 20 ==== osd_op_reply(81 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.357+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:82 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199000 con 0x56118c7fb800 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.357+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 21 ==== osd_op_reply(82 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.357+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:83 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198c00 con 0x56118c7fb800 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.357+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 22 ==== osd_op_reply(83 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.357+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:84 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199c00 con 0x56118c7fac00 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.358+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 25 ==== osd_op_reply(84 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.358+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:85 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb400 con 0x56118c7fac00 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.358+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 26 ==== osd_op_reply(85 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.358+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:86 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4400 con 0x56118c7fac00 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.358+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 27 ==== osd_op_reply(86 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.358+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:87 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb000 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.358+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(87 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.358+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:88 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fa800 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.359+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(88 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.359+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:89 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fbc00 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.359+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(89 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.359+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:90 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821400 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.359+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(90 gc.19 [call out=15b] v0'0 uv167 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.359+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:91 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820400 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.359+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(91 gc.19 [call out=24b] v0'0 uv167 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.359+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:92 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821000 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.359+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(92 gc.19 [call out=15b] v0'0 uv167 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118d199800 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.359+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:93 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821800 con 0x56118c7fac00 2024-04-19T23:45:58.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.360+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 28 ==== osd_op_reply(93 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.360+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820000 con 0x56118c7fac00 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.360+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 29 ==== osd_op_reply(94 gc.20 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.360+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821400 con 0x56118c7fac00 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.360+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 30 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.360+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:96 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb000 con 0x56118c7fb800 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.361+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 23 ==== osd_op_reply(96 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.361+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:97 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fa800 con 0x56118c7fb800 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.361+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 24 ==== osd_op_reply(97 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.361+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:98 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fbc00 con 0x56118c7fb800 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.361+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 25 ==== osd_op_reply(98 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.361+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:99 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199000 con 0x56118c7fac00 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.361+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 31 ==== osd_op_reply(99 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.361+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:100 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198c00 con 0x56118c7fac00 2024-04-19T23:45:58.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.362+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 32 ==== osd_op_reply(100 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.362+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:101 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68bc00 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.362+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 33 ==== osd_op_reply(101 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.362+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:102 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c5800 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.362+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 34 ==== osd_op_reply(102 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.362+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:103 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c5c00 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.362+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 35 ==== osd_op_reply(103 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.362+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:104 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4000 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.362+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 36 ==== osd_op_reply(104 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.362+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199c00 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.363+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 37 ==== osd_op_reply(105 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.363+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:106 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199000 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.363+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 38 ==== osd_op_reply(106 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.363+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:107 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198c00 con 0x56118c7fac00 2024-04-19T23:45:58.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.363+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 39 ==== osd_op_reply(107 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.363+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821800 con 0x56118c7fac00 2024-04-19T23:45:58.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.363+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 40 ==== osd_op_reply(108 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.363+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820000 con 0x56118c7fac00 2024-04-19T23:45:58.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.364+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 41 ==== osd_op_reply(109 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.364+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821400 con 0x56118c7fac00 2024-04-19T23:45:58.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.364+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 42 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.364+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:111 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4800 con 0x56118c7fa400 2024-04-19T23:45:58.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.364+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(111 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.364+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4400 con 0x56118c7fa400 2024-04-19T23:45:58.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.365+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(112 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.365+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c7fb400 con 0x56118c7fa400 2024-04-19T23:45:58.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.365+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.365+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c30dc00 con 0x56118c7fac00 2024-04-19T23:45:58.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.365+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 43 ==== osd_op_reply(114 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.365+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c5800 con 0x56118c7fac00 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.366+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 44 ==== osd_op_reply(115 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.366+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c5c00 con 0x56118c7fac00 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.366+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 45 ==== osd_op_reply(116 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.366+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4000 con 0x56118c7fa400 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.366+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(117 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.366+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4c00 con 0x56118c7fa400 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.366+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(118 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.366+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c5000 con 0x56118c7fa400 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.367+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(119 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.367+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:120 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c5400 con 0x56118c7fac00 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.367+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 46 ==== osd_op_reply(120 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.367+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:121 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4800 con 0x56118c7fac00 2024-04-19T23:45:58.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.367+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 47 ==== osd_op_reply(121 gc.29 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.367+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:122 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821800 con 0x56118c7fac00 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.368+0000 7fa686626700 1 -- 172.21.15.155:0/3238166758 <== osd.3 v2:172.21.15.155:6808/41835 48 ==== osd_op_reply(122 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6feb40 con 0x56118c7fac00 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.368+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:123 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820000 con 0x56118c7fa400 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.368+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(123 gc.30 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.368+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:124 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821400 con 0x56118c7fa400 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.368+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(124 gc.30 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.368+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:125 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820800 con 0x56118c7fa400 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.369+0000 7fa685624700 1 -- 172.21.15.155:0/3238166758 <== osd.0 v2:172.21.15.76:6800/39408 28 ==== osd_op_reply(125 gc.30 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff440 con 0x56118c7fa400 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.369+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:126 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820c00 con 0x56118c7fb800 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.369+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 26 ==== osd_op_reply(126 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.369+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:127 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821c00 con 0x56118c7fb800 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.369+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 27 ==== osd_op_reply(127 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.369+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:128 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c30dc00 con 0x56118c7fb800 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.370+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 <== osd.2 v2:172.21.15.155:6812/41834 28 ==== osd_op_reply(128 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x56118c6ff200 con 0x56118c7fb800 2024-04-19T23:45:58.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.370+0000 7fa66cdf3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:58.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.370+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94633370968064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199c00 con 0x56118c30d800 2024-04-19T23:45:58.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.371+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 data_loggenerations_metadata [watch unwatch cookie 94633370968064] v30'173 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.371+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94633369451264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d199000 con 0x56118c68b400 2024-04-19T23:45:58.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.372+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 notify.0 [watch unwatch cookie 94633369451264] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.372+0000 7fa687e7ba80 20 remove_watcher() i=0 2024-04-19T23:45:58.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.372+0000 7fa687e7ba80 2 removed watcher, disabling cache 2024-04-19T23:45:58.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.372+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94633369452416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118d198c00 con 0x56118c30d800 2024-04-19T23:45:58.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.374+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 notify.1 [watch unwatch cookie 94633369452416] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.374+0000 7fa687e7ba80 20 remove_watcher() i=1 2024-04-19T23:45:58.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.374+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94633369453568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c68bc00 con 0x56118c68b000 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.375+0000 7fa685e25700 1 -- 172.21.15.155:0/1492488395 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(65 notify.2 [watch unwatch cookie 94633369453568] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6ff200 con 0x56118c68b000 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.375+0000 7fa687e7ba80 20 remove_watcher() i=2 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.375+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94633369454720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820000 con 0x56118c68b400 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.376+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(66 notify.3 [watch unwatch cookie 94633369454720] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6ff440 con 0x56118c68b400 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.376+0000 7fa687e7ba80 20 remove_watcher() i=3 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.376+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94633369455872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c821400 con 0x56118c30d800 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.377+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(67 notify.4 [watch unwatch cookie 94633369455872] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118c30d800 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.377+0000 7fa687e7ba80 20 remove_watcher() i=4 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.377+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94633369457024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c820800 con 0x56118d198000 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.378+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(68 notify.5 [watch unwatch cookie 94633369457024] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.378+0000 7fa687e7ba80 20 remove_watcher() i=5 2024-04-19T23:45:58.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.378+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94633369458176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4400 con 0x56118d198000 2024-04-19T23:45:58.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.379+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(69 notify.6 [watch unwatch cookie 94633369458176] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.379+0000 7fa687e7ba80 20 remove_watcher() i=6 2024-04-19T23:45:58.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.379+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94633369459328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56118c8c4000 con 0x56118d198000 2024-04-19T23:45:58.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.380+0000 7fa686626700 1 -- 172.21.15.155:0/1492488395 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(70 notify.7 [watch unwatch cookie 94633369459328] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56118c6feb40 con 0x56118d198000 2024-04-19T23:45:58.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.380+0000 7fa687e7ba80 20 remove_watcher() i=7 2024-04-19T23:45:58.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.380+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56118d198000 msgr2=0x56118c5f7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.380+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56118d198000 0x56118c5f7180 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.380+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56118c30d800 msgr2=0x56118c5f5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.380+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56118c30d800 0x56118c5f5b80 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.380+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56118c68b400 msgr2=0x56118c5f6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.382 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.380+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56118c68b400 0x56118c5f6c00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.380+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56118c68b000 msgr2=0x56118c5f6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.380+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56118c68b000 0x56118c5f6100 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c68ac00 msgr2=0x56118c5f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c68ac00 0x56118c5f5600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56118d0dc030 tx=0x56118c653320 comp rx=0 tx=0).stop 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 msgr2=0x56118c5f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/1492488395 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30d400 0x56118c5f4b00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x56118d0dd9b0 tx=0x56118c3fdce0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 reap_dead start 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa685624700 1 -- 172.21.15.155:0/1492488395 reap_dead start 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 shutdown_connections 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 >> 172.21.15.155:0/1492488395 conn(0x56118c30cc00 msgr2=0x56118c3f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 shutdown_connections 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/1492488395 wait complete. 2024-04-19T23:45:58.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56118c7fa400 msgr2=0x56118c80e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56118c7fa400 0x56118c80e580 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56118d199800 msgr2=0x56118c80e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56118d199800 0x56118c80e000 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56118c7fb800 msgr2=0x56118c80f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56118c7fb800 0x56118c80f080 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56118c7fac00 msgr2=0x56118c80eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56118c7fac00 0x56118c80eb00 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c7fa000 msgr2=0x56118c5f7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c7fa000 0x56118c5f7700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x56118c6f5c80 tx=0x56118c6534a0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 msgr2=0x56118c5f6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/3238166758 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118d199400 0x56118c5f6680 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x56118c7662d0 tx=0x56118c6537a0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 reap_dead start 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa685e25700 1 -- 172.21.15.155:0/3238166758 reap_dead start 2024-04-19T23:45:58.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 shutdown_connections 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 >> 172.21.15.155:0/3238166758 conn(0x56118d198800 msgr2=0x56118c3fa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 shutdown_connections 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.381+0000 7fa687e7ba80 1 -- 172.21.15.155:0/3238166758 wait complete. 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.382+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2588476007 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c68a000 msgr2=0x56118c5f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.382+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/2588476007 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c68a000 0x56118c5f5080 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x56118d19efc0 tx=0x56118c652540 comp rx=0 tx=0).stop 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.382+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2588476007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 msgr2=0x56118c5f4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.382+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/2588476007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x56118d0ddec0 tx=0x56118c3fd980 comp rx=0 tx=0).stop 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.382+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2588476007 shutdown_connections 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.382+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/2588476007 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56118c68a000 0x56118c5f5080 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.382+0000 7fa687e7ba80 1 --2- 172.21.15.155:0/2588476007 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56118c30c800 0x56118c5f4580 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.382+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2588476007 >> 172.21.15.155:0/2588476007 conn(0x56118c30c400 msgr2=0x56118c3f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.382+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2588476007 shutdown_connections 2024-04-19T23:45:58.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.382+0000 7fa687e7ba80 1 -- 172.21.15.155:0/2588476007 wait complete. 2024-04-19T23:45:58.386 INFO:teuthology.orchestra.run.smithi155.stdout:[] 2024-04-19T23:45:58.386 DEBUG:tasks.util.rgw: json result: [] 2024-04-19T23:45:58.387 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-19T23:45:58.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-19T23:45:58.387 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-19T23:45:58.432 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:58.432 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:58.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.434+0000 7ff772c02a80 1 Processor -- start 2024-04-19T23:45:58.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.434+0000 7ff772c02a80 1 -- start start 2024-04-19T23:45:58.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.434+0000 7ff772c02a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5637a108c800 0x5637a1374580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.434+0000 7ff772c02a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5637a13b7500 con 0x5637a108cc00 2024-04-19T23:45:58.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.434+0000 7ff772c02a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5637a112ea00 con 0x5637a108c800 2024-04-19T23:45:58.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.434+0000 7ff770bac700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5637a108c800 0x5637a1374580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.434+0000 7ff7703ab700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5637a108cc00 0x5637a1178800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:33538/0 (socket says 172.21.15.155:33538) 2024-04-19T23:45:58.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.434+0000 7ff7703ab700 1 -- 172.21.15.155:0/3889360183 learned_addr learned my addr 172.21.15.155:0/3889360183 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:58.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.435+0000 7ff76fbaa700 1 -- 172.21.15.155:0/3889360183 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976797161 0 0) 0x5637a1e5a000 con 0x5637a108cc00 2024-04-19T23:45:58.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.435+0000 7ff770bac700 1 -- 172.21.15.155:0/3889360183 >> v1:172.21.15.76:6789/0 conn(0x5637a108cc00 legacy=0x5637a1178800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.435+0000 7ff770bac700 1 -- 172.21.15.155:0/3889360183 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637a10b5d40 con 0x5637a108c800 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.435+0000 7ff770bac700 1 --2- 172.21.15.155:0/3889360183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x5637a136f9e0 tx=0x5637a117d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152de9491da6217a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.435+0000 7ff76fbaa700 1 -- 172.21.15.155:0/3889360183 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a11454a0 con 0x5637a108c800 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.435+0000 7ff76fbaa700 1 -- 172.21.15.155:0/3889360183 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637a13b7800 con 0x5637a108c800 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.435+0000 7ff76fbaa700 1 -- 172.21.15.155:0/3889360183 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a1145600 con 0x5637a108c800 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.436+0000 7ff772c02a80 1 -- 172.21.15.155:0/3889360183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 msgr2=0x5637a1374580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.436+0000 7ff772c02a80 1 --2- 172.21.15.155:0/3889360183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x5637a136f9e0 tx=0x5637a117d920 comp rx=0 tx=0).stop 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.436+0000 7ff772c02a80 1 -- 172.21.15.155:0/3889360183 shutdown_connections 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.436+0000 7ff772c02a80 1 --2- 172.21.15.155:0/3889360183 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.436+0000 7ff772c02a80 1 -- 172.21.15.155:0/3889360183 >> 172.21.15.155:0/3889360183 conn(0x5637a108c400 msgr2=0x5637a1178000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.436+0000 7ff772c02a80 1 -- 172.21.15.155:0/3889360183 shutdown_connections 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.436+0000 7ff772c02a80 1 -- 172.21.15.155:0/3889360183 wait complete. 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.436+0000 7ff772c02a80 1 Processor -- start 2024-04-19T23:45:58.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.436+0000 7ff772c02a80 1 -- start start 2024-04-19T23:45:58.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.437+0000 7ff772c02a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.437+0000 7ff772c02a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637a112e500 con 0x5637a108c800 2024-04-19T23:45:58.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.437+0000 7ff770bac700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.437+0000 7ff770bac700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35060/0 (socket says 172.21.15.155:35060) 2024-04-19T23:45:58.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.437+0000 7ff770bac700 1 -- 172.21.15.155:0/399060679 learned_addr learned my addr 172.21.15.155:0/399060679 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.437+0000 7ff770bac700 1 -- 172.21.15.155:0/399060679 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637a10b5ba0 con 0x5637a108c800 2024-04-19T23:45:58.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.437+0000 7ff770bac700 1 --2- 172.21.15.155:0/399060679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x5637a1e5d800 tx=0x5637a117d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee14af0967b191f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.437+0000 7ff76f3a9700 1 -- 172.21.15.155:0/399060679 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a1145760 con 0x5637a108c800 2024-04-19T23:45:58.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.437+0000 7ff76f3a9700 1 -- 172.21.15.155:0/399060679 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637a13b7b00 con 0x5637a108c800 2024-04-19T23:45:58.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.437+0000 7ff76f3a9700 1 -- 172.21.15.155:0/399060679 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a11454a0 con 0x5637a108c800 2024-04-19T23:45:58.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff772c02a80 1 -- 172.21.15.155:0/399060679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 msgr2=0x5637a1374580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff772c02a80 1 --2- 172.21.15.155:0/399060679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x5637a1e5d800 tx=0x5637a117d800 comp rx=0 tx=0).stop 2024-04-19T23:45:58.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff772c02a80 1 -- 172.21.15.155:0/399060679 shutdown_connections 2024-04-19T23:45:58.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff772c02a80 1 --2- 172.21.15.155:0/399060679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff772c02a80 1 -- 172.21.15.155:0/399060679 >> 172.21.15.155:0/399060679 conn(0x5637a108c400 msgr2=0x5637a1179000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff772c02a80 1 -- 172.21.15.155:0/399060679 shutdown_connections 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff772c02a80 1 -- 172.21.15.155:0/399060679 wait complete. 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff772c02a80 1 Processor -- start 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff772c02a80 1 -- start start 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff772c02a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff772c02a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637a112e3c0 con 0x5637a108c800 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff770bac700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff770bac700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35072/0 (socket says 172.21.15.155:35072) 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.438+0000 7ff770bac700 1 -- 172.21.15.155:0/280710118 learned_addr learned my addr 172.21.15.155:0/280710118 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.439+0000 7ff770bac700 1 -- 172.21.15.155:0/280710118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637a10b5a00 con 0x5637a108c800 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.439+0000 7ff770bac700 1 --2- 172.21.15.155:0/280710118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x5637a1e5d9e0 tx=0x5637a117d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.439+0000 7ff76dba6700 1 -- 172.21.15.155:0/280710118 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a1145600 con 0x5637a108c800 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.439+0000 7ff76dba6700 1 -- 172.21.15.155:0/280710118 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637a13b7c80 con 0x5637a108c800 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.439+0000 7ff772c02a80 1 -- 172.21.15.155:0/280710118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5637a10b5860 con 0x5637a108c800 2024-04-19T23:45:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.439+0000 7ff76dba6700 1 -- 172.21.15.155:0/280710118 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a11458c0 con 0x5637a108c800 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.439+0000 7ff772c02a80 1 -- 172.21.15.155:0/280710118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637a10b56c0 con 0x5637a108c800 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff772c02a80 1 Processor -- start 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff772c02a80 1 -- start start 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff772c02a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff772c02a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637a10c8640 con 0x5637a108d400 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff76dba6700 1 -- 172.21.15.155:0/280710118 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5637a1e2eb00 con 0x5637a108c800 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff7713ad700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff7713ad700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35084/0 (socket says 172.21.15.155:35084) 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff7713ad700 1 -- 172.21.15.155:0/2788264757 learned_addr learned my addr 172.21.15.155:0/2788264757 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff76dba6700 1 --2- 172.21.15.155:0/280710118 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a1410000 0x5637a1375080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff76dba6700 1 -- 172.21.15.155:0/280710118 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5637a1107180 con 0x5637a108c800 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff770bac700 1 --2- 172.21.15.155:0/280710118 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a1410000 0x5637a1375080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.440+0000 7ff7713ad700 1 -- 172.21.15.155:0/2788264757 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637a10b4000 con 0x5637a108d400 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff7713ad700 1 --2- 172.21.15.155:0/2788264757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x5637a13fe060 tx=0x5637a117d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a704465b79b1da server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff770bac700 1 --2- 172.21.15.155:0/280710118 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a1410000 0x5637a1375080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5637a1f070e0 tx=0x5637a13d6600 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff76b3a1700 1 -- 172.21.15.155:0/2788264757 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a1145600 con 0x5637a108d400 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff76b3a1700 1 -- 172.21.15.155:0/2788264757 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637a112dc80 con 0x5637a108d400 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff76b3a1700 1 -- 172.21.15.155:0/2788264757 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a11458c0 con 0x5637a108d400 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff772c02a80 1 -- 172.21.15.155:0/2788264757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 msgr2=0x5637a1374b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff772c02a80 1 --2- 172.21.15.155:0/2788264757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x5637a13fe060 tx=0x5637a117d8c0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff772c02a80 1 -- 172.21.15.155:0/2788264757 shutdown_connections 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff772c02a80 1 --2- 172.21.15.155:0/2788264757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff772c02a80 1 -- 172.21.15.155:0/2788264757 >> 172.21.15.155:0/2788264757 conn(0x5637a108cc00 msgr2=0x5637a1179800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff772c02a80 1 -- 172.21.15.155:0/2788264757 shutdown_connections 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff772c02a80 1 -- 172.21.15.155:0/2788264757 wait complete. 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff772c02a80 1 Processor -- start 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.441+0000 7ff772c02a80 1 -- start start 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.442+0000 7ff772c02a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.442+0000 7ff772c02a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637a10c88c0 con 0x5637a108d400 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.442+0000 7ff7713ad700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.442+0000 7ff7713ad700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35098/0 (socket says 172.21.15.155:35098) 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.442+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 learned_addr learned my addr 172.21.15.155:0/1645793858 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.442+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637a10b4ea0 con 0x5637a108d400 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.442+0000 7ff7713ad700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5637a1f06240 tx=0x5637a117d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.443+0000 7ff769b9e700 1 -- 172.21.15.155:0/1645793858 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a1145760 con 0x5637a108d400 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.443+0000 7ff769b9e700 1 -- 172.21.15.155:0/1645793858 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637a112db00 con 0x5637a108d400 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.443+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5637a10b4820 con 0x5637a108d400 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.443+0000 7ff769b9e700 1 -- 172.21.15.155:0/1645793858 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a1145600 con 0x5637a108d400 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.443+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637a10b49c0 con 0x5637a108d400 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.443+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.444+0000 7ff769b9e700 1 -- 172.21.15.155:0/1645793858 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5637a1e2edc0 con 0x5637a108d400 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.444+0000 7ff769b9e700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a1410c00 0x5637a1375600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.444+0000 7ff769b9e700 1 -- 172.21.15.155:0/1645793858 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5637a1107340 con 0x5637a108d400 2024-04-19T23:45:58.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.444+0000 7ff7703ab700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a1410c00 0x5637a1375600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.444+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5637a108d800 0x5637a1375b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.444+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a108dc00 con 0x5637a108d800 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.444+0000 7ff7713ad700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5637a108d800 0x5637a1375b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.444+0000 7ff7703ab700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a1410c00 0x5637a1375600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x5637a1e5c030 tx=0x5637a13d7380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.444+0000 7ff7713ad700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5637a108d800 0x5637a1375b80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff772c02a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff772c02a80 20 realm 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411000 con 0x5637a108d800 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff772c02a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff772c02a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:58.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411400 con 0x5637a108d800 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff772c02a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.445+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411800 con 0x5637a108d800 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.446+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.446+0000 7ff772c02a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.446+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.446+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411c00 con 0x5637a108d800 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.446+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.446+0000 7ff772c02a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.446+0000 7ff772c02a80 20 searching for the correct realm 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.446+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5637a1411000 0x5637a1376100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.446+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411400 con 0x5637a1411000 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.446+0000 7ff770bac700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5637a1411000 0x5637a1376100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.446+0000 7ff770bac700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5637a1411000 0x5637a1376100 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.447+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.447+0000 7ff770bac700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5637a1411400 0x5637a1376c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.447+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0000 con 0x5637a1411400 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.447+0000 7ff7703ab700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5637a1411400 0x5637a1376c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.447+0000 7ff7703ab700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5637a1411400 0x5637a1376c00 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.447+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.447+0000 7ff7703ab700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5637a14d0000 0x5637a1377180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.447+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a14d0000 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.448+0000 7ff7713ad700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5637a14d0000 0x5637a1377180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.448+0000 7ff7713ad700 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5637a14d0000 0x5637a1377180 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.448+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.448+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a108d800 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.449+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.449+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a108d800 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.449+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.449+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a14d0000 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.449+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.449+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a14d0000 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.449+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.449+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411400 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.450+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.450+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411000 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.450+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.450+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a108d800 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.450+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.450+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a14d0000 2024-04-19T23:45:58.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.450+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.450+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a108d800 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.451+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.451+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411400 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.451+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.451+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411000 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.451+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.451+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411000 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.451+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.451+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a14d0000 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.452+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.452+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411000 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.452+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.452+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411000 2024-04-19T23:45:58.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.452+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.452+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a108d800 2024-04-19T23:45:58.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.452+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.452+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a108d800 2024-04-19T23:45:58.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.452+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.452+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a14d0000 2024-04-19T23:45:58.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.453+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.453+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411000 2024-04-19T23:45:58.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.453+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.453+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411400 2024-04-19T23:45:58.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.453+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.453+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a108d800 2024-04-19T23:45:58.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.453+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.453+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a14d0000 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.454+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.454+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411000 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.454+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.454+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a14d0000 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.454+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.454+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411400 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.454+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.454+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411000 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a14d0000 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a108d800 2024-04-19T23:45:58.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411400 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff772c02a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff772c02a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff772c02a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff772c02a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.455+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a108dc00 con 0x5637a108d800 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0c00 con 0x5637a108d800 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1000 con 0x5637a1411400 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 20 zone default found 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 4 Realm: () 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 20 zonegroup default 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.456+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1400 con 0x5637a14d0000 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff772c02a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1800 con 0x5637a1411000 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff772c02a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1c00 con 0x5637a1411000 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff772c02a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff772c02a80 20 started sync module instance, tier type = 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff772c02a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.457+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0c00 con 0x5637a1411400 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.458+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.458+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94796927908608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a108dc00 con 0x5637a1411400 2024-04-19T23:45:58.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.458+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411800 con 0x5637a108d800 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.459+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94796927908608] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.459+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.460+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94796927909760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411c00 con 0x5637a108d800 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.460+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a1411000 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.461+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94796927909760] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.461+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.461+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94796927910912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1000 con 0x5637a1411000 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.461+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0c00 con 0x5637a1411400 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.462+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.462+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94796927912064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0400 con 0x5637a1411400 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.462+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1800 con 0x5637a108d800 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.462+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94796927910912] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.463+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94796927912064] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.463+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.463+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94796927913216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1c00 con 0x5637a108d800 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.463+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0800 con 0x5637a14d0000 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.464+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.464+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94796927914368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1400 con 0x5637a14d0000 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.464+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1800 con 0x5637a14d0000 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.464+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94796927913216] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.465+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94796927914368] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.465+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.465+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94796927915520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1c00 con 0x5637a14d0000 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.465+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411800 con 0x5637a14d0000 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.466+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94796927915520] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.466+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.466+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94796927916672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411c00 con 0x5637a14d0000 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.466+0000 7ff772c02a80 20 add_watcher() i=0 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.466+0000 7ff772c02a80 20 add_watcher() i=1 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.466+0000 7ff772c02a80 20 add_watcher() i=2 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.466+0000 7ff772c02a80 20 add_watcher() i=3 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.466+0000 7ff772c02a80 20 add_watcher() i=4 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.466+0000 7ff772c02a80 20 add_watcher() i=5 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.466+0000 7ff772c02a80 20 add_watcher() i=6 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.467+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94796927916672] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.467+0000 7ff772c02a80 20 add_watcher() i=7 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.467+0000 7ff772c02a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.467+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411800 con 0x5637a108d800 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.468+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.468+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94796929425408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411c00 con 0x5637a108d800 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.469+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94796929425408] v30'174 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.469+0000 7ff757b7a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.469+0000 7ff772c02a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.469+0000 7ff772c02a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.469+0000 7ff772c02a80 1 Processor -- start 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.469+0000 7ff772c02a80 1 -- start start 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.469+0000 7ff772c02a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.469+0000 7ff772c02a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637a112e3c0 con 0x5637a14d1400 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.470+0000 7ff7703ab700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.470+0000 7ff7703ab700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35104/0 (socket says 172.21.15.155:35104) 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.470+0000 7ff7703ab700 1 -- 172.21.15.155:0/110508465 learned_addr learned my addr 172.21.15.155:0/110508465 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.470+0000 7ff7703ab700 1 -- 172.21.15.155:0/110508465 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637a10b4b60 con 0x5637a14d1400 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.470+0000 7ff7703ab700 1 --2- 172.21.15.155:0/110508465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x5637a14e60c0 tx=0x5637a13d7680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f6bf655546530c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.470+0000 7ff757379700 1 -- 172.21.15.155:0/110508465 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a14f6000 con 0x5637a14d1400 2024-04-19T23:45:58.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.470+0000 7ff757379700 1 -- 172.21.15.155:0/110508465 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637a14fe000 con 0x5637a14d1400 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.470+0000 7ff757379700 1 -- 172.21.15.155:0/110508465 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a14f6160 con 0x5637a14d1400 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.471+0000 7ff772c02a80 1 -- 172.21.15.155:0/110508465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 msgr2=0x5637a1376680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.471+0000 7ff772c02a80 1 --2- 172.21.15.155:0/110508465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x5637a14e60c0 tx=0x5637a13d7680 comp rx=0 tx=0).stop 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.471+0000 7ff772c02a80 1 -- 172.21.15.155:0/110508465 shutdown_connections 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.471+0000 7ff772c02a80 1 --2- 172.21.15.155:0/110508465 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.471+0000 7ff772c02a80 1 -- 172.21.15.155:0/110508465 >> 172.21.15.155:0/110508465 conn(0x5637a14d0800 msgr2=0x5637a117a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.471+0000 7ff772c02a80 1 -- 172.21.15.155:0/110508465 shutdown_connections 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.471+0000 7ff772c02a80 1 -- 172.21.15.155:0/110508465 wait complete. 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.471+0000 7ff772c02a80 1 Processor -- start 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.472+0000 7ff772c02a80 1 -- start start 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.472+0000 7ff772c02a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.472+0000 7ff772c02a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637a112e500 con 0x5637a14d1400 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.472+0000 7ff7703ab700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.472+0000 7ff7703ab700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35118/0 (socket says 172.21.15.155:35118) 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.472+0000 7ff7703ab700 1 -- 172.21.15.155:0/1028074228 learned_addr learned my addr 172.21.15.155:0/1028074228 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.472+0000 7ff7703ab700 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637a10b4d00 con 0x5637a14d1400 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.472+0000 7ff7703ab700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5637a14e6300 tx=0x5637a13d77a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.472+0000 7ff755b76700 1 -- 172.21.15.155:0/1028074228 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a14f62c0 con 0x5637a14d1400 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.473+0000 7ff755b76700 1 -- 172.21.15.155:0/1028074228 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637a14fe180 con 0x5637a14d1400 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.473+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5637a10b4340 con 0x5637a14d1400 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.473+0000 7ff755b76700 1 -- 172.21.15.155:0/1028074228 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5637a14f6000 con 0x5637a14d1400 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.473+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637a10b4b60 con 0x5637a14d1400 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.473+0000 7ff755b76700 1 -- 172.21.15.155:0/1028074228 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5637a1e2fb80 con 0x5637a14d1400 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.474+0000 7ff755b76700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a157a000 0x5637a1377700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.474+0000 7ff755b76700 1 -- 172.21.15.155:0/1028074228 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x5637a1107500 con 0x5637a14d1400 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.474+0000 7ff7713ad700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a157a000 0x5637a1377700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.474+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5637a14d1800 0x5637a158e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.474+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1c00 con 0x5637a14d1800 2024-04-19T23:45:58.483 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.474+0000 7ff770bac700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5637a14d1800 0x5637a158e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.474+0000 7ff7713ad700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a157a000 0x5637a1377700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5637a1461ef0 tx=0x5637a13d74a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.474+0000 7ff770bac700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5637a14d1800 0x5637a158e000 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.475+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a14d1800 2024-04-19T23:45:58.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.475+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5637a157a400 0x5637a158e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.475+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157a800 con 0x5637a157a400 2024-04-19T23:45:58.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.475+0000 7ff7703ab700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5637a157a400 0x5637a158e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.476+0000 7ff7703ab700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5637a157a400 0x5637a158e580 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.477+0000 7ff7703ab700 1 -- 172.21.15.155:0/1028074228 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a157a400 2024-04-19T23:45:58.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.477+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5637a157ac00 0x5637a158eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.477+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157b000 con 0x5637a157ac00 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.477+0000 7ff7713ad700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5637a157ac00 0x5637a158eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.477+0000 7ff7713ad700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5637a157ac00 0x5637a158eb00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.478+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.478+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157b400 con 0x5637a14d1800 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.479+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'175 uv163 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a14d1800 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.479+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5637a157b800 0x5637a158f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.479+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157bc00 con 0x5637a157b800 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.479+0000 7ff770bac700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5637a157b800 0x5637a158f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.479+0000 7ff770bac700 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5637a157b800 0x5637a158f080 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.480+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'59 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a157b800 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.480+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ac000 con 0x5637a157ac00 2024-04-19T23:45:58.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.481+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.481+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ac400 con 0x5637a14d1800 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.482+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a14d1800 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.482+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ac800 con 0x5637a157a400 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.484+0000 7ff7703ab700 1 -- 172.21.15.155:0/1028074228 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a157a400 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.484+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15acc00 con 0x5637a157b800 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.485+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a157b800 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.485+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ad000 con 0x5637a157ac00 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.486+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.486+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ad400 con 0x5637a157b800 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.486+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'60 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a157b800 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.486+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ad800 con 0x5637a157a400 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.488+0000 7ff7703ab700 1 -- 172.21.15.155:0/1028074228 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a157a400 2024-04-19T23:45:58.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.488+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15adc00 con 0x5637a157b800 2024-04-19T23:45:58.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.489+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a157b800 2024-04-19T23:45:58.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.489+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ac800 con 0x5637a157a400 2024-04-19T23:45:58.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.490+0000 7ff7703ab700 1 -- 172.21.15.155:0/1028074228 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'48 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a157a400 2024-04-19T23:45:58.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.490+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ac400 con 0x5637a14d1800 2024-04-19T23:45:58.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.491+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'176 uv165 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a14d1800 2024-04-19T23:45:58.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.491+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157a800 con 0x5637a157ac00 2024-04-19T23:45:58.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.492+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'58 uv50 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.492+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157b400 con 0x5637a157b800 2024-04-19T23:45:58.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.493+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'61 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a157b800 2024-04-19T23:45:58.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.493+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157bc00 con 0x5637a157ac00 2024-04-19T23:45:58.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.494+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.494+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0c00 con 0x5637a14d1800 2024-04-19T23:45:58.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.495+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a14d1800 2024-04-19T23:45:58.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.495+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1000 con 0x5637a14d1800 2024-04-19T23:45:58.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.496+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'177 uv167 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a14d1800 2024-04-19T23:45:58.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.496+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d1c00 con 0x5637a157ac00 2024-04-19T23:45:58.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.497+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'59 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.497+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a108dc00 con 0x5637a157b800 2024-04-19T23:45:58.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.498+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'33 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a157b800 2024-04-19T23:45:58.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.498+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157b400 con 0x5637a157ac00 2024-04-19T23:45:58.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.499+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.499+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157b000 con 0x5637a157ac00 2024-04-19T23:45:58.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.500+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.500+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157a800 con 0x5637a157ac00 2024-04-19T23:45:58.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.500+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'19 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.500+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157bc00 con 0x5637a157ac00 2024-04-19T23:45:58.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.501+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.501+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15acc00 con 0x5637a157a400 2024-04-19T23:45:58.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.502+0000 7ff7703ab700 1 -- 172.21.15.155:0/1028074228 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a157a400 2024-04-19T23:45:58.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.502+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ad400 con 0x5637a157ac00 2024-04-19T23:45:58.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.503+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.503+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15adc00 con 0x5637a157a400 2024-04-19T23:45:58.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.504+0000 7ff7703ab700 1 -- 172.21.15.155:0/1028074228 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a157a400 2024-04-19T23:45:58.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.504+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ac400 con 0x5637a157ac00 2024-04-19T23:45:58.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.505+0000 7ff7713ad700 1 -- 172.21.15.155:0/1028074228 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'60 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a157ac00 2024-04-19T23:45:58.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.505+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ac000 con 0x5637a157a400 2024-04-19T23:45:58.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.507+0000 7ff7703ab700 1 -- 172.21.15.155:0/1028074228 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'49 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a157a400 2024-04-19T23:45:58.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.507+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ad000 con 0x5637a157b800 2024-04-19T23:45:58.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.508+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a157b800 2024-04-19T23:45:58.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.509+0000 7ff753371700 20 reqs_thread_entry: start 2024-04-19T23:45:58.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.509+0000 7ff772c02a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:58.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.509+0000 7ff772c02a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:58.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.509+0000 7ff75136d700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:28 2024 2024-04-19T23:45:58.508 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:58.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.509+0000 7ff750b4b700 20 reqs_thread_entry: start 2024-04-19T23:45:58.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.509+0000 7ff772c02a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:58.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.509+0000 7ff772c02a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.509+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411c00 con 0x5637a108d800 2024-04-19T23:45:58.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.510+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.510+0000 7ff772c02a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:58.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.510+0000 7ff772c02a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:58.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.510+0000 7ff772c02a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:58.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.510+0000 7ff772c02a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:58.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.510+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a14d0c00 con 0x5637a1411400 2024-04-19T23:45:58.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.510+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.510 INFO:teuthology.orchestra.run.smithi155.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-19T23:45:58.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.511+0000 7ff757b7a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:58.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.511+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94796929425408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ad400 con 0x5637a108d800 2024-04-19T23:45:58.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.512+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94796929425408] v30'178 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.512+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94796927908608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ac400 con 0x5637a1411400 2024-04-19T23:45:58.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.513+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94796927908608] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.513+0000 7ff772c02a80 20 remove_watcher() i=0 2024-04-19T23:45:58.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.513+0000 7ff772c02a80 2 removed watcher, disabling cache 2024-04-19T23:45:58.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.513+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94796927909760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ad800 con 0x5637a108d800 2024-04-19T23:45:58.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.514+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94796927909760] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.514+0000 7ff772c02a80 20 remove_watcher() i=1 2024-04-19T23:45:58.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.514+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94796927910912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ac800 con 0x5637a1411000 2024-04-19T23:45:58.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.515+0000 7ff770bac700 1 -- 172.21.15.155:0/1645793858 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94796927910912] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1469200 con 0x5637a1411000 2024-04-19T23:45:58.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.515+0000 7ff772c02a80 20 remove_watcher() i=2 2024-04-19T23:45:58.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.515+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94796927912064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15acc00 con 0x5637a1411400 2024-04-19T23:45:58.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.516+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94796927912064] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1469440 con 0x5637a1411400 2024-04-19T23:45:58.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.516+0000 7ff772c02a80 20 remove_watcher() i=3 2024-04-19T23:45:58.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.516+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94796927913216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15adc00 con 0x5637a108d800 2024-04-19T23:45:58.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.517+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94796927913216] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a108d800 2024-04-19T23:45:58.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.517+0000 7ff772c02a80 20 remove_watcher() i=4 2024-04-19T23:45:58.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.517+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94796927914368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a15ac000 con 0x5637a14d0000 2024-04-19T23:45:58.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.518+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94796927914368] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.518+0000 7ff772c02a80 20 remove_watcher() i=5 2024-04-19T23:45:58.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.518+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94796927915520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a1411c00 con 0x5637a14d0000 2024-04-19T23:45:58.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.519+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94796927915520] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.519+0000 7ff772c02a80 20 remove_watcher() i=6 2024-04-19T23:45:58.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.519+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94796927916672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637a157b400 con 0x5637a14d0000 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff7713ad700 1 -- 172.21.15.155:0/1645793858 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94796927916672] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5637a1468b40 con 0x5637a14d0000 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 20 remove_watcher() i=7 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5637a14d0000 msgr2=0x5637a1377180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5637a14d0000 0x5637a1377180 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5637a108d800 msgr2=0x5637a1375b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5637a108d800 0x5637a1375b80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5637a1411400 msgr2=0x5637a1376c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5637a1411400 0x5637a1376c00 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5637a1411000 msgr2=0x5637a1376100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5637a1411000 0x5637a1376100 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a1410c00 msgr2=0x5637a1375600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a1410c00 0x5637a1375600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x5637a1e5c030 tx=0x5637a13d7380 comp rx=0 tx=0).stop 2024-04-19T23:45:58.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 msgr2=0x5637a1374b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.520+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5637a1f06240 tx=0x5637a117d800 comp rx=0 tx=0).stop 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff7703ab700 1 -- 172.21.15.155:0/1645793858 reap_dead start 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 shutdown_connections 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1645793858 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108d400 0x5637a1374b00 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 >> 172.21.15.155:0/1645793858 conn(0x5637a108cc00 msgr2=0x5637a1179800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 shutdown_connections 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1645793858 wait complete. 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5637a157a400 msgr2=0x5637a158e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5637a157a400 0x5637a158e580 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5637a14d1800 msgr2=0x5637a158e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5637a14d1800 0x5637a158e000 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5637a157b800 msgr2=0x5637a158f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5637a157b800 0x5637a158f080 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5637a157ac00 msgr2=0x5637a158eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5637a157ac00 0x5637a158eb00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a157a000 msgr2=0x5637a1377700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a157a000 0x5637a1377700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5637a1461ef0 tx=0x5637a13d74a0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 msgr2=0x5637a1376680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5637a14e6300 tx=0x5637a13d77a0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 shutdown_connections 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5637a157ac00 0x5637a158eb00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5637a157b800 0x5637a158f080 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5637a157a400 0x5637a158e580 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5637a14d1800 0x5637a158e000 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a14d1400 0x5637a1376680 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 --2- 172.21.15.155:0/1028074228 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a157a000 0x5637a1377700 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff770bac700 1 -- 172.21.15.155:0/1028074228 reap_dead start 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 >> 172.21.15.155:0/1028074228 conn(0x5637a14d0800 msgr2=0x5637a117a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 shutdown_connections 2024-04-19T23:45:58.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.521+0000 7ff772c02a80 1 -- 172.21.15.155:0/1028074228 wait complete. 2024-04-19T23:45:58.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.522+0000 7ff772c02a80 1 -- 172.21.15.155:0/280710118 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a1410000 msgr2=0x5637a1375080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.522+0000 7ff772c02a80 1 --2- 172.21.15.155:0/280710118 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a1410000 0x5637a1375080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5637a1f070e0 tx=0x5637a13d6600 comp rx=0 tx=0).stop 2024-04-19T23:45:58.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.522+0000 7ff772c02a80 1 -- 172.21.15.155:0/280710118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 msgr2=0x5637a1374580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.522+0000 7ff772c02a80 1 --2- 172.21.15.155:0/280710118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x5637a1e5d9e0 tx=0x5637a117d920 comp rx=0 tx=0).stop 2024-04-19T23:45:58.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.522+0000 7ff772c02a80 1 -- 172.21.15.155:0/280710118 shutdown_connections 2024-04-19T23:45:58.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.522+0000 7ff772c02a80 1 --2- 172.21.15.155:0/280710118 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5637a1410000 0x5637a1375080 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.522+0000 7ff772c02a80 1 --2- 172.21.15.155:0/280710118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5637a108c800 0x5637a1374580 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.522+0000 7ff772c02a80 1 -- 172.21.15.155:0/280710118 >> 172.21.15.155:0/280710118 conn(0x5637a108c400 msgr2=0x5637a1179000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.522+0000 7ff772c02a80 1 -- 172.21.15.155:0/280710118 shutdown_connections 2024-04-19T23:45:58.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.522+0000 7ff772c02a80 1 -- 172.21.15.155:0/280710118 wait complete. 2024-04-19T23:45:58.526 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-19T23:45:58.537 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-04-19T23:45:58.542 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:58.577 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:58.589 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:58.635 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-19T23:45:58.639 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:58.640 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-19T23:45:58.640 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-19T23:45:58.640 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-19T23:45:58.686 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:58.686 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:58.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.687+0000 7f67e7eaaa80 1 Processor -- start 2024-04-19T23:45:58.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.688+0000 7f67e7eaaa80 1 -- start start 2024-04-19T23:45:58.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.688+0000 7f67e7eaaa80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x563d972bc800 0x563d975a4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.688+0000 7f67e7eaaa80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563d975e7500 con 0x563d972bcc00 2024-04-19T23:45:58.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.688+0000 7f67e7eaaa80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x563d9735ea00 con 0x563d972bc800 2024-04-19T23:45:58.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.688+0000 7f67e5653700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x563d972bcc00 0x563d973a8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:33544/0 (socket says 172.21.15.155:33544) 2024-04-19T23:45:58.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.688+0000 7f67e5e54700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x563d972bc800 0x563d975a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.688+0000 7f67e5653700 1 -- 172.21.15.155:0/3932015901 learned_addr learned my addr 172.21.15.155:0/3932015901 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:58.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.688+0000 7f67e5e54700 1 -- 172.21.15.155:0/3932015901 >> v1:172.21.15.76:6789/0 conn(0x563d972bcc00 legacy=0x563d973a8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.688+0000 7f67e5e54700 1 -- 172.21.15.155:0/3932015901 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d972e5d40 con 0x563d972bc800 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.689+0000 7f67e5e54700 1 --2- 172.21.15.155:0/3932015901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x563d9759f9e0 tx=0x563d973ad920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69f1b5d350290a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.689+0000 7f67e4e52700 1 -- 172.21.15.155:0/3932015901 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d973754a0 con 0x563d972bc800 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.689+0000 7f67e4e52700 1 -- 172.21.15.155:0/3932015901 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d975e7800 con 0x563d972bc800 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.689+0000 7f67e4e52700 1 -- 172.21.15.155:0/3932015901 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d97375600 con 0x563d972bc800 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.689+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3932015901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 msgr2=0x563d975a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.689+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/3932015901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x563d9759f9e0 tx=0x563d973ad920 comp rx=0 tx=0).stop 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.689+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3932015901 shutdown_connections 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.689+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/3932015901 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.689+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3932015901 >> 172.21.15.155:0/3932015901 conn(0x563d972bc400 msgr2=0x563d973a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.689+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3932015901 shutdown_connections 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.689+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3932015901 wait complete. 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.690+0000 7f67e7eaaa80 1 Processor -- start 2024-04-19T23:45:58.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.690+0000 7f67e7eaaa80 1 -- start start 2024-04-19T23:45:58.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.690+0000 7f67e7eaaa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.690+0000 7f67e7eaaa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9735e500 con 0x563d972bc800 2024-04-19T23:45:58.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.690+0000 7f67e5e54700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.690+0000 7f67e5e54700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35140/0 (socket says 172.21.15.155:35140) 2024-04-19T23:45:58.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.690+0000 7f67e5e54700 1 -- 172.21.15.155:0/3810395280 learned_addr learned my addr 172.21.15.155:0/3810395280 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e5e54700 1 -- 172.21.15.155:0/3810395280 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d972e5ba0 con 0x563d972bc800 2024-04-19T23:45:58.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e5e54700 1 --2- 172.21.15.155:0/3810395280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x563d98087d40 tx=0x563d973ad800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f1b6531c2b8734 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e4651700 1 -- 172.21.15.155:0/3810395280 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d97375760 con 0x563d972bc800 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e4651700 1 -- 172.21.15.155:0/3810395280 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d975e7b00 con 0x563d972bc800 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e4651700 1 -- 172.21.15.155:0/3810395280 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d973754a0 con 0x563d972bc800 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3810395280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 msgr2=0x563d975a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/3810395280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x563d98087d40 tx=0x563d973ad800 comp rx=0 tx=0).stop 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3810395280 shutdown_connections 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/3810395280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3810395280 >> 172.21.15.155:0/3810395280 conn(0x563d972bc400 msgr2=0x563d973a9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3810395280 shutdown_connections 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.691+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3810395280 wait complete. 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.692+0000 7f67e7eaaa80 1 Processor -- start 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.692+0000 7f67e7eaaa80 1 -- start start 2024-04-19T23:45:58.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.692+0000 7f67e7eaaa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.692+0000 7f67e7eaaa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9735e3c0 con 0x563d972bc800 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.692+0000 7f67e5e54700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.692+0000 7f67e5e54700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35144/0 (socket says 172.21.15.155:35144) 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.692+0000 7f67e5e54700 1 -- 172.21.15.155:0/4129987530 learned_addr learned my addr 172.21.15.155:0/4129987530 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.692+0000 7f67e5e54700 1 -- 172.21.15.155:0/4129987530 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d972e5a00 con 0x563d972bc800 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.693+0000 7f67e5e54700 1 --2- 172.21.15.155:0/4129987530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x563d98087650 tx=0x563d973ad920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.693+0000 7f67e2e4e700 1 -- 172.21.15.155:0/4129987530 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d97375600 con 0x563d972bc800 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.693+0000 7f67e2e4e700 1 -- 172.21.15.155:0/4129987530 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d975e7c80 con 0x563d972bc800 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.693+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/4129987530 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563d972e5860 con 0x563d972bc800 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.693+0000 7f67e2e4e700 1 -- 172.21.15.155:0/4129987530 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d973758c0 con 0x563d972bc800 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.693+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/4129987530 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d972e56c0 con 0x563d972bc800 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.693+0000 7f67e7eaaa80 1 Processor -- start 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.693+0000 7f67e7eaaa80 1 -- start start 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.693+0000 7f67e7eaaa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 0x563d975a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.693+0000 7f67e7eaaa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d972f8640 con 0x563d972bd400 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e2e4e700 1 -- 172.21.15.155:0/4129987530 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x563d9805eb00 con 0x563d972bc800 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e6655700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 0x563d975a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e6655700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 0x563d975a4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35150/0 (socket says 172.21.15.155:35150) 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e6655700 1 -- 172.21.15.155:0/1478853773 learned_addr learned my addr 172.21.15.155:0/1478853773 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e2e4e700 1 --2- 172.21.15.155:0/4129987530 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d97644000 0x563d975a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e2e4e700 1 -- 172.21.15.155:0/4129987530 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x563d97337180 con 0x563d972bc800 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e5e54700 1 --2- 172.21.15.155:0/4129987530 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d97644000 0x563d975a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e6655700 1 -- 172.21.15.155:0/1478853773 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d972e4000 con 0x563d972bd400 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e5e54700 1 --2- 172.21.15.155:0/4129987530 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d97644000 0x563d975a5080 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x563d98155020 tx=0x563d9760a600 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e6655700 1 --2- 172.21.15.155:0/1478853773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 0x563d975a4b00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x563d98155e90 tx=0x563d973ad8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9caf9a0da69a1e50 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e0649700 1 -- 172.21.15.155:0/1478853773 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d97375600 con 0x563d972bd400 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e0649700 1 -- 172.21.15.155:0/1478853773 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d9735dc80 con 0x563d972bd400 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.694+0000 7f67e0649700 1 -- 172.21.15.155:0/1478853773 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d973758c0 con 0x563d972bd400 2024-04-19T23:45:58.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.695+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/1478853773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 msgr2=0x563d975a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.695+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/1478853773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 0x563d975a4b00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x563d98155e90 tx=0x563d973ad8c0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.695+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/1478853773 shutdown_connections 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.695+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/1478853773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 0x563d975a4b00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.695+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/1478853773 >> 172.21.15.155:0/1478853773 conn(0x563d972bcc00 msgr2=0x563d973a9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.695+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/1478853773 shutdown_connections 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.695+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/1478853773 wait complete. 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.695+0000 7f67e7eaaa80 1 Processor -- start 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.695+0000 7f67e7eaaa80 1 -- start start 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.695+0000 7f67e7eaaa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 0x563d975a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.695+0000 7f67e7eaaa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d972f88c0 con 0x563d972bd400 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.696+0000 7f67e6655700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 0x563d975a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.696+0000 7f67e6655700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 0x563d975a4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35154/0 (socket says 172.21.15.155:35154) 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.696+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 learned_addr learned my addr 172.21.15.155:0/104219584 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.696+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d972e4ea0 con 0x563d972bd400 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.696+0000 7f67e6655700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 0x563d975a4b00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x563d98087e00 tx=0x563d973ad800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.696+0000 7f67dee46700 1 -- 172.21.15.155:0/104219584 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d97375760 con 0x563d972bd400 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.696+0000 7f67dee46700 1 -- 172.21.15.155:0/104219584 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d9735db00 con 0x563d972bd400 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.696+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563d972e4820 con 0x563d972bd400 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.696+0000 7f67dee46700 1 -- 172.21.15.155:0/104219584 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d97375600 con 0x563d972bd400 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.696+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d972e49c0 con 0x563d972bd400 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.697+0000 7f67dee46700 1 -- 172.21.15.155:0/104219584 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x563d9805edc0 con 0x563d972bd400 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.697+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.697+0000 7f67dee46700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d97644c00 0x563d975a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.697+0000 7f67dee46700 1 -- 172.21.15.155:0/104219584 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x563d97337340 con 0x563d972bd400 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.697+0000 7f67e5653700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d97644c00 0x563d975a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.697+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563d972bd800 0x563d975a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.697+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d972bdc00 con 0x563d972bd800 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.697+0000 7f67e6655700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563d972bd800 0x563d975a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e5653700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d97644c00 0x563d975a5600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x563d97639ad0 tx=0x563d9760b380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e6655700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563d972bd800 0x563d975a5b80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e7eaaa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e7eaaa80 20 realm 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97645000 con 0x563d972bd800 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e7eaaa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e7eaaa80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97645400 con 0x563d972bd800 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e7eaaa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.698+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97645800 con 0x563d972bd800 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.699+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.699+0000 7f67e7eaaa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.699+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.699+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97645c00 con 0x563d972bd800 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.699+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.699+0000 7f67e7eaaa80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.699+0000 7f67e7eaaa80 20 searching for the correct realm 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.699+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563d97645000 0x563d975a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.699+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97645400 con 0x563d97645000 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.699+0000 7f67e5e54700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563d97645000 0x563d975a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.699+0000 7f67e5e54700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563d97645000 0x563d975a6100 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.700+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.700+0000 7f67e5e54700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563d97645400 0x563d975a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.700+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704000 con 0x563d97645400 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.700+0000 7f67e5653700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563d97645400 0x563d975a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.700+0000 7f67e5653700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563d97645400 0x563d975a6c00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.700+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.700+0000 7f67e5653700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563d97704000 0x563d975a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.700+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97704000 2024-04-19T23:45:58.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.701+0000 7f67e6655700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563d97704000 0x563d975a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.701+0000 7f67e6655700 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563d97704000 0x563d975a7180 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.701+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.701+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d972bd800 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.702+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.702+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d972bd800 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.702+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.702+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97704000 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.702+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.702+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97704000 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.702+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.702+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645400 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.703+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.703+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645000 2024-04-19T23:45:58.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.703+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.703+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d972bd800 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.703+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.703+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97704000 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.703+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.703+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d972bd800 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.704+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.704+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645400 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.704+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.704+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645000 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.704+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.704+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645000 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.704+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.704+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97704000 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.705+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.705+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645000 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.705+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.705+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645000 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.705+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.705+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d972bd800 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.705+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.705+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d972bd800 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.705+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.706+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97704000 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.706+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.706+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645000 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.706+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.706+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645400 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.706+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.706+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d972bd800 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.707+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.707+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97704000 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.707+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.707+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645000 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.707+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.707+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97704000 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.708+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.708+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645400 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.708+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.708+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645000 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.708+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.708+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97704000 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.708+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.708+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d972bd800 2024-04-19T23:45:58.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645400 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d972bdc00 con 0x563d972bd800 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704c00 con 0x563d972bd800 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.709+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97705000 con 0x563d97645400 2024-04-19T23:45:58.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 20 zone default found 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 4 Realm: () 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 20 zonegroup default 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97705400 con 0x563d97704000 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97705800 con 0x563d97645000 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.710+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97705c00 con 0x563d97645000 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.711+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.711+0000 7f67e7eaaa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.711+0000 7f67e7eaaa80 20 started sync module instance, tier type = 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.711+0000 7f67e7eaaa80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.711+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704c00 con 0x563d97645400 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.712+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.712+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94822532233984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d972bdc00 con 0x563d97645400 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.712+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97645800 con 0x563d972bd800 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.713+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94822532233984] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.713+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.713+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94822532235136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97645c00 con 0x563d972bd800 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.713+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97645000 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.714+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.714+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94822532236288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97705000 con 0x563d97645000 2024-04-19T23:45:58.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.714+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704c00 con 0x563d97645400 2024-04-19T23:45:58.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.714+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94822532235136] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.715+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.715+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94822532237440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704400 con 0x563d97645400 2024-04-19T23:45:58.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.715+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97705800 con 0x563d972bd800 2024-04-19T23:45:58.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.715+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94822532236288] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.716+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94822532237440] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.717+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.717+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94822532238592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97705c00 con 0x563d972bd800 2024-04-19T23:45:58.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.717+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704800 con 0x563d97704000 2024-04-19T23:45:58.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.718+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94822532238592] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.718+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.718+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94822532239744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97705400 con 0x563d97704000 2024-04-19T23:45:58.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.718+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97705800 con 0x563d97704000 2024-04-19T23:45:58.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.719+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94822532239744] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.719+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.719+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94822532240896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97705c00 con 0x563d97704000 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.719+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97645800 con 0x563d97704000 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.720+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94822532240896] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.720+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.720+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94822532242048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97645c00 con 0x563d97704000 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.721+0000 7f67e7eaaa80 20 add_watcher() i=0 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.721+0000 7f67e7eaaa80 20 add_watcher() i=1 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.721+0000 7f67e7eaaa80 20 add_watcher() i=2 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.721+0000 7f67e7eaaa80 20 add_watcher() i=3 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.721+0000 7f67e7eaaa80 20 add_watcher() i=4 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.721+0000 7f67e7eaaa80 20 add_watcher() i=5 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.721+0000 7f67e7eaaa80 20 add_watcher() i=6 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.721+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94822532242048] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.722+0000 7f67e7eaaa80 20 add_watcher() i=7 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.722+0000 7f67e7eaaa80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:58.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.722+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97645800 con 0x563d972bd800 2024-04-19T23:45:58.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.722+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.722+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94822533767168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97645c00 con 0x563d972bd800 2024-04-19T23:45:58.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.723+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94822533767168] v30'179 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.723+0000 7f67cce22700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:58.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.723+0000 7f67e7eaaa80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:58.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.723+0000 7f67e7eaaa80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:58.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.723+0000 7f67e7eaaa80 1 Processor -- start 2024-04-19T23:45:58.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.723+0000 7f67e7eaaa80 1 -- start start 2024-04-19T23:45:58.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.723+0000 7f67e7eaaa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.723+0000 7f67e7eaaa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9735e3c0 con 0x563d97705400 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.724+0000 7f67e5653700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.724+0000 7f67e5653700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35164/0 (socket says 172.21.15.155:35164) 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.724+0000 7f67e5653700 1 -- 172.21.15.155:0/3798636205 learned_addr learned my addr 172.21.15.155:0/3798636205 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.724+0000 7f67e5653700 1 -- 172.21.15.155:0/3798636205 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d972e4b60 con 0x563d97705400 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.724+0000 7f67e5653700 1 --2- 172.21.15.155:0/3798636205 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x563d9771e0c0 tx=0x563d9760b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272ae9ba4802693d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.724+0000 7f67cc621700 1 -- 172.21.15.155:0/3798636205 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d9772a000 con 0x563d97705400 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.724+0000 7f67cc621700 1 -- 172.21.15.155:0/3798636205 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d97732000 con 0x563d97705400 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.724+0000 7f67cc621700 1 -- 172.21.15.155:0/3798636205 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d9772a160 con 0x563d97705400 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.725+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3798636205 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 msgr2=0x563d975a6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.725+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/3798636205 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x563d9771e0c0 tx=0x563d9760b680 comp rx=0 tx=0).stop 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.725+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3798636205 shutdown_connections 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.725+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/3798636205 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.725+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3798636205 >> 172.21.15.155:0/3798636205 conn(0x563d97704800 msgr2=0x563d973aa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.725+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3798636205 shutdown_connections 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.725+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/3798636205 wait complete. 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.725+0000 7f67e7eaaa80 1 Processor -- start 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.725+0000 7f67e7eaaa80 1 -- start start 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.726+0000 7f67e7eaaa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.726+0000 7f67e7eaaa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9735e500 con 0x563d97705400 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.726+0000 7f67e5653700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.726+0000 7f67e5653700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35170/0 (socket says 172.21.15.155:35170) 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.726+0000 7f67e5653700 1 -- 172.21.15.155:0/2677189398 learned_addr learned my addr 172.21.15.155:0/2677189398 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.726+0000 7f67e5653700 1 -- 172.21.15.155:0/2677189398 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d972e4d00 con 0x563d97705400 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.726+0000 7f67e5653700 1 --2- 172.21.15.155:0/2677189398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x563d9771f380 tx=0x563d9760b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.726+0000 7f67cae1e700 1 -- 172.21.15.155:0/2677189398 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d9772a2c0 con 0x563d97705400 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.726+0000 7f67cae1e700 1 -- 172.21.15.155:0/2677189398 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d97732180 con 0x563d97705400 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.726+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/2677189398 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563d972e4340 con 0x563d97705400 2024-04-19T23:45:58.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.726+0000 7f67cae1e700 1 -- 172.21.15.155:0/2677189398 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563d9772a000 con 0x563d97705400 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.727+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/2677189398 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d972e4b60 con 0x563d97705400 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.727+0000 7f67cae1e700 1 -- 172.21.15.155:0/2677189398 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x563d9805fb80 con 0x563d97705400 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.727+0000 7f67cae1e700 1 --2- 172.21.15.155:0/2677189398 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d977ae000 0x563d975a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.727+0000 7f67cae1e700 1 -- 172.21.15.155:0/2677189398 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x563d97337500 con 0x563d97705400 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.728+0000 7f67e7eaaa80 5 note: GC not initialized 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.728+0000 7f67e6655700 1 --2- 172.21.15.155:0/2677189398 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d977ae000 0x563d975a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.728+0000 7f67e6655700 1 --2- 172.21.15.155:0/2677189398 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d977ae000 0x563d975a7700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x563d976a3da0 tx=0x563d9760b4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.728+0000 7f67c8619700 20 reqs_thread_entry: start 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e7eaaa80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e7eaaa80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67c6615700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:29 2024 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67c5df3700 20 reqs_thread_entry: start 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e7eaaa80 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:45:58.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d977ae800 con 0x563d97645400 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e7eaaa80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e7eaaa80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e7eaaa80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e7eaaa80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 : miss 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e7eaaa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.729+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:63 8.f 8:f6caeff1:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d977aec00 con 0x563d97645000 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(63 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e7eaaa80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e7eaaa80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 info.flags=0x17 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e7eaaa80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 to cache LRU end 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e7eaaa80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e7eaaa80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:58.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e7eaaa80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 2024-04-19T23:45:58.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e7eaaa80 20 get_obj_state: rctx=0x563d976e7340 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x563d978181e8 s->prefetch_data=0 2024-04-19T23:45:58.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:64 3.39 3:9c93e7da:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d977af000 con 0x563d97645000 2024-04-19T23:45:58.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(64 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 262+0+864 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e7eaaa80 10 manifest: total_size = 5 2024-04-19T23:45:58.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.730+0000 7f67e7eaaa80 20 get_obj_state: setting s->obj_tag to _sFi6WMs3c5BM0dCI33S8i67X8U_1Ezd 2024-04-19T23:45:58.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.731+0000 7f67cce22700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:58.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.731+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94822533767168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d977af800 con 0x563d972bd800 2024-04-19T23:45:58.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.732+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94822533767168] v30'180 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.732+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94822532233984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d977afc00 con 0x563d97645400 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.733+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94822532233984] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.733+0000 7f67e7eaaa80 20 remove_watcher() i=0 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.733+0000 7f67e7eaaa80 2 removed watcher, disabling cache 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.733+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94822532235136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d977ae800 con 0x563d972bd800 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.735+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94822532235136] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.735+0000 7f67e7eaaa80 20 remove_watcher() i=1 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.735+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94822532236288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d977afc00 con 0x563d97645000 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.736+0000 7f67e5e54700 1 -- 172.21.15.155:0/104219584 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94822532236288] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eb200 con 0x563d97645000 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.736+0000 7f67e7eaaa80 20 remove_watcher() i=2 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.736+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94822532237440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d977af400 con 0x563d97645400 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.737+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94822532237440] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eb440 con 0x563d97645400 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.737+0000 7f67e7eaaa80 20 remove_watcher() i=3 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.737+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94822532238592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97704c00 con 0x563d972bd800 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.738+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94822532238592] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d972bd800 2024-04-19T23:45:58.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.738+0000 7f67e7eaaa80 20 remove_watcher() i=4 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.738+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94822532239744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d972bdc00 con 0x563d97704000 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.739+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94822532239744] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.739+0000 7f67e7eaaa80 20 remove_watcher() i=5 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.739+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94822532240896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97668000 con 0x563d97704000 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.740+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94822532240896] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.740+0000 7f67e7eaaa80 20 remove_watcher() i=6 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.740+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94822532242048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563d97668400 con 0x563d97704000 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e6655700 1 -- 172.21.15.155:0/104219584 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94822532242048] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563d976eab40 con 0x563d97704000 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 20 remove_watcher() i=7 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563d97704000 msgr2=0x563d975a7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563d97704000 0x563d975a7180 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563d972bd800 msgr2=0x563d975a5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563d972bd800 0x563d975a5b80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563d97645400 msgr2=0x563d975a6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563d97645400 0x563d975a6c00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563d97645000 msgr2=0x563d975a6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563d97645000 0x563d975a6100 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d97644c00 msgr2=0x563d975a5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d97644c00 0x563d975a5600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x563d97639ad0 tx=0x563d9760b380 comp rx=0 tx=0).stop 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 msgr2=0x563d975a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/104219584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bd400 0x563d975a4b00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x563d98087e00 tx=0x563d973ad800 comp rx=0 tx=0).stop 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 reap_dead start 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e5653700 1 -- 172.21.15.155:0/104219584 reap_dead start 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 shutdown_connections 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 >> 172.21.15.155:0/104219584 conn(0x563d972bcc00 msgr2=0x563d973a9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.741+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 shutdown_connections 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/104219584 wait complete. 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/2677189398 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d977ae000 msgr2=0x563d975a7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/2677189398 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d977ae000 0x563d975a7700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x563d976a3da0 tx=0x563d9760b4a0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/2677189398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 msgr2=0x563d975a6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/2677189398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x563d9771f380 tx=0x563d9760b7a0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/2677189398 shutdown_connections 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/2677189398 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d977ae000 0x563d975a7700 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/2677189398 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d97705400 0x563d975a6680 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/2677189398 >> 172.21.15.155:0/2677189398 conn(0x563d97704800 msgr2=0x563d973aa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/2677189398 shutdown_connections 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/2677189398 wait complete. 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/4129987530 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d97644000 msgr2=0x563d975a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/4129987530 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d97644000 0x563d975a5080 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x563d98155020 tx=0x563d9760a600 comp rx=0 tx=0).stop 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/4129987530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 msgr2=0x563d975a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/4129987530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x563d98087650 tx=0x563d973ad920 comp rx=0 tx=0).stop 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/4129987530 shutdown_connections 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/4129987530 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563d97644000 0x563d975a5080 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 --2- 172.21.15.155:0/4129987530 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563d972bc800 0x563d975a4580 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/4129987530 >> 172.21.15.155:0/4129987530 conn(0x563d972bc400 msgr2=0x563d973a9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/4129987530 shutdown_connections 2024-04-19T23:45:58.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.742+0000 7f67e7eaaa80 1 -- 172.21.15.155:0/4129987530 wait complete. 2024-04-19T23:45:58.747 INFO:teuthology.orchestra.run.smithi155.stdout:fooFoofooFooFULL_CONTROL 2024-04-19T23:45:58.748 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-04-19T23:45:58.750 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-04-19T23:45:58.754 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:58.754 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-19T23:45:58.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-19T23:45:58.755 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-19T23:45:58.800 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:58.800 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:58.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.802+0000 7f81f5cd1a80 1 Processor -- start 2024-04-19T23:45:58.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.802+0000 7f81f5cd1a80 1 -- start start 2024-04-19T23:45:58.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.802+0000 7f81f5cd1a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55c82557ac00 0x55c825862580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.802+0000 7f81f5cd1a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c8258a5500 con 0x55c82557a800 2024-04-19T23:45:58.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.802+0000 7f81f5cd1a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c82561ca00 con 0x55c82557ac00 2024-04-19T23:45:58.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.802+0000 7f81f3c7b700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55c82557a800 0x55c825666800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:33550/0 (socket says 172.21.15.155:33550) 2024-04-19T23:45:58.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.802+0000 7f81f347a700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55c82557ac00 0x55c825862580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.802+0000 7f81f3c7b700 1 -- 172.21.15.155:0/227724528 learned_addr learned my addr 172.21.15.155:0/227724528 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:58.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.803+0000 7f81f347a700 1 -- 172.21.15.155:0/227724528 >> v1:172.21.15.76:6789/0 conn(0x55c82557a800 legacy=0x55c825666800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.803+0000 7f81f347a700 1 -- 172.21.15.155:0/227724528 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8255a3d40 con 0x55c82557ac00 2024-04-19T23:45:58.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.803+0000 7f81f347a700 1 --2- 172.21.15.155:0/227724528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557ac00 0x55c825862580 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x55c82585d890 tx=0x55c82566b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a333589bf331e40a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.803+0000 7f81f2c79700 1 -- 172.21.15.155:0/227724528 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c8256334a0 con 0x55c82557ac00 2024-04-19T23:45:58.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.803+0000 7f81f2c79700 1 -- 172.21.15.155:0/227724528 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c8258a5800 con 0x55c82557ac00 2024-04-19T23:45:58.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.803+0000 7f81f2c79700 1 -- 172.21.15.155:0/227724528 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c825633600 con 0x55c82557ac00 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.804+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/227724528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557ac00 msgr2=0x55c825862580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.804+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/227724528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557ac00 0x55c825862580 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x55c82585d890 tx=0x55c82566b920 comp rx=0 tx=0).stop 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.804+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/227724528 shutdown_connections 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.804+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/227724528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557ac00 0x55c825862580 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.804+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/227724528 >> 172.21.15.155:0/227724528 conn(0x55c82557a400 msgr2=0x55c825666000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.804+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/227724528 shutdown_connections 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.804+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/227724528 wait complete. 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.804+0000 7f81f5cd1a80 1 Processor -- start 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.804+0000 7f81f5cd1a80 1 -- start start 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.804+0000 7f81f5cd1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.804+0000 7f81f5cd1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c82561c500 con 0x55c82557a800 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.805+0000 7f81f3c7b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.805+0000 7f81f3c7b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35198/0 (socket says 172.21.15.155:35198) 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.805+0000 7f81f3c7b700 1 -- 172.21.15.155:0/3426410126 learned_addr learned my addr 172.21.15.155:0/3426410126 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.805+0000 7f81f3c7b700 1 -- 172.21.15.155:0/3426410126 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8255a3ba0 con 0x55c82557a800 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.805+0000 7f81f3c7b700 1 --2- 172.21.15.155:0/3426410126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x55c826353e00 tx=0x55c82566bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ab5ccc8c062edc server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.805+0000 7f81f2478700 1 -- 172.21.15.155:0/3426410126 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c8256334a0 con 0x55c82557a800 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.805+0000 7f81f2478700 1 -- 172.21.15.155:0/3426410126 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c8258a5b00 con 0x55c82557a800 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.805+0000 7f81f2478700 1 -- 172.21.15.155:0/3426410126 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c825633600 con 0x55c82557a800 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/3426410126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 msgr2=0x55c825862580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/3426410126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x55c826353e00 tx=0x55c82566bb60 comp rx=0 tx=0).stop 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/3426410126 shutdown_connections 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/3426410126 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/3426410126 >> 172.21.15.155:0/3426410126 conn(0x55c82557a400 msgr2=0x55c825667000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/3426410126 shutdown_connections 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/3426410126 wait complete. 2024-04-19T23:45:58.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f5cd1a80 1 Processor -- start 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f5cd1a80 1 -- start start 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f5cd1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f5cd1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c82561c3c0 con 0x55c82557a800 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f3c7b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f3c7b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35214/0 (socket says 172.21.15.155:35214) 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.806+0000 7f81f3c7b700 1 -- 172.21.15.155:0/298219426 learned_addr learned my addr 172.21.15.155:0/298219426 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.807+0000 7f81f3c7b700 1 -- 172.21.15.155:0/298219426 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8255a3a00 con 0x55c82557a800 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.807+0000 7f81f3c7b700 1 --2- 172.21.15.155:0/298219426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55c826353e60 tx=0x55c82566ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.807+0000 7f81f0c75700 1 -- 172.21.15.155:0/298219426 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c8256338c0 con 0x55c82557a800 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.807+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/298219426 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c8255a3860 con 0x55c82557a800 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.807+0000 7f81f0c75700 1 -- 172.21.15.155:0/298219426 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c82561bc80 con 0x55c82557a800 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.807+0000 7f81f0c75700 1 -- 172.21.15.155:0/298219426 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c8256334a0 con 0x55c82557a800 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.807+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/298219426 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8255a36c0 con 0x55c82557a800 2024-04-19T23:45:58.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.807+0000 7f81f5cd1a80 1 Processor -- start 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.808+0000 7f81f5cd1a80 1 -- start start 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.808+0000 7f81f5cd1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 0x55c825862b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.808+0000 7f81f5cd1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8255b6640 con 0x55c82557b400 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.808+0000 7f81f0c75700 1 -- 172.21.15.155:0/298219426 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c82631cb00 con 0x55c82557a800 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.808+0000 7f81f447c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 0x55c825862b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.808+0000 7f81f447c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 0x55c825862b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35222/0 (socket says 172.21.15.155:35222) 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.808+0000 7f81f447c700 1 -- 172.21.15.155:0/2576756175 learned_addr learned my addr 172.21.15.155:0/2576756175 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.808+0000 7f81f0c75700 1 --2- 172.21.15.155:0/298219426 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c82590a000 0x55c825863080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.808+0000 7f81f0c75700 1 -- 172.21.15.155:0/298219426 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55c8255f5180 con 0x55c82557a800 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.808+0000 7f81f3c7b700 1 --2- 172.21.15.155:0/298219426 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c82590a000 0x55c825863080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.808+0000 7f81f447c700 1 -- 172.21.15.155:0/2576756175 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8255a2000 con 0x55c82557b400 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81f3c7b700 1 --2- 172.21.15.155:0/298219426 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c82590a000 0x55c825863080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55c8263fd6e0 tx=0x55c8258d0240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81f447c700 1 --2- 172.21.15.155:0/2576756175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 0x55c825862b00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x55c8258e6690 tx=0x55c8258d0120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb951ab565e17e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81ee470700 1 -- 172.21.15.155:0/2576756175 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c8256338c0 con 0x55c82557b400 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81ee470700 1 -- 172.21.15.155:0/2576756175 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c8258a4300 con 0x55c82557b400 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81ee470700 1 -- 172.21.15.155:0/2576756175 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c8256334a0 con 0x55c82557b400 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/2576756175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 msgr2=0x55c825862b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/2576756175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 0x55c825862b00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x55c8258e6690 tx=0x55c8258d0120 comp rx=0 tx=0).stop 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/2576756175 shutdown_connections 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/2576756175 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 0x55c825862b00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/2576756175 >> 172.21.15.155:0/2576756175 conn(0x55c82557ac00 msgr2=0x55c825667800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/2576756175 shutdown_connections 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/2576756175 wait complete. 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81f5cd1a80 1 Processor -- start 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.809+0000 7f81f5cd1a80 1 -- start start 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81f5cd1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 0x55c825862b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81f5cd1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8255b68c0 con 0x55c82557b400 2024-04-19T23:45:58.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81f447c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 0x55c825862b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81f447c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 0x55c825862b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35224/0 (socket says 172.21.15.155:35224) 2024-04-19T23:45:58.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 learned_addr learned my addr 172.21.15.155:0/1981130978 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8255a2ea0 con 0x55c82557b400 2024-04-19T23:45:58.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81f447c700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 0x55c825862b00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x55c826353fb0 tx=0x55c8258d08a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81ecc6d700 1 -- 172.21.15.155:0/1981130978 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c825633b80 con 0x55c82557b400 2024-04-19T23:45:58.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81ecc6d700 1 -- 172.21.15.155:0/1981130978 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c82561bc80 con 0x55c82557b400 2024-04-19T23:45:58.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c8255a2820 con 0x55c82557b400 2024-04-19T23:45:58.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81ecc6d700 1 -- 172.21.15.155:0/1981130978 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c8256338c0 con 0x55c82557b400 2024-04-19T23:45:58.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.810+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8255a29c0 con 0x55c82557b400 2024-04-19T23:45:58.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.811+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.811+0000 7f81ecc6d700 1 -- 172.21.15.155:0/1981130978 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c82631cdc0 con 0x55c82557b400 2024-04-19T23:45:58.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.812+0000 7f81ecc6d700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c82590ac00 0x55c825863600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.812+0000 7f81ecc6d700 1 -- 172.21.15.155:0/1981130978 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55c8255f5340 con 0x55c82557b400 2024-04-19T23:45:58.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.812+0000 7f81f347a700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c82590ac00 0x55c825863600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.812+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c82557b800 0x55c825863b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.812+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82557bc00 con 0x55c82557b800 2024-04-19T23:45:58.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.812+0000 7f81f447c700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c82557b800 0x55c825863b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.812+0000 7f81f347a700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c82590ac00 0x55c825863600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55c82585d890 tx=0x55c82566b800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.812+0000 7f81f447c700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c82557b800 0x55c825863b80 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 20 realm 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82590b000 con 0x55c82557b800 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82590b400 con 0x55c82557b800 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82590b800 con 0x55c82557b800 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.813+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82590bc00 con 0x55c82557b800 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.814+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.814+0000 7f81f5cd1a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.814+0000 7f81f5cd1a80 20 searching for the correct realm 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.814+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c82590b000 0x55c825864100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.814+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82590b400 con 0x55c82590b000 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.814+0000 7f81f3c7b700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c82590b000 0x55c825864100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.814+0000 7f81f3c7b700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c82590b000 0x55c825864100 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.814+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.814+0000 7f81f3c7b700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c82590b400 0x55c825864c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.814+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4000 con 0x55c82590b400 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.815+0000 7f81f347a700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c82590b400 0x55c825864c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.815+0000 7f81f347a700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c82590b400 0x55c825864c00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.815+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.815+0000 7f81f347a700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c8259c4000 0x55c825865180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.815+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c8259c4000 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.815+0000 7f81f447c700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c8259c4000 0x55c825865180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.816+0000 7f81f447c700 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c8259c4000 0x55c825865180 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.816+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.816+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82557b800 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.816+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.816+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82557b800 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.816+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.816+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c8259c4000 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.817+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.817+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c8259c4000 2024-04-19T23:45:58.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.817+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.817+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b400 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.817+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.817+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b000 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.817+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.817+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82557b800 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.818+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.818+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c8259c4000 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.818+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.818+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82557b800 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.818+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.818+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b400 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.819+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.819+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b000 2024-04-19T23:45:58.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.819+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.819+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b000 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.819+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.819+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c8259c4000 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.819+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.819+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b000 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.819+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.819+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b000 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.820+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.820+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82557b800 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.820+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.820+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82557b800 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.820+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.820+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c8259c4000 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.820+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.820+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b000 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.821+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.821+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b400 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.821+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.821+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82557b800 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.821+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.821+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c8259c4000 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.821+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.821+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b000 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.822+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.822+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c8259c4000 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.822+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.822+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b400 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.822+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.834 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.822+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b000 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.822+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.822+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c8259c4000 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.823+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.823+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82557b800 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.823+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.823+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b400 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.823+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.823+0000 7f81f5cd1a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.823+0000 7f81f5cd1a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.823+0000 7f81f5cd1a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.823+0000 7f81f5cd1a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.823+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82557bc00 con 0x55c82557b800 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4c00 con 0x55c82557b800 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c5000 con 0x55c82590b400 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 20 zone default found 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 4 Realm: () 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 20 zonegroup default 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.824+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c5400 con 0x55c8259c4000 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f5cd1a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c5800 con 0x55c82590b000 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f5cd1a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c5c00 con 0x55c82590b000 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f5cd1a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f5cd1a80 20 started sync module instance, tier type = 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f5cd1a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.825+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4c00 con 0x55c82590b400 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.826+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.826+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94318111333120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82557bc00 con 0x55c82590b400 2024-04-19T23:45:58.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.826+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82590b800 con 0x55c82557b800 2024-04-19T23:45:58.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.827+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94318111333120] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.827+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.828+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94318111334272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82590bc00 con 0x55c82557b800 2024-04-19T23:45:58.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.828+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c82590b000 2024-04-19T23:45:58.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.829+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.829+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94318111335424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c5000 con 0x55c82590b000 2024-04-19T23:45:58.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.829+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4c00 con 0x55c82590b400 2024-04-19T23:45:58.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.829+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94318111334272] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.830+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.830+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94318111336576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4400 con 0x55c82590b400 2024-04-19T23:45:58.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.830+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c5800 con 0x55c82557b800 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.830+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94318111335424] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.831+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94318111336576] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.831+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.831+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94318111337728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c5c00 con 0x55c82557b800 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.831+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4800 con 0x55c8259c4000 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.832+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.832+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94318111338880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c5400 con 0x55c8259c4000 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.832+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c5800 con 0x55c8259c4000 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.833+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94318111337728] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.833+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94318111338880] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.834+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.834+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94318111340032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c5c00 con 0x55c8259c4000 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.834+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82590b800 con 0x55c8259c4000 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.835+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(58 notify.7 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.835+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94318111340032] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.835+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94318111341184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82590bc00 con 0x55c8259c4000 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.835+0000 7f81f5cd1a80 20 add_watcher() i=0 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.835+0000 7f81f5cd1a80 20 add_watcher() i=1 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.835+0000 7f81f5cd1a80 20 add_watcher() i=2 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.835+0000 7f81f5cd1a80 20 add_watcher() i=3 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.835+0000 7f81f5cd1a80 20 add_watcher() i=4 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.835+0000 7f81f5cd1a80 20 add_watcher() i=5 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.835+0000 7f81f5cd1a80 20 add_watcher() i=6 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.836+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94318111341184] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.836+0000 7f81f5cd1a80 20 add_watcher() i=7 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.836+0000 7f81f5cd1a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.836+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82590b800 con 0x55c82557b800 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.836+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.836+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94318112890880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82590bc00 con 0x55c82557b800 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.837+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94318112890880] v30'181 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.837+0000 7f81dac49700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.837+0000 7f81f5cd1a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.837+0000 7f81f5cd1a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.837+0000 7f81f5cd1a80 1 Processor -- start 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.838+0000 7f81f5cd1a80 1 -- start start 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.838+0000 7f81f5cd1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.838+0000 7f81f5cd1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c82561c3c0 con 0x55c8259c5400 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.838+0000 7f81f347a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.838+0000 7f81f347a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35234/0 (socket says 172.21.15.155:35234) 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.838+0000 7f81f347a700 1 -- 172.21.15.155:0/3024987036 learned_addr learned my addr 172.21.15.155:0/3024987036 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.838+0000 7f81f347a700 1 -- 172.21.15.155:0/3024987036 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8255a2b60 con 0x55c8259c5400 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.839+0000 7f81f347a700 1 --2- 172.21.15.155:0/3024987036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55c8259de000 tx=0x55c8258d16e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5878fe077d2d380 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.839+0000 7f81da448700 1 -- 172.21.15.155:0/3024987036 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c825633760 con 0x55c8259c5400 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.839+0000 7f81da448700 1 -- 172.21.15.155:0/3024987036 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c8259ee000 con 0x55c8259c5400 2024-04-19T23:45:58.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.839+0000 7f81da448700 1 -- 172.21.15.155:0/3024987036 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c8259f0000 con 0x55c8259c5400 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.839+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/3024987036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 msgr2=0x55c825864680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.839+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/3024987036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55c8259de000 tx=0x55c8258d16e0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/3024987036 shutdown_connections 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/3024987036 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/3024987036 >> 172.21.15.155:0/3024987036 conn(0x55c8259c4800 msgr2=0x55c825668000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/3024987036 shutdown_connections 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/3024987036 wait complete. 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f5cd1a80 1 Processor -- start 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f5cd1a80 1 -- start start 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f5cd1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f5cd1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c82561c500 con 0x55c8259c5400 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f347a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f347a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35238/0 (socket says 172.21.15.155:35238) 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.840+0000 7f81f347a700 1 -- 172.21.15.155:0/1371165610 learned_addr learned my addr 172.21.15.155:0/1371165610 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.841+0000 7f81f347a700 1 -- 172.21.15.155:0/1371165610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8255a2d00 con 0x55c8259c5400 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.841+0000 7f81f347a700 1 --2- 172.21.15.155:0/1371165610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x55c8259de1e0 tx=0x55c8258d1800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.841+0000 7f81d8c45700 1 -- 172.21.15.155:0/1371165610 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c8259f0160 con 0x55c8259c5400 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.841+0000 7f81d8c45700 1 -- 172.21.15.155:0/1371165610 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c8259ee180 con 0x55c8259c5400 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.841+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1371165610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c8255a2340 con 0x55c8259c5400 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.841+0000 7f81d8c45700 1 -- 172.21.15.155:0/1371165610 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c8259f02c0 con 0x55c8259c5400 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.841+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1371165610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8255a3d40 con 0x55c8259c5400 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.842+0000 7f81d8c45700 1 -- 172.21.15.155:0/1371165610 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c82631db80 con 0x55c8259c5400 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.842+0000 7f81d8c45700 1 --2- 172.21.15.155:0/1371165610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c825a66000 0x55c825865700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.842+0000 7f81d8c45700 1 -- 172.21.15.155:0/1371165610 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55c8255f5500 con 0x55c8259c5400 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.842+0000 7f81f447c700 1 --2- 172.21.15.155:0/1371165610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c825a66000 0x55c825865700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.842+0000 7f81f5cd1a80 5 note: GC not initialized 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.842+0000 7f81f447c700 1 --2- 172.21.15.155:0/1371165610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c825a66000 0x55c825865700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55c825961f80 tx=0x55c8258d00c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.843+0000 7f81d6440700 20 reqs_thread_entry: start 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.843+0000 7f81f5cd1a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:58.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.843+0000 7f81f5cd1a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.843+0000 7f81d443c700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:29 2024 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.843+0000 7f81d3c1a700 20 reqs_thread_entry: start 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.843+0000 7f81f5cd1a80 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.843+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.843+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c825a66800 con 0x55c82590b400 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 : miss 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:63 8.f 8:f6caeff1:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c825a66c00 con 0x55c82590b000 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(63 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:58.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 info.flags=0x17 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 to cache LRU end 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 20 get_obj_state: rctx=0x55c825985500 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c825ad41e8 s->prefetch_data=0 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:64 3.39 3:9c93e7da:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c825a67000 con 0x55c82590b000 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(64 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 10 manifest: total_size = 5 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.844+0000 7f81f5cd1a80 20 get_obj_state: setting s->obj_tag to _R2SAs0DYNbNs2q1wYJZxFOCMVCm4oHn 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.845+0000 7f81dac49700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.845+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94318112890880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c825a67800 con 0x55c82557b800 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.846+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94318112890880] v30'182 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.846+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94318111333120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c825a67c00 con 0x55c82590b400 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.847+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94318111333120] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.847+0000 7f81f5cd1a80 20 remove_watcher() i=0 2024-04-19T23:45:58.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.847+0000 7f81f5cd1a80 2 removed watcher, disabling cache 2024-04-19T23:45:58.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.847+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94318111334272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c825a66800 con 0x55c82557b800 2024-04-19T23:45:58.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.848+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94318111334272] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.849+0000 7f81f5cd1a80 20 remove_watcher() i=1 2024-04-19T23:45:58.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.849+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94318111335424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c825a67c00 con 0x55c82590b000 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.850+0000 7f81f3c7b700 1 -- 172.21.15.155:0/1981130978 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94318111335424] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259ab200 con 0x55c82590b000 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.850+0000 7f81f5cd1a80 20 remove_watcher() i=2 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.850+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94318111336576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c825a67400 con 0x55c82590b400 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.851+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94318111336576] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259ab440 con 0x55c82590b400 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.851+0000 7f81f5cd1a80 20 remove_watcher() i=3 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.851+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94318111337728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8259c4c00 con 0x55c82557b800 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.852+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94318111337728] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c82557b800 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.852+0000 7f81f5cd1a80 20 remove_watcher() i=4 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.852+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94318111338880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c82557bc00 con 0x55c8259c4000 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.853+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94318111338880] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.853+0000 7f81f5cd1a80 20 remove_watcher() i=5 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.853+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94318111340032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c825990000 con 0x55c8259c4000 2024-04-19T23:45:58.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.854+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94318111340032] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.854+0000 7f81f5cd1a80 20 remove_watcher() i=6 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.854+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94318111341184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c825990400 con 0x55c8259c4000 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f447c700 1 -- 172.21.15.155:0/1981130978 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94318111341184] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c8259aab40 con 0x55c8259c4000 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 20 remove_watcher() i=7 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c8259c4000 msgr2=0x55c825865180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c8259c4000 0x55c825865180 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c82557b800 msgr2=0x55c825863b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c82557b800 0x55c825863b80 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c82590b400 msgr2=0x55c825864c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c82590b400 0x55c825864c00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c82590b000 msgr2=0x55c825864100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c82590b000 0x55c825864100 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c82590ac00 msgr2=0x55c825863600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c82590ac00 0x55c825863600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55c82585d890 tx=0x55c82566b800 comp rx=0 tx=0).stop 2024-04-19T23:45:58.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 msgr2=0x55c825862b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1981130978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557b400 0x55c825862b00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x55c826353fb0 tx=0x55c8258d08a0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 reap_dead start 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f347a700 1 -- 172.21.15.155:0/1981130978 reap_dead start 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 shutdown_connections 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 >> 172.21.15.155:0/1981130978 conn(0x55c82557ac00 msgr2=0x55c825667800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 shutdown_connections 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.855+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1981130978 wait complete. 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1371165610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c825a66000 msgr2=0x55c825865700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1371165610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c825a66000 0x55c825865700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55c825961f80 tx=0x55c8258d00c0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1371165610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 msgr2=0x55c825864680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1371165610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x55c8259de1e0 tx=0x55c8258d1800 comp rx=0 tx=0).stop 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1371165610 shutdown_connections 2024-04-19T23:45:58.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1371165610 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c825a66000 0x55c825865700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/1371165610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c8259c5400 0x55c825864680 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1371165610 >> 172.21.15.155:0/1371165610 conn(0x55c8259c4800 msgr2=0x55c825668000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1371165610 shutdown_connections 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/1371165610 wait complete. 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/298219426 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c82590a000 msgr2=0x55c825863080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/298219426 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c82590a000 0x55c825863080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55c8263fd6e0 tx=0x55c8258d0240 comp rx=0 tx=0).stop 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/298219426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 msgr2=0x55c825862580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/298219426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55c826353e60 tx=0x55c82566ba40 comp rx=0 tx=0).stop 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/298219426 shutdown_connections 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/298219426 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c82590a000 0x55c825863080 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 --2- 172.21.15.155:0/298219426 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c82557a800 0x55c825862580 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/298219426 >> 172.21.15.155:0/298219426 conn(0x55c82557a400 msgr2=0x55c825667000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/298219426 shutdown_connections 2024-04-19T23:45:58.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.856+0000 7f81f5cd1a80 1 -- 172.21.15.155:0/298219426 wait complete. 2024-04-19T23:45:58.863 INFO:teuthology.orchestra.run.smithi155.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-19T23:45:58.863 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-19T23:45:58.866 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-04-19T23:45:58.869 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:58.922 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-19T23:45:58.923 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-19T23:45:58.923 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-19T23:45:58.923 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-19T23:45:58.923 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-19T23:45:58.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-19T23:45:58.923 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-04-19T23:45:58.969 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:58.969 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:58.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.971+0000 7f75fb313a80 1 Processor -- start 2024-04-19T23:45:58.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.971+0000 7f75fb313a80 1 -- start start 2024-04-19T23:45:58.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.971+0000 7f75fb313a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x563264a3c800 0x563264d24580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.971+0000 7f75fb313a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563264d67500 con 0x563264a3cc00 2024-04-19T23:45:58.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.971+0000 7f75fb313a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x563264adea00 con 0x563264a3c800 2024-04-19T23:45:58.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.971+0000 7f75f8abc700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x563264a3cc00 0x563264b28800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:33566/0 (socket says 172.21.15.155:33566) 2024-04-19T23:45:58.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.971+0000 7f75f8abc700 1 -- 172.21.15.155:0/412709244 learned_addr learned my addr 172.21.15.155:0/412709244 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:58.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.971+0000 7f75f92bd700 1 --2- 172.21.15.155:0/412709244 >> v2:172.21.15.76:3300/0 conn(0x563264a3c800 0x563264d24580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.972+0000 7f75f82bb700 1 -- 172.21.15.155:0/412709244 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398536868 0 0) 0x56326580a000 con 0x563264a3cc00 2024-04-19T23:45:58.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.972+0000 7f75f92bd700 1 -- 172.21.15.155:0/412709244 >> v1:172.21.15.76:6789/0 conn(0x563264a3cc00 legacy=0x563264b28800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.972+0000 7f75f92bd700 1 -- 172.21.15.155:0/412709244 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563264a65d40 con 0x563264a3c800 2024-04-19T23:45:58.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.972+0000 7f75f92bd700 1 --2- 172.21.15.155:0/412709244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x563264d1f9e0 tx=0x563264b2d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8f5c2f1b9f73db server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.972+0000 7f75f82bb700 1 -- 172.21.15.155:0/412709244 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264af54a0 con 0x563264a3c800 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.972+0000 7f75f82bb700 1 -- 172.21.15.155:0/412709244 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563264d67800 con 0x563264a3c800 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.972+0000 7f75f82bb700 1 -- 172.21.15.155:0/412709244 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264af5600 con 0x563264a3c800 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.973+0000 7f75fb313a80 1 -- 172.21.15.155:0/412709244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 msgr2=0x563264d24580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.973+0000 7f75fb313a80 1 --2- 172.21.15.155:0/412709244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x563264d1f9e0 tx=0x563264b2d920 comp rx=0 tx=0).stop 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.973+0000 7f75fb313a80 1 -- 172.21.15.155:0/412709244 shutdown_connections 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.973+0000 7f75fb313a80 1 --2- 172.21.15.155:0/412709244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.973+0000 7f75fb313a80 1 -- 172.21.15.155:0/412709244 >> 172.21.15.155:0/412709244 conn(0x563264a3c400 msgr2=0x563264b28000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.973+0000 7f75fb313a80 1 -- 172.21.15.155:0/412709244 shutdown_connections 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.973+0000 7f75fb313a80 1 -- 172.21.15.155:0/412709244 wait complete. 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.973+0000 7f75fb313a80 1 Processor -- start 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.973+0000 7f75fb313a80 1 -- start start 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.973+0000 7f75fb313a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.973+0000 7f75fb313a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563264ade500 con 0x563264a3c800 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.974+0000 7f75f92bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.974+0000 7f75f92bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35266/0 (socket says 172.21.15.155:35266) 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.974+0000 7f75f92bd700 1 -- 172.21.15.155:0/1089766302 learned_addr learned my addr 172.21.15.155:0/1089766302 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.974+0000 7f75f92bd700 1 -- 172.21.15.155:0/1089766302 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563264a65ba0 con 0x563264a3c800 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.974+0000 7f75f92bd700 1 --2- 172.21.15.155:0/1089766302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x56326580d800 tx=0x563264b2d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02638c75a1df694 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.974+0000 7f75f7aba700 1 -- 172.21.15.155:0/1089766302 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264af5760 con 0x563264a3c800 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.974+0000 7f75f7aba700 1 -- 172.21.15.155:0/1089766302 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563264d67b00 con 0x563264a3c800 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.974+0000 7f75f7aba700 1 -- 172.21.15.155:0/1089766302 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264af51e0 con 0x563264a3c800 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75fb313a80 1 -- 172.21.15.155:0/1089766302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 msgr2=0x563264d24580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75fb313a80 1 --2- 172.21.15.155:0/1089766302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x56326580d800 tx=0x563264b2d800 comp rx=0 tx=0).stop 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75fb313a80 1 -- 172.21.15.155:0/1089766302 shutdown_connections 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75fb313a80 1 --2- 172.21.15.155:0/1089766302 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75fb313a80 1 -- 172.21.15.155:0/1089766302 >> 172.21.15.155:0/1089766302 conn(0x563264a3c400 msgr2=0x563264b29000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75fb313a80 1 -- 172.21.15.155:0/1089766302 shutdown_connections 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75fb313a80 1 -- 172.21.15.155:0/1089766302 wait complete. 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75fb313a80 1 Processor -- start 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75fb313a80 1 -- start start 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75fb313a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75fb313a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563264ade3c0 con 0x563264a3c800 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.975+0000 7f75f92bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.976+0000 7f75f92bd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35268/0 (socket says 172.21.15.155:35268) 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.976+0000 7f75f92bd700 1 -- 172.21.15.155:0/346873109 learned_addr learned my addr 172.21.15.155:0/346873109 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.976+0000 7f75f92bd700 1 -- 172.21.15.155:0/346873109 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563264a65a00 con 0x563264a3c800 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.976+0000 7f75f92bd700 1 --2- 172.21.15.155:0/346873109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x56326580dec0 tx=0x563264b2d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.976+0000 7f75f62b7700 1 -- 172.21.15.155:0/346873109 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264af54a0 con 0x563264a3c800 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.976+0000 7f75f62b7700 1 -- 172.21.15.155:0/346873109 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563264d67c80 con 0x563264a3c800 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.976+0000 7f75f62b7700 1 -- 172.21.15.155:0/346873109 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264af5600 con 0x563264a3c800 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.976+0000 7f75fb313a80 1 -- 172.21.15.155:0/346873109 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563264a65860 con 0x563264a3c800 2024-04-19T23:45:58.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.976+0000 7f75fb313a80 1 -- 172.21.15.155:0/346873109 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563264a656c0 con 0x563264a3c800 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75fb313a80 1 Processor -- start 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75fb313a80 1 -- start start 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75fb313a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75fb313a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563264a78640 con 0x563264a3d400 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75f62b7700 1 -- 172.21.15.155:0/346873109 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5632657deb00 con 0x563264a3c800 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75f62b7700 1 --2- 172.21.15.155:0/346873109 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264dc4000 0x563264d25080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75f9abe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75f62b7700 1 -- 172.21.15.155:0/346873109 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x563264ab7180 con 0x563264a3c800 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75f9abe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35282/0 (socket says 172.21.15.155:35282) 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75f9abe700 1 -- 172.21.15.155:0/1193483225 learned_addr learned my addr 172.21.15.155:0/1193483225 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75f92bd700 1 --2- 172.21.15.155:0/346873109 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264dc4000 0x563264d25080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.977+0000 7f75f9abe700 1 -- 172.21.15.155:0/1193483225 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563264a64000 con 0x563264a3d400 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75f92bd700 1 --2- 172.21.15.155:0/346873109 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264dc4000 0x563264d25080 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5632658d8fc0 tx=0x563264d8c540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75f9abe700 1 --2- 172.21.15.155:0/1193483225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x56326580df80 tx=0x563264b2d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d298cdd11180d9ec server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75f3ab2700 1 -- 172.21.15.155:0/1193483225 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264af54a0 con 0x563264a3d400 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75f3ab2700 1 -- 172.21.15.155:0/1193483225 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563264addc80 con 0x563264a3d400 2024-04-19T23:45:58.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75f3ab2700 1 -- 172.21.15.155:0/1193483225 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264af5600 con 0x563264a3d400 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75fb313a80 1 -- 172.21.15.155:0/1193483225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 msgr2=0x563264d24b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75fb313a80 1 --2- 172.21.15.155:0/1193483225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x56326580df80 tx=0x563264b2d800 comp rx=0 tx=0).stop 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75fb313a80 1 -- 172.21.15.155:0/1193483225 shutdown_connections 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75fb313a80 1 --2- 172.21.15.155:0/1193483225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75fb313a80 1 -- 172.21.15.155:0/1193483225 >> 172.21.15.155:0/1193483225 conn(0x563264a3cc00 msgr2=0x563264b29800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75fb313a80 1 -- 172.21.15.155:0/1193483225 shutdown_connections 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75fb313a80 1 -- 172.21.15.155:0/1193483225 wait complete. 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.978+0000 7f75fb313a80 1 Processor -- start 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75fb313a80 1 -- start start 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75fb313a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75fb313a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563264a788c0 con 0x563264a3d400 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75f9abe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75f9abe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35294/0 (socket says 172.21.15.155:35294) 2024-04-19T23:45:58.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 learned_addr learned my addr 172.21.15.155:0/915713888 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:58.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563264a64ea0 con 0x563264a3d400 2024-04-19T23:45:58.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75f9abe700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x56326580d9b0 tx=0x563264b2db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75f22af700 1 -- 172.21.15.155:0/915713888 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264af5760 con 0x563264a3d400 2024-04-19T23:45:58.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75f22af700 1 -- 172.21.15.155:0/915713888 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563264addb00 con 0x563264a3d400 2024-04-19T23:45:58.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563264a64820 con 0x563264a3d400 2024-04-19T23:45:58.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75f22af700 1 -- 172.21.15.155:0/915713888 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264af54a0 con 0x563264a3d400 2024-04-19T23:45:58.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.979+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563264a649c0 con 0x563264a3d400 2024-04-19T23:45:58.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.980+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.980+0000 7f75f22af700 1 -- 172.21.15.155:0/915713888 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5632657dedc0 con 0x563264a3d400 2024-04-19T23:45:58.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75f22af700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264dc4c00 0x563264d25600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75f22af700 1 -- 172.21.15.155:0/915713888 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x563264ab7340 con 0x563264a3d400 2024-04-19T23:45:58.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75f8abc700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264dc4c00 0x563264d25600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75fb313a80 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563264a3d800 0x563264d25b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264a3dc00 con 0x563264a3d800 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75f9abe700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563264a3d800 0x563264d25b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75f8abc700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264dc4c00 0x563264d25600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x56326580c030 tx=0x563264d8d380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75f9abe700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563264a3d800 0x563264d25b80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75fb313a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75fb313a80 20 realm 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.981+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5000 con 0x563264a3d800 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5400 con 0x563264a3d800 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:58.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5800 con 0x563264a3d800 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5c00 con 0x563264a3d800 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 20 searching for the correct realm 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563264dc5000 0x563264d26100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5400 con 0x563264dc5000 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.982+0000 7f75f92bd700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563264dc5000 0x563264d26100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.983+0000 7f75f92bd700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563264dc5000 0x563264d26100 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.983+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.983+0000 7f75f92bd700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563264dc5400 0x563264d26c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.983+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82000 con 0x563264dc5400 2024-04-19T23:45:58.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.983+0000 7f75f8abc700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563264dc5400 0x563264d26c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.983+0000 7f75f8abc700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563264dc5400 0x563264d26c00 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.984+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.984+0000 7f75f8abc700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563264e82000 0x563264d27180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.984+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264e82000 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.984+0000 7f75f9abe700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563264e82000 0x563264d27180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.984+0000 7f75f9abe700 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563264e82000 0x563264d27180 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.985+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.985+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264a3d800 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.985+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.985+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264a3d800 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.985+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.985+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264e82000 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.985+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.985+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264e82000 2024-04-19T23:45:58.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.986+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.986+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5400 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.986+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.986+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5000 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.986+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.986+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264a3d800 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.986+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.986+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264e82000 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.987+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.987+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264a3d800 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.987+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.987+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5400 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.987+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.987+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5000 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.987+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.987+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5000 2024-04-19T23:45:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.988+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.988+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264e82000 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.988+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.988+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5000 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.988+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.988+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5000 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.988+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.988+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264a3d800 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.989+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.989+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264a3d800 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.989+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.989+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264e82000 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.989+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.989+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5000 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.989+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.989+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5400 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.990+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.990+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264a3d800 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.990+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.990+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264e82000 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.990+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.990+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5000 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.990+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.990+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264e82000 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.991+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.991+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5400 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.991+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.991+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5000 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.991+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.991+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264e82000 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264a3d800 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5400 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264a3dc00 con 0x563264a3d800 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82c00 con 0x563264a3d800 2024-04-19T23:45:59.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.992+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83000 con 0x563264dc5400 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 20 zone default found 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 4 Realm: () 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 20 zonegroup default 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83400 con 0x563264e82000 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83800 con 0x563264dc5000 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.993+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83c00 con 0x563264dc5000 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.994+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.994+0000 7f75fb313a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.994+0000 7f75fb313a80 20 started sync module instance, tier type = 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.994+0000 7f75fb313a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.994+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82c00 con 0x563264dc5400 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.995+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.995+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94774439820032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264a3dc00 con 0x563264dc5400 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.995+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5800 con 0x563264a3d800 2024-04-19T23:45:59.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.996+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94774439820032] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.996+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.996+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94774439821184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5c00 con 0x563264a3d800 2024-04-19T23:45:59.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.996+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264dc5000 2024-04-19T23:45:59.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.997+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94774439821184] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.997+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.997+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94774439822336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83000 con 0x563264dc5000 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.997+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82c00 con 0x563264dc5400 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.998+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.998+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94774439823488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82400 con 0x563264dc5400 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.998+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83800 con 0x563264a3d800 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.999+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94774439822336] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:58.999+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94774439823488] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.000+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.000+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94774439824640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83c00 con 0x563264a3d800 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.000+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82800 con 0x563264e82000 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.001+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.001+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94774439825792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83400 con 0x563264e82000 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.001+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83800 con 0x563264e82000 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.001+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94774439824640] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.002+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(56 notify.6 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.002+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94774439826944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83c00 con 0x563264e82000 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.002+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5800 con 0x563264e82000 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.002+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94774439825792] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.003+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94774439826944] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.003+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.003+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94774439828096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5c00 con 0x563264e82000 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.003+0000 7f75fb313a80 20 add_watcher() i=0 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.003+0000 7f75fb313a80 20 add_watcher() i=1 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.003+0000 7f75fb313a80 20 add_watcher() i=2 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.003+0000 7f75fb313a80 20 add_watcher() i=3 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.003+0000 7f75fb313a80 20 add_watcher() i=4 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.003+0000 7f75fb313a80 20 add_watcher() i=5 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.003+0000 7f75fb313a80 20 add_watcher() i=6 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.004+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94774439828096] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.004+0000 7f75fb313a80 20 add_watcher() i=7 2024-04-19T23:45:59.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.004+0000 7f75fb313a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.004+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5800 con 0x563264a3d800 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.004+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.004+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94774441345024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5c00 con 0x563264a3d800 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.005+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94774441345024] v30'183 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.005+0000 7f75e028b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.006+0000 7f75fb313a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.006+0000 7f75fb313a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.006+0000 7f75fb313a80 1 Processor -- start 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.006+0000 7f75fb313a80 1 -- start start 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.006+0000 7f75fb313a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.006+0000 7f75fb313a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563264ade3c0 con 0x563264e83400 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.006+0000 7f75f8abc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.006+0000 7f75f8abc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35302/0 (socket says 172.21.15.155:35302) 2024-04-19T23:45:59.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.006+0000 7f75f8abc700 1 -- 172.21.15.155:0/952929663 learned_addr learned my addr 172.21.15.155:0/952929663 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.007+0000 7f75f8abc700 1 -- 172.21.15.155:0/952929663 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563264a64b60 con 0x563264e83400 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.007+0000 7f75f8abc700 1 --2- 172.21.15.155:0/952929663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x563264e9c0c0 tx=0x563264d8d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73184e80b569049 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.007+0000 7f75dfa8a700 1 -- 172.21.15.155:0/952929663 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264ea8000 con 0x563264e83400 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.007+0000 7f75dfa8a700 1 -- 172.21.15.155:0/952929663 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563264eaa000 con 0x563264e83400 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.007+0000 7f75dfa8a700 1 -- 172.21.15.155:0/952929663 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264ea8160 con 0x563264e83400 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75fb313a80 1 -- 172.21.15.155:0/952929663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 msgr2=0x563264d26680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75fb313a80 1 --2- 172.21.15.155:0/952929663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x563264e9c0c0 tx=0x563264d8d680 comp rx=0 tx=0).stop 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75fb313a80 1 -- 172.21.15.155:0/952929663 shutdown_connections 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75fb313a80 1 --2- 172.21.15.155:0/952929663 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75fb313a80 1 -- 172.21.15.155:0/952929663 >> 172.21.15.155:0/952929663 conn(0x563264e82800 msgr2=0x563264b2a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75fb313a80 1 -- 172.21.15.155:0/952929663 shutdown_connections 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75fb313a80 1 -- 172.21.15.155:0/952929663 wait complete. 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75fb313a80 1 Processor -- start 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75fb313a80 1 -- start start 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75fb313a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75fb313a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x563264ade500 con 0x563264e83400 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75f8abc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75f8abc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35318/0 (socket says 172.21.15.155:35318) 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.008+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 learned_addr learned my addr 172.21.15.155:0/3187437432 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.009+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563264a64d00 con 0x563264e83400 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.009+0000 7f75f8abc700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x563264e9c300 tx=0x563264d8d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.009+0000 7f75de287700 1 -- 172.21.15.155:0/3187437432 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264ea82c0 con 0x563264e83400 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.009+0000 7f75de287700 1 -- 172.21.15.155:0/3187437432 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563264eaa180 con 0x563264e83400 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.009+0000 7f75de287700 1 -- 172.21.15.155:0/3187437432 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563264ea8000 con 0x563264e83400 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.009+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563264a64340 con 0x563264e83400 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.009+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563264a64b60 con 0x563264e83400 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.010+0000 7f75de287700 1 -- 172.21.15.155:0/3187437432 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5632657dfb80 con 0x563264e83400 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.010+0000 7f75de287700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264f2e000 0x563264d27700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.010+0000 7f75de287700 1 -- 172.21.15.155:0/3187437432 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x563264ab7500 con 0x563264e83400 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.010+0000 7f75f9abe700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264f2e000 0x563264d27700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.010+0000 7f75fb313a80 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563264e83800 0x563264f3e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.010+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83c00 con 0x563264e83800 2024-04-19T23:45:59.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.010+0000 7f75f92bd700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563264e83800 0x563264f3e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.010+0000 7f75f9abe700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264f2e000 0x563264d27700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x563264e1fc80 tx=0x563264d8d4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.010+0000 7f75f92bd700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563264e83800 0x563264f3e000 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.012+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264e83800 2024-04-19T23:45:59.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.012+0000 7f75fb313a80 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563264f2e400 0x563264f3e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.012+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2e800 con 0x563264f2e400 2024-04-19T23:45:59.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.012+0000 7f75f8abc700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563264f2e400 0x563264f3e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.012+0000 7f75f8abc700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563264f2e400 0x563264f3e580 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.013+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264f2e400 2024-04-19T23:45:59.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.014+0000 7f75fb313a80 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563264f2ec00 0x563264f3eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.014+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f000 con 0x563264f2ec00 2024-04-19T23:45:59.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.014+0000 7f75f9abe700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563264f2ec00 0x563264f3eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.014+0000 7f75f9abe700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563264f2ec00 0x563264f3eb00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.015+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.015+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f400 con 0x563264e83800 2024-04-19T23:45:59.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.016+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'184 uv163 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264e83800 2024-04-19T23:45:59.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.016+0000 7f75fb313a80 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563264f2f800 0x563264f3f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.016+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2fc00 con 0x563264f2f800 2024-04-19T23:45:59.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.016+0000 7f75f92bd700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563264f2f800 0x563264f3f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.016+0000 7f75f92bd700 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563264f2f800 0x563264f3f080 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.017+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'62 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264f2f800 2024-04-19T23:45:59.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.017+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54000 con 0x563264f2ec00 2024-04-19T23:45:59.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.018+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.018+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54400 con 0x563264e83800 2024-04-19T23:45:59.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.019+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264e83800 2024-04-19T23:45:59.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.019+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54800 con 0x563264f2e400 2024-04-19T23:45:59.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.020+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264f2e400 2024-04-19T23:45:59.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.021+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54c00 con 0x563264f2f800 2024-04-19T23:45:59.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.022+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264f2f800 2024-04-19T23:45:59.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.022+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55000 con 0x563264f2ec00 2024-04-19T23:45:59.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.023+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.023+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55400 con 0x563264f2f800 2024-04-19T23:45:59.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.023+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'63 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264f2f800 2024-04-19T23:45:59.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.023+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55800 con 0x563264f2e400 2024-04-19T23:45:59.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.025+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264f2e400 2024-04-19T23:45:59.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.025+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55c00 con 0x563264f2f800 2024-04-19T23:45:59.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.026+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264f2f800 2024-04-19T23:45:59.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.026+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54800 con 0x563264f2e400 2024-04-19T23:45:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.027+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'50 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264f2e400 2024-04-19T23:45:59.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.027+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54400 con 0x563264e83800 2024-04-19T23:45:59.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.028+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'185 uv165 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264e83800 2024-04-19T23:45:59.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.028+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2e800 con 0x563264f2ec00 2024-04-19T23:45:59.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.029+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'61 uv50 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.029+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f400 con 0x563264f2f800 2024-04-19T23:45:59.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.030+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'64 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264f2f800 2024-04-19T23:45:59.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.030+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2fc00 con 0x563264f2ec00 2024-04-19T23:45:59.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.031+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.031+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82c00 con 0x563264e83800 2024-04-19T23:45:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.032+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264e83800 2024-04-19T23:45:59.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.032+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83000 con 0x563264e83800 2024-04-19T23:45:59.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.033+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'186 uv167 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264e83800 2024-04-19T23:45:59.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.033+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83c00 con 0x563264f2ec00 2024-04-19T23:45:59.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.034+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'62 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.034+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264a3dc00 con 0x563264f2f800 2024-04-19T23:45:59.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.035+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'34 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264f2f800 2024-04-19T23:45:59.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.035+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f400 con 0x563264f2ec00 2024-04-19T23:45:59.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.036+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.036+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f000 con 0x563264f2ec00 2024-04-19T23:45:59.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.037+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.037+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2e800 con 0x563264f2ec00 2024-04-19T23:45:59.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.038+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'20 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.038+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2fc00 con 0x563264f2ec00 2024-04-19T23:45:59.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.039+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.039+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54c00 con 0x563264f2e400 2024-04-19T23:45:59.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.040+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264f2e400 2024-04-19T23:45:59.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.040+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55400 con 0x563264f2ec00 2024-04-19T23:45:59.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.041+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.041+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55c00 con 0x563264f2e400 2024-04-19T23:45:59.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.042+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264f2e400 2024-04-19T23:45:59.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.042+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54400 con 0x563264f2ec00 2024-04-19T23:45:59.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.043+0000 7f75f9abe700 1 -- 172.21.15.155:0/3187437432 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'63 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264f2ec00 2024-04-19T23:45:59.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.043+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54000 con 0x563264f2e400 2024-04-19T23:45:59.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.044+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'51 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264f2e400 2024-04-19T23:45:59.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.045+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55000 con 0x563264f2f800 2024-04-19T23:45:59.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.046+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264f2f800 2024-04-19T23:45:59.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.046+0000 7f75dba82700 20 reqs_thread_entry: start 2024-04-19T23:45:59.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75fb313a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:59.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75fb313a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:59.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75d9a7e700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:29 2024 2024-04-19T23:45:59.047 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:59.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75d925c700 20 reqs_thread_entry: start 2024-04-19T23:45:59.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75fb313a80 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:45:59.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5c00 con 0x563264dc5400 2024-04-19T23:45:59.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75fb313a80 20 rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75fb313a80 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75fb313a80 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75fb313a80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 : miss 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.047+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:63 8.f 8:f6caeff1:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82c00 con 0x563264dc5000 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(63 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75fb313a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75fb313a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 info.flags=0x17 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75fb313a80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 to cache LRU end 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75fb313a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75fb313a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75fb313a80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 2024-04-19T23:45:59.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 4.4 4:2290bb09:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55800 con 0x563264e82000 2024-04-19T23:45:59.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(64 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:65 4.29 4:94322bec:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54800 con 0x563264dc5000 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(65 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.048+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 4.20 4:07a2be8d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54c00 con 0x563264a3d800 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.049+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(66 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2 [call out=426b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.049+0000 7f75fb313a80 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.049+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 4.23 4:c5591813:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55c00 con 0x563264e82000 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.049+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(67 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.049+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 4.16 4:6a702c4e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54000 con 0x563264dc5000 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.050+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(68 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.050+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 4.3c 4:3c289815:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55400 con 0x563264a3d800 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.050+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(69 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.050+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:70 4.1d 4:b9a37c73:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54400 con 0x563264dc5000 2024-04-19T23:45:59.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.050+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(70 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6 [call out=425b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.050+0000 7f75fb313a80 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.050+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:71 4.3a 4:5e39f498:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55800 con 0x563264dc5000 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.050+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(71 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.7 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.051+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 4.31 4:8cc3b2f9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f400 con 0x563264a3d800 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.051+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(72 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8 [call out=425b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.051+0000 7f75fb313a80 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.051+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 4.38 4:1cdb3aa9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f000 con 0x563264a3d800 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.051+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(73 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.051+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 4.26 4:6431b19c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2e800 con 0x563264e82000 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(74 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10 [call out=698b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+698 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75fb313a80 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75fb313a80 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75fb313a80 20 get_obj_state: rctx=0x563264e3f730 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x563264fe81e8 s->prefetch_data=0 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:75 3.d 3:b17d0022:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2e800 con 0x563264dc5000 2024-04-19T23:45:59.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(75 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75fb313a80 10 manifest: total_size = 6 2024-04-19T23:45:59.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75fb313a80 20 get_obj_state: setting s->obj_tag to 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4221.17470573409411241820 2024-04-19T23:45:59.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75fb313a80 20 get_obj_state: rctx=0x563264e3f730 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x563264fe81e8 s->prefetch_data=0 2024-04-19T23:45:59.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75fb313a80 20 prepare_atomic_modification: state is not atomic. state=0x563264fe81e8 2024-04-19T23:45:59.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75fb313a80 20 bucket index object: default.rgw.buckets.index:.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2 2024-04-19T23:45:59.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.052+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:76 4.20 4:07a2be8d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2fc00 con 0x563264a3d800 2024-04-19T23:45:59.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.054+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(76 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2 [stat,call,call] v30'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.054+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:77 3.d 3:b17d0022:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83c00 con 0x563264dc5000 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.055+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(77 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_9c8454ddf7aa50116496bac348d7550d [call] v30'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.055+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:78 4.20 4:07a2be8d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54800 con 0x563264a3d800 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.055+0000 7f75fb313a80 20 get_obj_state: rctx=0x563264e3f730 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x563264fe81e8 s->prefetch_data=0 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.055+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:79 3.37 3:ee715afc:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54000 con 0x563264a3d800 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.055+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(79 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.055+0000 7f75fb313a80 10 manifest: total_size = 3 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.055+0000 7f75fb313a80 20 get_obj_state: setting s->obj_tag to 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4221.8397628782064637121 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.055+0000 7f75fb313a80 20 get_obj_state: rctx=0x563264e3f730 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x563264fe81e8 s->prefetch_data=0 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.055+0000 7f75fb313a80 20 prepare_atomic_modification: state is not atomic. state=0x563264fe81e8 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.055+0000 7f75fb313a80 20 bucket index object: default.rgw.buckets.index:.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.055+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:80 4.1d 4:b9a37c73:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54400 con 0x563264dc5000 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.056+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(80 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6 [stat,call,call] v30'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.056+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:81 3.37 3:ee715afc:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83000 con 0x563264a3d800 2024-04-19T23:45:59.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.056+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(78 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2 [stat,call,call] v30'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.056+0000 7f75f3ab2700 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-04-19T23:45:59.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.057+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(81 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_b1b9a972ccd8c962a473909b97007eb4 [call] v30'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.057+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:82 4.1d 4:b9a37c73:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264a3dc00 con 0x563264dc5000 2024-04-19T23:45:59.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.057+0000 7f75fb313a80 20 get_obj_state: rctx=0x563264e3f730 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x563264fe81e8 s->prefetch_data=0 2024-04-19T23:45:59.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.057+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:83 3.27 3:e521308f:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83000 con 0x563264e82000 2024-04-19T23:45:59.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.058+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(83 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.058+0000 7f75fb313a80 10 manifest: total_size = 4 2024-04-19T23:45:59.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.058+0000 7f75fb313a80 20 get_obj_state: setting s->obj_tag to 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4221.3597739794653070674 2024-04-19T23:45:59.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.058+0000 7f75fb313a80 20 get_obj_state: rctx=0x563264e3f730 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x563264fe81e8 s->prefetch_data=0 2024-04-19T23:45:59.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.058+0000 7f75fb313a80 20 prepare_atomic_modification: state is not atomic. state=0x563264fe81e8 2024-04-19T23:45:59.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.058+0000 7f75fb313a80 20 bucket index object: default.rgw.buckets.index:.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8 2024-04-19T23:45:59.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.058+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:84 4.31 4:8cc3b2f9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54c00 con 0x563264a3d800 2024-04-19T23:45:59.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.058+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== osd_op_reply(82 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6 [stat,call,call] v30'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.058+0000 7f75f32b1700 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-04-19T23:45:59.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.059+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(84 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8 [stat,call,call] v30'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.059+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:85 3.27 3:e521308f:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55c00 con 0x563264e82000 2024-04-19T23:45:59.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.060+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(85 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v30'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.060+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:86 4.31 4:8cc3b2f9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54800 con 0x563264a3d800 2024-04-19T23:45:59.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.060+0000 7f75fb313a80 20 get_obj_state: rctx=0x563264e3f730 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x563264fe81e8 s->prefetch_data=0 2024-04-19T23:45:59.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.060+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:87 3.15 3:aa38ac20:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54000 con 0x563264dc5400 2024-04-19T23:45:59.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.061+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(87 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.061+0000 7f75fb313a80 10 manifest: total_size = 5 2024-04-19T23:45:59.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.061+0000 7f75fb313a80 20 get_obj_state: setting s->obj_tag to 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4221.16578053235038266929 2024-04-19T23:45:59.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.061+0000 7f75fb313a80 20 get_obj_state: rctx=0x563264e3f730 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x563264fe81e8 s->prefetch_data=0 2024-04-19T23:45:59.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.061+0000 7f75fb313a80 20 prepare_atomic_modification: state is not atomic. state=0x563264fe81e8 2024-04-19T23:45:59.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.061+0000 7f75fb313a80 20 bucket index object: default.rgw.buckets.index:.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10 2024-04-19T23:45:59.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.061+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:88 4.26 4:6431b19c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f400 con 0x563264e82000 2024-04-19T23:45:59.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.062+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(86 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8 [stat,call,call] v30'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.062+0000 7f75f3ab2700 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-04-19T23:45:59.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.062+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(88 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10 [stat,call,call] v30'10 uv10 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.062+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:89 3.15 3:aa38ac20:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f000 con 0x563264dc5400 2024-04-19T23:45:59.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.063+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(89 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_24d27c169c2c881eb09a065116f2aa5c [call] v30'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.063+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:90 4.26 4:6431b19c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fec000 con 0x563264e82000 2024-04-19T23:45:59.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.063+0000 7f75fb313a80 20 get_obj_state: rctx=0x563264e3f730 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x563264fe81e8 s->prefetch_data=0 2024-04-19T23:45:59.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.063+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:91 3.39 3:9c93e7da:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fec400 con 0x563264dc5000 2024-04-19T23:45:59.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.063+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(91 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.063+0000 7f75fb313a80 10 manifest: total_size = 5 2024-04-19T23:45:59.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.063+0000 7f75fb313a80 20 get_obj_state: setting s->obj_tag to _R2SAs0DYNbNs2q1wYJZxFOCMVCm4oHn 2024-04-19T23:45:59.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.063+0000 7f75fb313a80 20 get_obj_state: rctx=0x563264e3f730 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x563264fe81e8 s->prefetch_data=0 2024-04-19T23:45:59.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.063+0000 7f75fb313a80 20 prepare_atomic_modification: state is not atomic. state=0x563264fe81e8 2024-04-19T23:45:59.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.063+0000 7f75fb313a80 20 bucket index object: default.rgw.buckets.index:.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10 2024-04-19T23:45:59.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.063+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:92 4.26 4:6431b19c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fec800 con 0x563264e82000 2024-04-19T23:45:59.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.065+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(90 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10 [stat,call,call] v30'11 uv11 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.065+0000 7f75f32b1700 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-04-19T23:45:59.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.065+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(92 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10 [stat,call,call] v30'12 uv12 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.065+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:93 3.39 3:9c93e7da:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fecc00 con 0x563264dc5000 2024-04-19T23:45:59.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(93 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5_bb3aec0fdcdbc2974890f805c585d432 [call] v30'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:94 4.26 4:6431b19c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fed400 con 0x563264e82000 2024-04-19T23:45:59.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 20 list_objects_ordered: starting attempt 1 2024-04-19T23:45:59.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:95 4.4 4:2290bb09:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fed800 con 0x563264e82000 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:96 4.29 4:94322bec:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fedc00 con 0x563264dc5000 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:97 4.20 4:07a2be8d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2fc00 con 0x563264a3d800 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:98 4.23 4:c5591813:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82c00 con 0x563264e82000 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:99 4.16 4:6a702c4e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fec000 con 0x563264dc5000 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:100 4.3c 4:3c289815:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fec800 con 0x563264a3d800 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:101 4.1d 4:b9a37c73:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fed400 con 0x563264dc5000 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:102 4.3a 4:5e39f498:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fed800 con 0x563264dc5000 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:103 4.31 4:8cc3b2f9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fec400 con 0x563264a3d800 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:104 4.38 4:1cdb3aa9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fecc00 con 0x563264a3d800 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:105 4.26 4:6431b19c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fedc00 con 0x563264e82000 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(100 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 33 ==== osd_op_reply(97 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(95 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 25 ==== osd_op_reply(96 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(98 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.066+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 34 ==== osd_op_reply(103 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 26 ==== osd_op_reply(99 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 35 ==== osd_op_reply(104 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 27 ==== osd_op_reply(102 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.7 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 28 ==== osd_op_reply(101 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(94 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10 [stat,call,call] v30'13 uv13 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75f3ab2700 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 28 ==== osd_op_reply(105 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75fb313a80 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75fb313a80 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75fb313a80 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75fb313a80 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75fb313a80 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5])"; uploads.size()=0; is_truncated=0 2024-04-19T23:45:59.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75fb313a80 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5]) 2024-04-19T23:45:59.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75fb313a80 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x17, cached=0x11) 2024-04-19T23:45:59.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75fb313a80 20 lifecycle: rados->read ofs=0 len=0 2024-04-19T23:45:59.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.067+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264a3dc00 con 0x563264dc5400 2024-04-19T23:45:59.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.068+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(106 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv33 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.068+0000 7f75fb313a80 20 lifecycle: rados_obj.operate() r=0 bl.length=165 2024-04-19T23:45:59.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.068+0000 7f75fb313a80 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-19T23:45:59.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.068+0000 7f75fb313a80 10 lifecycle: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:45:59.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.068+0000 7f75fb313a80 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:59.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.068+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:107 8.f 8:f6caeff1:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55c00 con 0x563264dc5000 2024-04-19T23:45:59.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.069+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 29 ==== osd_op_reply(107 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.069+0000 7f75fb313a80 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 info.flags=0x17 2024-04-19T23:45:59.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.069+0000 7f75fb313a80 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 to cache LRU end 2024-04-19T23:45:59.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.069+0000 7f75fb313a80 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:59.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.069+0000 7f75fb313a80 10 lifecycle: distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5, ofs0, ns] 2024-04-19T23:45:59.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify cookie 94774441348480 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55800 con 0x563264dc5000 2024-04-19T23:45:59.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 30 ==== watch-notify(notify (1) cookie 94774439822336 notify 128849018896 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x563264d8bba0 con 0x563264dc5000 2024-04-19T23:45:59.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75f3ab2700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94774439822336 notifier 4701 bl.length()=725 2024-04-19T23:45:59.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75f3ab2700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 info.flags=0x17 2024-04-19T23:45:59.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 31 ==== osd_op_reply(108 notify.2 [notify cookie 94774441348480 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75f3ab2700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 to cache LRU end 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75f3ab2700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75f3ab2700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fed000 con 0x563264dc5000 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 32 ==== osd_op_reply(109 notify.2 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 33 ==== watch-notify(notify_complete (2) cookie 94774441348480 notify 128849018896 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563264d8bd40 con 0x563264dc5000 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75fb313a80 20 lifecycle: handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5]): orig_sources= new_sources= 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75fb313a80 20 lifecycle: handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5]): potential sources added=[] removed=[] 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75fb313a80 20 lifecycle: handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5]): orig_dests= new_dests= 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75fb313a80 20 lifecycle: handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5]): potential dests added=[] removed=[] 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.070+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:33 6.18 6:1fdc4f8e:lc::lc.10:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54400 con 0x563264f2e400 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.072+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(33 lc.10 [call] v30'25 uv25 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264f2e400 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.072+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:34 6.18 6:1fdc4f8e:lc::lc.10:head [call rgw.lc_rm_entry in=92b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83000 con 0x563264f2e400 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.073+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(34 lc.10 [call] v30'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264f2e400 2024-04-19T23:45:59.073 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.073+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 6.18 6:1fdc4f8e:lc::lc.10:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83c00 con 0x563264f2e400 2024-04-19T23:45:59.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75f8abc700 1 -- 172.21.15.155:0/3187437432 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(35 lc.10 [call] v30'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264f2e400 2024-04-19T23:45:59.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:110 4.4 4:2290bb09:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f400 con 0x563264e82000 2024-04-19T23:45:59.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:111 4.29 4:94322bec:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2fc00 con 0x563264dc5000 2024-04-19T23:45:59.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:112 4.20 4:07a2be8d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2e800 con 0x563264a3d800 2024-04-19T23:45:59.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:113 4.23 4:c5591813:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83000 con 0x563264e82000 2024-04-19T23:45:59.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:114 4.16 4:6a702c4e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54000 con 0x563264dc5000 2024-04-19T23:45:59.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:115 4.3c 4:3c289815:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54400 con 0x563264a3d800 2024-04-19T23:45:59.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:116 4.1d 4:b9a37c73:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264a3dc00 con 0x563264dc5000 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:117 4.3a 4:5e39f498:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f000 con 0x563264dc5000 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:118 4.31 4:8cc3b2f9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5c00 con 0x563264a3d800 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:119 4.38 4:1cdb3aa9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2fc00 con 0x563264a3d800 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:120 4.26 4:6431b19c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fec000 con 0x563264e82000 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 29 ==== osd_op_reply(110 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 30 ==== osd_op_reply(113 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 34 ==== osd_op_reply(111 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 36 ==== osd_op_reply(112 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 35 ==== osd_op_reply(114 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 36 ==== osd_op_reply(116 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.074+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 37 ==== osd_op_reply(117 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.7 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.075+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 31 ==== osd_op_reply(120 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.075+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 37 ==== osd_op_reply(119 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.075+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 38 ==== osd_op_reply(115 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.075+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 39 ==== osd_op_reply(118 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.075+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:121 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fed400 con 0x563264dc5400 2024-04-19T23:45:59.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.076+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(121 foo.buckets [call] v30'36 uv36 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.076+0000 7f75fb313a80 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x17) 2024-04-19T23:45:59.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.076+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:122 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fed800 con 0x563264dc5400 2024-04-19T23:45:59.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.077+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(122 myfoo [call,call,delete] v30'37 uv37 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.077+0000 7f75fb313a80 10 removing default.rgw.meta+root+myfoo from cache 2024-04-19T23:45:59.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.077+0000 7f75fb313a80 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-19T23:45:59.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.077+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:123 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94774441348480 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fed000 con 0x563264e82000 2024-04-19T23:45:59.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.077+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 32 ==== watch-notify(notify (1) cookie 94774439826944 notify 128849018901 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x563264e29a00 con 0x563264e82000 2024-04-19T23:45:59.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.077+0000 7f75f3ab2700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018901 cookie 94774439826944 notifier 4701 bl.length()=149 2024-04-19T23:45:59.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.077+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 33 ==== osd_op_reply(123 notify.6 [notify cookie 94774441348480 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.077+0000 7f75f3ab2700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:124 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55000 con 0x563264e82000 2024-04-19T23:45:59.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.078+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 34 ==== osd_op_reply(124 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.078+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 35 ==== watch-notify(notify_complete (2) cookie 94774441348480 notify 128849018901 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563264e29ba0 con 0x563264e82000 2024-04-19T23:45:59.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.078+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:125 8.f 8:f6caeff1:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54800 con 0x563264dc5000 2024-04-19T23:45:59.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.079+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 38 ==== osd_op_reply(125 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 [call,call,delete] v30'3 uv3 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.079+0000 7f75fb313a80 10 removing default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 from cache 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.079+0000 7f75fb313a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5, ofs0, ns] 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.079+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:126 7.15 7:a93a5511:::notify.2:head [notify cookie 94774441348480 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54c00 con 0x563264dc5000 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 39 ==== watch-notify(notify (1) cookie 94774439822336 notify 128849018897 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x563264d8bd40 con 0x563264dc5000 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75f3ab2700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94774439822336 notifier 4701 bl.length()=206 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 40 ==== osd_op_reply(126 notify.2 [notify cookie 94774441348480 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75f3ab2700 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:127 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55400 con 0x563264dc5000 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 41 ==== osd_op_reply(127 notify.2 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 42 ==== watch-notify(notify_complete (2) cookie 94774441348480 notify 128849018897 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563264ef3d40 con 0x563264dc5000 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:128 4.4 4:2290bb09:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55c00 con 0x563264e82000 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:129 4.29 4:94322bec:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55800 con 0x563264dc5000 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:130 4.20 4:07a2be8d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f400 con 0x563264a3d800 2024-04-19T23:45:59.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:131 4.23 4:c5591813:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2e800 con 0x563264e82000 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:132 4.16 4:6a702c4e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2fc00 con 0x563264dc5000 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:133 4.3c 4:3c289815:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264dc5c00 con 0x563264a3d800 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:134 4.1d 4:b9a37c73:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54400 con 0x563264dc5000 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:135 4.3a 4:5e39f498:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82c00 con 0x563264dc5000 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:136 4.31 4:8cc3b2f9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e83000 con 0x563264a3d800 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:137 4.38 4:1cdb3aa9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fec800 con 0x563264a3d800 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.080+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:138 4.26 4:6431b19c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fec400 con 0x563264e82000 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.082+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 43 ==== osd_op_reply(132 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.4 [delete] v30'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.082+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 44 ==== osd_op_reply(135 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.7 [delete] v30'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.082+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 40 ==== osd_op_reply(130 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.2 [delete] v30'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.082+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 36 ==== osd_op_reply(131 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.3 [delete] v30'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.082+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 41 ==== osd_op_reply(137 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.9 [delete] v30'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.082+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 37 ==== osd_op_reply(128 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.0 [delete] v30'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.082+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 38 ==== osd_op_reply(138 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.10 [delete] v30'14 uv14 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.082+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 42 ==== osd_op_reply(133 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.5 [delete] v30'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.082+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 45 ==== osd_op_reply(134 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.6 [delete] v30'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.082+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 46 ==== osd_op_reply(129 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.1 [delete] v30'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.083+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 43 ==== osd_op_reply(136 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5.8 [delete] v30'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.083+0000 7f75fb313a80 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 : miss 2024-04-19T23:45:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.083+0000 7f75fb313a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.083+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:139 6.c 6:320fb210:::pubsub..bucket.myfoo%2f1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fecc00 con 0x563264dc5000 2024-04-19T23:45:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.083+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 47 ==== osd_op_reply(139 pubsub..bucket.myfoo/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.083+0000 7f75fb313a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.083+0000 7f75fb313a80 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 info.flags=0x0 2024-04-19T23:45:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.083+0000 7f75fb313a80 10 adding default.rgw.log++pubsub..bucket.myfoo/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 to cache LRU end 2024-04-19T23:45:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.083+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:140 6.c 6:320fb210:::pubsub..bucket.myfoo%2f1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264fedc00 con 0x563264dc5000 2024-04-19T23:45:59.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.084+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 48 ==== osd_op_reply(140 pubsub..bucket.myfoo/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.5 [delete] v30'11 uv10 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.084+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:141 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264e82c00 con 0x563264dc5400 2024-04-19T23:45:59.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.085+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(141 foo.buckets [call] v30'38 uv38 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.085+0000 7f75e028b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:59.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.085+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94774441345024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54000 con 0x563264a3d800 2024-04-19T23:45:59.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.086+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 44 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 94774441345024] v30'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.086+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:143 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94774439820032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54800 con 0x563264dc5400 2024-04-19T23:45:59.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.087+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(143 notify.0 [watch unwatch cookie 94774439820032] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.087+0000 7f75fb313a80 20 remove_watcher() i=0 2024-04-19T23:45:59.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.087+0000 7f75fb313a80 2 removed watcher, disabling cache 2024-04-19T23:45:59.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.087+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:144 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94774439821184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54c00 con 0x563264a3d800 2024-04-19T23:45:59.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.089+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 45 ==== osd_op_reply(144 notify.1 [watch unwatch cookie 94774439821184] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.089+0000 7f75fb313a80 20 remove_watcher() i=1 2024-04-19T23:45:59.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.089+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:145 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94774439822336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55400 con 0x563264dc5000 2024-04-19T23:45:59.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.090+0000 7f75f92bd700 1 -- 172.21.15.155:0/915713888 <== osd.3 v2:172.21.15.155:6808/41835 49 ==== osd_op_reply(145 notify.2 [watch unwatch cookie 94774439822336] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e67200 con 0x563264dc5000 2024-04-19T23:45:59.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.090+0000 7f75fb313a80 20 remove_watcher() i=2 2024-04-19T23:45:59.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.090+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:146 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94774439823488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f55800 con 0x563264dc5400 2024-04-19T23:45:59.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.091+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 <== osd.2 v2:172.21.15.155:6812/41834 20 ==== osd_op_reply(146 notify.3 [watch unwatch cookie 94774439823488] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e67440 con 0x563264dc5400 2024-04-19T23:45:59.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.091+0000 7f75fb313a80 20 remove_watcher() i=3 2024-04-19T23:45:59.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.091+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:147 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94774439824640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f54400 con 0x563264a3d800 2024-04-19T23:45:59.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.092+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.1 v2:172.21.15.155:6800/41833 46 ==== osd_op_reply(147 notify.4 [watch unwatch cookie 94774439824640] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264a3d800 2024-04-19T23:45:59.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.092+0000 7f75fb313a80 20 remove_watcher() i=4 2024-04-19T23:45:59.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.092+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:148 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94774439825792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2f000 con 0x563264e82000 2024-04-19T23:45:59.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.094+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 39 ==== osd_op_reply(148 notify.5 [watch unwatch cookie 94774439825792] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.094+0000 7f75fb313a80 20 remove_watcher() i=5 2024-04-19T23:45:59.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.094+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:149 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94774439826944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264f2fc00 con 0x563264e82000 2024-04-19T23:45:59.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.095+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 40 ==== osd_op_reply(149 notify.6 [watch unwatch cookie 94774439826944] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.095+0000 7f75fb313a80 20 remove_watcher() i=6 2024-04-19T23:45:59.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.095+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:150 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94774439828096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563264a3dc00 con 0x563264e82000 2024-04-19T23:45:59.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75f9abe700 1 -- 172.21.15.155:0/915713888 <== osd.0 v2:172.21.15.76:6800/39408 41 ==== osd_op_reply(150 notify.7 [watch unwatch cookie 94774439828096] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563264e66b40 con 0x563264e82000 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 20 remove_watcher() i=7 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563264e82000 msgr2=0x563264d27180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563264e82000 0x563264d27180 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563264a3d800 msgr2=0x563264d25b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563264a3d800 0x563264d25b80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563264dc5400 msgr2=0x563264d26c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563264dc5400 0x563264d26c00 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563264dc5000 msgr2=0x563264d26100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563264dc5000 0x563264d26100 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264dc4c00 msgr2=0x563264d25600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264dc4c00 0x563264d25600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x56326580c030 tx=0x563264d8d380 comp rx=0 tx=0).stop 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 msgr2=0x563264d24b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x56326580d9b0 tx=0x563264b2db60 comp rx=0 tx=0).stop 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75f8abc700 1 -- 172.21.15.155:0/915713888 reap_dead start 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 shutdown_connections 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 --2- 172.21.15.155:0/915713888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3d400 0x563264d24b00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.096+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 >> 172.21.15.155:0/915713888 conn(0x563264a3cc00 msgr2=0x563264b29800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 shutdown_connections 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/915713888 wait complete. 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563264f2e400 msgr2=0x563264f3e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x563264f2e400 0x563264f3e580 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563264e83800 msgr2=0x563264f3e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x563264e83800 0x563264f3e000 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563264f2f800 msgr2=0x563264f3f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x563264f2f800 0x563264f3f080 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563264f2ec00 msgr2=0x563264f3eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x563264f2ec00 0x563264f3eb00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264f2e000 msgr2=0x563264d27700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264f2e000 0x563264d27700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x563264e1fc80 tx=0x563264d8d4a0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 msgr2=0x563264d26680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x563264e9c300 tx=0x563264d8d7a0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75f92bd700 1 -- 172.21.15.155:0/3187437432 reap_dead start 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 shutdown_connections 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 --2- 172.21.15.155:0/3187437432 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264e83400 0x563264d26680 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 >> 172.21.15.155:0/3187437432 conn(0x563264e82800 msgr2=0x563264b2a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 shutdown_connections 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/3187437432 wait complete. 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/346873109 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264dc4000 msgr2=0x563264d25080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 --2- 172.21.15.155:0/346873109 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264dc4000 0x563264d25080 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5632658d8fc0 tx=0x563264d8c540 comp rx=0 tx=0).stop 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/346873109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 msgr2=0x563264d24580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 --2- 172.21.15.155:0/346873109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x56326580dec0 tx=0x563264b2d920 comp rx=0 tx=0).stop 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/346873109 shutdown_connections 2024-04-19T23:45:59.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 --2- 172.21.15.155:0/346873109 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x563264dc4000 0x563264d25080 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 --2- 172.21.15.155:0/346873109 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x563264a3c800 0x563264d24580 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.097+0000 7f75fb313a80 1 -- 172.21.15.155:0/346873109 >> 172.21.15.155:0/346873109 conn(0x563264a3c400 msgr2=0x563264b29000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.098+0000 7f75fb313a80 1 -- 172.21.15.155:0/346873109 shutdown_connections 2024-04-19T23:45:59.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.098+0000 7f75fb313a80 1 -- 172.21.15.155:0/346873109 wait complete. 2024-04-19T23:45:59.102 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-19T23:45:59.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-19T23:45:59.102 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-04-19T23:45:59.149 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:59.149 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:59.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.151+0000 7f166db0fa80 1 Processor -- start 2024-04-19T23:45:59.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.151+0000 7f166db0fa80 1 -- start start 2024-04-19T23:45:59.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.151+0000 7f166db0fa80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55a8e767c800 0x55a8e7964580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.151+0000 7f166db0fa80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a8e79a7500 con 0x55a8e767cc00 2024-04-19T23:45:59.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.151+0000 7f166db0fa80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a8e771ea00 con 0x55a8e767c800 2024-04-19T23:45:59.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.151+0000 7f166bab9700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55a8e767c800 0x55a8e7964580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.151+0000 7f166b2b8700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55a8e767cc00 0x55a8e7768800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:33568/0 (socket says 172.21.15.155:33568) 2024-04-19T23:45:59.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.151+0000 7f166b2b8700 1 -- 172.21.15.155:0/58721269 learned_addr learned my addr 172.21.15.155:0/58721269 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:59.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.152+0000 7f166bab9700 1 -- 172.21.15.155:0/58721269 >> v1:172.21.15.76:6789/0 conn(0x55a8e767cc00 legacy=0x55a8e7768800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.152+0000 7f166bab9700 1 -- 172.21.15.155:0/58721269 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e76a5d40 con 0x55a8e767c800 2024-04-19T23:45:59.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.152+0000 7f166bab9700 1 --2- 172.21.15.155:0/58721269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x55a8e795f9e0 tx=0x55a8e776d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b90d5a51532d6dd server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.152+0000 7f166aab7700 1 -- 172.21.15.155:0/58721269 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e77354a0 con 0x55a8e767c800 2024-04-19T23:45:59.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.152+0000 7f166aab7700 1 -- 172.21.15.155:0/58721269 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8e79a7800 con 0x55a8e767c800 2024-04-19T23:45:59.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.152+0000 7f166aab7700 1 -- 172.21.15.155:0/58721269 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e7735600 con 0x55a8e767c800 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.152+0000 7f166db0fa80 1 -- 172.21.15.155:0/58721269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 msgr2=0x55a8e7964580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.152+0000 7f166db0fa80 1 --2- 172.21.15.155:0/58721269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x55a8e795f9e0 tx=0x55a8e776d920 comp rx=0 tx=0).stop 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.152+0000 7f166db0fa80 1 -- 172.21.15.155:0/58721269 shutdown_connections 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.152+0000 7f166db0fa80 1 --2- 172.21.15.155:0/58721269 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.152+0000 7f166db0fa80 1 -- 172.21.15.155:0/58721269 >> 172.21.15.155:0/58721269 conn(0x55a8e767c400 msgr2=0x55a8e7768000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.153+0000 7f166db0fa80 1 -- 172.21.15.155:0/58721269 shutdown_connections 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.153+0000 7f166db0fa80 1 -- 172.21.15.155:0/58721269 wait complete. 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.153+0000 7f166db0fa80 1 Processor -- start 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.153+0000 7f166db0fa80 1 -- start start 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.153+0000 7f166db0fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.153+0000 7f166db0fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e771e500 con 0x55a8e767c800 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.154+0000 7f166bab9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.154+0000 7f166bab9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35336/0 (socket says 172.21.15.155:35336) 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.154+0000 7f166bab9700 1 -- 172.21.15.155:0/1870964159 learned_addr learned my addr 172.21.15.155:0/1870964159 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.154+0000 7f166bab9700 1 -- 172.21.15.155:0/1870964159 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e76a5ba0 con 0x55a8e767c800 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.154+0000 7f166bab9700 1 --2- 172.21.15.155:0/1870964159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x55a8e84ed800 tx=0x55a8e776d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871123e0505254d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.154+0000 7f166a2b6700 1 -- 172.21.15.155:0/1870964159 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e7735760 con 0x55a8e767c800 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.154+0000 7f166a2b6700 1 -- 172.21.15.155:0/1870964159 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8e79a7b00 con 0x55a8e767c800 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.154+0000 7f166a2b6700 1 -- 172.21.15.155:0/1870964159 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e77351e0 con 0x55a8e767c800 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166db0fa80 1 -- 172.21.15.155:0/1870964159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 msgr2=0x55a8e7964580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166db0fa80 1 --2- 172.21.15.155:0/1870964159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x55a8e84ed800 tx=0x55a8e776d800 comp rx=0 tx=0).stop 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166db0fa80 1 -- 172.21.15.155:0/1870964159 shutdown_connections 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166db0fa80 1 --2- 172.21.15.155:0/1870964159 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166db0fa80 1 -- 172.21.15.155:0/1870964159 >> 172.21.15.155:0/1870964159 conn(0x55a8e767c400 msgr2=0x55a8e7769000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166db0fa80 1 -- 172.21.15.155:0/1870964159 shutdown_connections 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166db0fa80 1 -- 172.21.15.155:0/1870964159 wait complete. 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166db0fa80 1 Processor -- start 2024-04-19T23:45:59.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166db0fa80 1 -- start start 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166db0fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166db0fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e771e3c0 con 0x55a8e767c800 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166bab9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166bab9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35342/0 (socket says 172.21.15.155:35342) 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.155+0000 7f166bab9700 1 -- 172.21.15.155:0/635878421 learned_addr learned my addr 172.21.15.155:0/635878421 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.156+0000 7f166bab9700 1 -- 172.21.15.155:0/635878421 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e76a5a00 con 0x55a8e767c800 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.156+0000 7f166bab9700 1 --2- 172.21.15.155:0/635878421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x55a8e84edec0 tx=0x55a8e776d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.156+0000 7f1668ab3700 1 -- 172.21.15.155:0/635878421 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e77354a0 con 0x55a8e767c800 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.156+0000 7f1668ab3700 1 -- 172.21.15.155:0/635878421 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8e79a7c80 con 0x55a8e767c800 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.156+0000 7f166db0fa80 1 -- 172.21.15.155:0/635878421 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a8e76a5860 con 0x55a8e767c800 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.156+0000 7f1668ab3700 1 -- 172.21.15.155:0/635878421 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e7735600 con 0x55a8e767c800 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.156+0000 7f166db0fa80 1 -- 172.21.15.155:0/635878421 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8e76a56c0 con 0x55a8e767c800 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f166db0fa80 1 Processor -- start 2024-04-19T23:45:59.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f166db0fa80 1 -- start start 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f166db0fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 0x55a8e7964b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f166db0fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e76b8640 con 0x55a8e767d400 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f1668ab3700 1 -- 172.21.15.155:0/635878421 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55a8e841eb00 con 0x55a8e767c800 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f1668ab3700 1 --2- 172.21.15.155:0/635878421 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e79fa000 0x55a8e7965080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f166c2ba700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 0x55a8e7964b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f1668ab3700 1 -- 172.21.15.155:0/635878421 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55a8e76f7180 con 0x55a8e767c800 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f166c2ba700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 0x55a8e7964b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35348/0 (socket says 172.21.15.155:35348) 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f166c2ba700 1 -- 172.21.15.155:0/4053024773 learned_addr learned my addr 172.21.15.155:0/4053024773 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f166bab9700 1 --2- 172.21.15.155:0/635878421 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e79fa000 0x55a8e7965080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f166c2ba700 1 -- 172.21.15.155:0/4053024773 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e76a4000 con 0x55a8e767d400 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f166bab9700 1 --2- 172.21.15.155:0/635878421 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e79fa000 0x55a8e7965080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55a8e84f4fc0 tx=0x55a8e79c2540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.157+0000 7f166c2ba700 1 --2- 172.21.15.155:0/4053024773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 0x55a8e7964b00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55a8e84ed860 tx=0x55a8e79c2720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4748759ab0695b server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f16662ae700 1 -- 172.21.15.155:0/4053024773 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e77354a0 con 0x55a8e767d400 2024-04-19T23:45:59.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f16662ae700 1 -- 172.21.15.155:0/4053024773 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8e771dc80 con 0x55a8e767d400 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f16662ae700 1 -- 172.21.15.155:0/4053024773 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e7735600 con 0x55a8e767d400 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f166db0fa80 1 -- 172.21.15.155:0/4053024773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 msgr2=0x55a8e7964b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f166db0fa80 1 --2- 172.21.15.155:0/4053024773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 0x55a8e7964b00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55a8e84ed860 tx=0x55a8e79c2720 comp rx=0 tx=0).stop 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f166db0fa80 1 -- 172.21.15.155:0/4053024773 shutdown_connections 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f166db0fa80 1 --2- 172.21.15.155:0/4053024773 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 0x55a8e7964b00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f166db0fa80 1 -- 172.21.15.155:0/4053024773 >> 172.21.15.155:0/4053024773 conn(0x55a8e767cc00 msgr2=0x55a8e7769800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f166db0fa80 1 -- 172.21.15.155:0/4053024773 shutdown_connections 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f166db0fa80 1 -- 172.21.15.155:0/4053024773 wait complete. 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f166db0fa80 1 Processor -- start 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.158+0000 7f166db0fa80 1 -- start start 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f166db0fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 0x55a8e7964b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f166db0fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e76b88c0 con 0x55a8e767d400 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f166c2ba700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 0x55a8e7964b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f166c2ba700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 0x55a8e7964b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35356/0 (socket says 172.21.15.155:35356) 2024-04-19T23:45:59.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 learned_addr learned my addr 172.21.15.155:0/285693874 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e76a4ea0 con 0x55a8e767d400 2024-04-19T23:45:59.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f166c2ba700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 0x55a8e7964b00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x55a8e84f4240 tx=0x55a8e776d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f1664aab700 1 -- 172.21.15.155:0/285693874 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e7735760 con 0x55a8e767d400 2024-04-19T23:45:59.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f1664aab700 1 -- 172.21.15.155:0/285693874 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8e771db00 con 0x55a8e767d400 2024-04-19T23:45:59.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a8e76a4820 con 0x55a8e767d400 2024-04-19T23:45:59.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f1664aab700 1 -- 172.21.15.155:0/285693874 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e77354a0 con 0x55a8e767d400 2024-04-19T23:45:59.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.159+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8e76a49c0 con 0x55a8e767d400 2024-04-19T23:45:59.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.160+0000 7f1664aab700 1 -- 172.21.15.155:0/285693874 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55a8e841edc0 con 0x55a8e767d400 2024-04-19T23:45:59.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.160+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.160+0000 7f1664aab700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e79fac00 0x55a8e7965600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.160+0000 7f1664aab700 1 -- 172.21.15.155:0/285693874 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55a8e76f7340 con 0x55a8e767d400 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166b2b8700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e79fac00 0x55a8e7965600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166db0fa80 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55a8e767d800 0x55a8e7965b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e767dc00 con 0x55a8e767d800 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166c2ba700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55a8e767d800 0x55a8e7965b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166b2b8700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e79fac00 0x55a8e7965600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55a8e79fde30 tx=0x55a8e79c3320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166c2ba700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55a8e767d800 0x55a8e7965b80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166db0fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166db0fa80 20 realm 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e79fb000 con 0x55a8e767d800 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166db0fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166db0fa80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.161+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e79fb400 con 0x55a8e767d800 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166db0fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e79fb800 con 0x55a8e767d800 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166db0fa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e79fbc00 con 0x55a8e767d800 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166db0fa80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:59.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166db0fa80 20 searching for the correct realm 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166db0fa80 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55a8e79fb000 0x55a8e7966100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e79fb400 con 0x55a8e79fb000 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166bab9700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55a8e79fb000 0x55a8e7966100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.162+0000 7f166bab9700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55a8e79fb000 0x55a8e7966100 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.163+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.163+0000 7f166bab9700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55a8e79fb400 0x55a8e7966c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.163+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a000 con 0x55a8e79fb400 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.163+0000 7f166b2b8700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55a8e79fb400 0x55a8e7966c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.163+0000 7f166b2b8700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55a8e79fb400 0x55a8e7966c00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.164+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.164+0000 7f166b2b8700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55a8e850a000 0x55a8e7967180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.164+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e850a000 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.164+0000 7f166c2ba700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55a8e850a000 0x55a8e7967180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.164+0000 7f166c2ba700 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55a8e850a000 0x55a8e7967180 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.165+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.165+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e767d800 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.165+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.165+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e767d800 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.165+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.165+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e850a000 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.165+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.165+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e850a000 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.166+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.166+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb400 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.166+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.166+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb000 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.166+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.166+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e767d800 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.166+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.166+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e850a000 2024-04-19T23:45:59.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.167+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.167+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e767d800 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.167+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.167+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb400 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.167+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.167+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb000 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.167+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.167+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb000 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.168+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.168+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e850a000 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.168+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.168+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb000 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.168+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.168+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb000 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.168+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.168+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e767d800 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.169+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.169+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e767d800 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.169+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.169+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e850a000 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.169+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.169+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb000 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.169+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.169+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb400 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.170+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.170+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e767d800 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.170+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.170+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e850a000 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.170+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.170+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb000 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.170+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.170+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e850a000 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.171+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.171+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb400 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.171+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.171+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb000 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.171+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.171+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e850a000 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.171+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.171+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e767d800 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb400 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:59.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e767dc00 con 0x55a8e767d800 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850ac00 con 0x55a8e767d800 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.172+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850b000 con 0x55a8e79fb400 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:59.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 20 zone default found 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 4 Realm: () 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 20 zonegroup default 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850b400 con 0x55a8e850a000 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850b800 con 0x55a8e79fb000 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850bc00 con 0x55a8e79fb000 2024-04-19T23:45:59.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 20 started sync module instance, tier type = 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.173+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850ac00 con 0x55a8e79fb400 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.174+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.174+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94183928216320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e767dc00 con 0x55a8e79fb400 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.174+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e79fb800 con 0x55a8e767d800 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.175+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94183928216320] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.176+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.176+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94183928217472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e79fbc00 con 0x55a8e767d800 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.176+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e79fb000 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.177+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94183928217472] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.177+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.177+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94183928218624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850b000 con 0x55a8e79fb000 2024-04-19T23:45:59.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.177+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850ac00 con 0x55a8e79fb400 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.178+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.178+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94183928219776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a400 con 0x55a8e79fb400 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.178+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850b800 con 0x55a8e767d800 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.178+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94183928218624] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.179+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94183928219776] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.179+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.179+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94183928220928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850bc00 con 0x55a8e767d800 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.179+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850a800 con 0x55a8e850a000 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.180+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94183928220928] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.180+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.180+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94183928222080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850b400 con 0x55a8e850a000 2024-04-19T23:45:59.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.180+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850b800 con 0x55a8e850a000 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.181+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94183928222080] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.181+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.181+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94183928223232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850bc00 con 0x55a8e850a000 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.181+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e79fb800 con 0x55a8e850a000 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.182+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94183928223232] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.182+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.182+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94183928224384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e79fbc00 con 0x55a8e850a000 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.182+0000 7f166db0fa80 20 add_watcher() i=0 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.182+0000 7f166db0fa80 20 add_watcher() i=1 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.183+0000 7f166db0fa80 20 add_watcher() i=2 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.183+0000 7f166db0fa80 20 add_watcher() i=3 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.183+0000 7f166db0fa80 20 add_watcher() i=4 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.183+0000 7f166db0fa80 20 add_watcher() i=5 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.183+0000 7f166db0fa80 20 add_watcher() i=6 2024-04-19T23:45:59.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.183+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94183928224384] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.183+0000 7f166db0fa80 20 add_watcher() i=7 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.183+0000 7f166db0fa80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.183+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e79fb800 con 0x55a8e767d800 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.184+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.184+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94183929741312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e79fbc00 con 0x55a8e767d800 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.185+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94183929741312] v30'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.185+0000 7f1652a87700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.185+0000 7f166db0fa80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.185+0000 7f166db0fa80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.185+0000 7f166db0fa80 1 Processor -- start 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.185+0000 7f166db0fa80 1 -- start start 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.185+0000 7f166db0fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.185+0000 7f166db0fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e771e3c0 con 0x55a8e850b400 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.186+0000 7f166b2b8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.186+0000 7f166b2b8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35360/0 (socket says 172.21.15.155:35360) 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.186+0000 7f166b2b8700 1 -- 172.21.15.155:0/2532495898 learned_addr learned my addr 172.21.15.155:0/2532495898 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.186+0000 7f166b2b8700 1 -- 172.21.15.155:0/2532495898 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e76a4b60 con 0x55a8e850b400 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.186+0000 7f166b2b8700 1 --2- 172.21.15.155:0/2532495898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55a8e7ae20c0 tx=0x55a8e79c3680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68bfe77c7b273a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.186+0000 7f1652286700 1 -- 172.21.15.155:0/2532495898 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e7af2000 con 0x55a8e850b400 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.186+0000 7f1652286700 1 -- 172.21.15.155:0/2532495898 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8e7afc000 con 0x55a8e850b400 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.186+0000 7f1652286700 1 -- 172.21.15.155:0/2532495898 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e7af2160 con 0x55a8e850b400 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.187+0000 7f166db0fa80 1 -- 172.21.15.155:0/2532495898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 msgr2=0x55a8e7966680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.187+0000 7f166db0fa80 1 --2- 172.21.15.155:0/2532495898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55a8e7ae20c0 tx=0x55a8e79c3680 comp rx=0 tx=0).stop 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.187+0000 7f166db0fa80 1 -- 172.21.15.155:0/2532495898 shutdown_connections 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.187+0000 7f166db0fa80 1 --2- 172.21.15.155:0/2532495898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.187+0000 7f166db0fa80 1 -- 172.21.15.155:0/2532495898 >> 172.21.15.155:0/2532495898 conn(0x55a8e850a800 msgr2=0x55a8e776a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.187+0000 7f166db0fa80 1 -- 172.21.15.155:0/2532495898 shutdown_connections 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.187+0000 7f166db0fa80 1 -- 172.21.15.155:0/2532495898 wait complete. 2024-04-19T23:45:59.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.187+0000 7f166db0fa80 1 Processor -- start 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.187+0000 7f166db0fa80 1 -- start start 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.188+0000 7f166db0fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.188+0000 7f166db0fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e771e500 con 0x55a8e850b400 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.188+0000 7f166b2b8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.188+0000 7f166b2b8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35364/0 (socket says 172.21.15.155:35364) 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.188+0000 7f166b2b8700 1 -- 172.21.15.155:0/4029119238 learned_addr learned my addr 172.21.15.155:0/4029119238 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.188+0000 7f166b2b8700 1 -- 172.21.15.155:0/4029119238 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e76a4d00 con 0x55a8e850b400 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.188+0000 7f166b2b8700 1 --2- 172.21.15.155:0/4029119238 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55a8e7ae3380 tx=0x55a8e79c37a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.189+0000 7f1650a83700 1 -- 172.21.15.155:0/4029119238 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e7af22c0 con 0x55a8e850b400 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.189+0000 7f1650a83700 1 -- 172.21.15.155:0/4029119238 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8e7afc180 con 0x55a8e850b400 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.189+0000 7f166db0fa80 1 -- 172.21.15.155:0/4029119238 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a8e76a4340 con 0x55a8e850b400 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.189+0000 7f1650a83700 1 -- 172.21.15.155:0/4029119238 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a8e7af2000 con 0x55a8e850b400 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.189+0000 7f166db0fa80 1 -- 172.21.15.155:0/4029119238 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8e76a4b60 con 0x55a8e850b400 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.189+0000 7f1650a83700 1 -- 172.21.15.155:0/4029119238 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55a8e841fb80 con 0x55a8e850b400 2024-04-19T23:45:59.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.190+0000 7f1650a83700 1 --2- 172.21.15.155:0/4029119238 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e7b74000 0x55a8e7967700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.190+0000 7f1650a83700 1 -- 172.21.15.155:0/4029119238 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55a8e76f7500 con 0x55a8e850b400 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.190+0000 7f166c2ba700 1 --2- 172.21.15.155:0/4029119238 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e7b74000 0x55a8e7967700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.190+0000 7f166db0fa80 5 note: GC not initialized 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.190+0000 7f166c2ba700 1 --2- 172.21.15.155:0/4029119238 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e7b74000 0x55a8e7967700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55a8e79fd440 tx=0x55a8e79c34a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f164e27e700 20 reqs_thread_entry: start 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f166db0fa80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f166db0fa80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f164c27a700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:29 2024 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f164ba58700 20 reqs_thread_entry: start 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f166db0fa80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f166db0fa80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e850bc00 con 0x55a8e767d800 2024-04-19T23:45:59.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f166db0fa80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f166db0fa80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f166db0fa80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f166db0fa80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.191+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~369 in=369b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7b74800 con 0x55a8e767d800 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.192+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~369] v30'16 uv16 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f166db0fa80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f166db0fa80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f166db0fa80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94183929743616 in=557b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7b74c00 con 0x55a8e767d800 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94183928220928 notify 128849018898 ret 0) v3 ==== 587+0+0 (crc 0 0 0) 0x55a8e7a67d40 con 0x55a8e767d800 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f16662ae700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94183928220928 notifier 4709 bl.length()=545 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f16662ae700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f16662ae700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(64 notify.4 [notify cookie 94183929743616 out=8b] v0'0 uv180 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f16662ae700 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7be6000 con 0x55a8e767d800 2024-04-19T23:45:59.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.193+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 94183929743616 notify 128849018898 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a8e7b3dd40 con 0x55a8e767d800 2024-04-19T23:45:59.202 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:59.202 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:59.202 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:59.202 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:59.202 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:59.202 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:59.202 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:59.202 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [ 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "user", 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: "perm": "read" 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:59.203 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:59.204 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:59.205 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:59.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:59.205 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:59.205 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:59.205 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:59.205 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:59.205 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:59.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.194+0000 7f1652a87700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:59.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.194+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94183929741312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7b75000 con 0x55a8e767d800 2024-04-19T23:45:59.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.195+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94183929741312] v30'189 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.195+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94183928216320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7b75400 con 0x55a8e79fb400 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.196+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94183928216320] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.196+0000 7f166db0fa80 20 remove_watcher() i=0 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.196+0000 7f166db0fa80 2 removed watcher, disabling cache 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.196+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94183928217472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7b75800 con 0x55a8e767d800 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.197+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94183928217472] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.197+0000 7f166db0fa80 20 remove_watcher() i=1 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.197+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94183928218624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7b75c00 con 0x55a8e79fb000 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.199+0000 7f166bab9700 1 -- 172.21.15.155:0/285693874 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94183928218624] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa5200 con 0x55a8e79fb000 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.199+0000 7f166db0fa80 20 remove_watcher() i=2 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.199+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94183928219776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7be6000 con 0x55a8e79fb400 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.199+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94183928219776] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa5440 con 0x55a8e79fb400 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.200+0000 7f166db0fa80 20 remove_watcher() i=3 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.200+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94183928220928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7be6800 con 0x55a8e767d800 2024-04-19T23:45:59.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.201+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94183928220928] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e767d800 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.201+0000 7f166db0fa80 20 remove_watcher() i=4 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.201+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94183928222080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7be6c00 con 0x55a8e850a000 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.202+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94183928222080] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.202+0000 7f166db0fa80 20 remove_watcher() i=5 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.202+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94183928223232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7be7000 con 0x55a8e850a000 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.203+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94183928223232] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.203+0000 7f166db0fa80 20 remove_watcher() i=6 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.203+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94183928224384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a8e7be7400 con 0x55a8e850a000 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166c2ba700 1 -- 172.21.15.155:0/285693874 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94183928224384] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a8e7aa4b40 con 0x55a8e850a000 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 20 remove_watcher() i=7 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55a8e850a000 msgr2=0x55a8e7967180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55a8e850a000 0x55a8e7967180 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55a8e767d800 msgr2=0x55a8e7965b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55a8e767d800 0x55a8e7965b80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55a8e79fb400 msgr2=0x55a8e7966c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55a8e79fb400 0x55a8e7966c00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55a8e79fb000 msgr2=0x55a8e7966100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55a8e79fb000 0x55a8e7966100 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e79fac00 msgr2=0x55a8e7965600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e79fac00 0x55a8e7965600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55a8e79fde30 tx=0x55a8e79c3320 comp rx=0 tx=0).stop 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 msgr2=0x55a8e7964b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 --2- 172.21.15.155:0/285693874 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767d400 0x55a8e7964b00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x55a8e84f4240 tx=0x55a8e776d8c0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 reap_dead start 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166b2b8700 1 -- 172.21.15.155:0/285693874 reap_dead start 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 shutdown_connections 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 >> 172.21.15.155:0/285693874 conn(0x55a8e767cc00 msgr2=0x55a8e7769800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 shutdown_connections 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/285693874 wait complete. 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/4029119238 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e7b74000 msgr2=0x55a8e7967700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 --2- 172.21.15.155:0/4029119238 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e7b74000 0x55a8e7967700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55a8e79fd440 tx=0x55a8e79c34a0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/4029119238 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 msgr2=0x55a8e7966680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 --2- 172.21.15.155:0/4029119238 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55a8e7ae3380 tx=0x55a8e79c37a0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 -- 172.21.15.155:0/4029119238 shutdown_connections 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.204+0000 7f166db0fa80 1 --2- 172.21.15.155:0/4029119238 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e7b74000 0x55a8e7967700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 --2- 172.21.15.155:0/4029119238 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e850b400 0x55a8e7966680 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 -- 172.21.15.155:0/4029119238 >> 172.21.15.155:0/4029119238 conn(0x55a8e850a800 msgr2=0x55a8e776a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 -- 172.21.15.155:0/4029119238 shutdown_connections 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 -- 172.21.15.155:0/4029119238 wait complete. 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 -- 172.21.15.155:0/635878421 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e79fa000 msgr2=0x55a8e7965080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 --2- 172.21.15.155:0/635878421 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e79fa000 0x55a8e7965080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55a8e84f4fc0 tx=0x55a8e79c2540 comp rx=0 tx=0).stop 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 -- 172.21.15.155:0/635878421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 msgr2=0x55a8e7964580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 --2- 172.21.15.155:0/635878421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x55a8e84edec0 tx=0x55a8e776d920 comp rx=0 tx=0).stop 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 -- 172.21.15.155:0/635878421 shutdown_connections 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 --2- 172.21.15.155:0/635878421 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55a8e79fa000 0x55a8e7965080 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 --2- 172.21.15.155:0/635878421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55a8e767c800 0x55a8e7964580 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 -- 172.21.15.155:0/635878421 >> 172.21.15.155:0/635878421 conn(0x55a8e767c400 msgr2=0x55a8e7769000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 -- 172.21.15.155:0/635878421 shutdown_connections 2024-04-19T23:45:59.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.205+0000 7f166db0fa80 1 -- 172.21.15.155:0/635878421 wait complete. 2024-04-19T23:45:59.215 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:59.215 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-19T23:45:59.215 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-19T23:45:59.215 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-04-19T23:45:59.262 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:59.263 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:59.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.264+0000 7fd8edf74a80 1 Processor -- start 2024-04-19T23:45:59.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.264+0000 7fd8edf74a80 1 -- start start 2024-04-19T23:45:59.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.265+0000 7fd8edf74a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x557b1a088800 0x557b1a370580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.265+0000 7fd8edf74a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557b1a3b3500 con 0x557b1a088c00 2024-04-19T23:45:59.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.265+0000 7fd8edf74a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x557b1a12aa00 con 0x557b1a088800 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.265+0000 7fd8eb71d700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x557b1a088c00 0x557b1a174800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:33578/0 (socket says 172.21.15.155:33578) 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.265+0000 7fd8eb71d700 1 -- 172.21.15.155:0/2842363922 learned_addr learned my addr 172.21.15.155:0/2842363922 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.265+0000 7fd8ebf1e700 1 --2- 172.21.15.155:0/2842363922 >> v2:172.21.15.76:3300/0 conn(0x557b1a088800 0x557b1a370580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.265+0000 7fd8eaf1c700 1 -- 172.21.15.155:0/2842363922 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371692686 0 0) 0x557b1ae56000 con 0x557b1a088c00 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.265+0000 7fd8eaf1c700 1 -- 172.21.15.155:0/2842363922 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x557b1a3b3680 con 0x557b1a088c00 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.265+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/2842363922 >> v1:172.21.15.76:6789/0 conn(0x557b1a088c00 legacy=0x557b1a174800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.265+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/2842363922 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1a0b1d40 con 0x557b1a088800 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.265+0000 7fd8ebf1e700 1 --2- 172.21.15.155:0/2842363922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x557b1a36b9e0 tx=0x557b1a179980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3629ce850cf19e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.266+0000 7fd8eaf1c700 1 -- 172.21.15.155:0/2842363922 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a1414a0 con 0x557b1a088800 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.266+0000 7fd8eaf1c700 1 -- 172.21.15.155:0/2842363922 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b1a3b3680 con 0x557b1a088800 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.266+0000 7fd8eaf1c700 1 -- 172.21.15.155:0/2842363922 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a141600 con 0x557b1a088800 2024-04-19T23:45:59.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.266+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2842363922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 msgr2=0x557b1a370580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.266+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/2842363922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x557b1a36b9e0 tx=0x557b1a179980 comp rx=0 tx=0).stop 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.266+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2842363922 shutdown_connections 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.266+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/2842363922 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.266+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2842363922 >> 172.21.15.155:0/2842363922 conn(0x557b1a088400 msgr2=0x557b1a174000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.266+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2842363922 shutdown_connections 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.266+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2842363922 wait complete. 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.267+0000 7fd8edf74a80 1 Processor -- start 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.267+0000 7fd8edf74a80 1 -- start start 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.267+0000 7fd8edf74a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.267+0000 7fd8edf74a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a12a500 con 0x557b1a088800 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.267+0000 7fd8ebf1e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.267+0000 7fd8ebf1e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35374/0 (socket says 172.21.15.155:35374) 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.267+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/3745788004 learned_addr learned my addr 172.21.15.155:0/3745788004 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.267+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/3745788004 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1a0b1ba0 con 0x557b1a088800 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.267+0000 7fd8ebf1e700 1 --2- 172.21.15.155:0/3745788004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x557b1ae59800 tx=0x557b1a179800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517e2b511ea4529a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8ea71b700 1 -- 172.21.15.155:0/3745788004 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a141760 con 0x557b1a088800 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8ea71b700 1 -- 172.21.15.155:0/3745788004 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b1a3b3980 con 0x557b1a088800 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8ea71b700 1 -- 172.21.15.155:0/3745788004 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a1414a0 con 0x557b1a088800 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8edf74a80 1 -- 172.21.15.155:0/3745788004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 msgr2=0x557b1a370580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/3745788004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x557b1ae59800 tx=0x557b1a179800 comp rx=0 tx=0).stop 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8edf74a80 1 -- 172.21.15.155:0/3745788004 shutdown_connections 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/3745788004 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8edf74a80 1 -- 172.21.15.155:0/3745788004 >> 172.21.15.155:0/3745788004 conn(0x557b1a088400 msgr2=0x557b1a175000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8edf74a80 1 -- 172.21.15.155:0/3745788004 shutdown_connections 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8edf74a80 1 -- 172.21.15.155:0/3745788004 wait complete. 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8edf74a80 1 Processor -- start 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.268+0000 7fd8edf74a80 1 -- start start 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.269+0000 7fd8edf74a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.269+0000 7fd8edf74a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a12a3c0 con 0x557b1a088800 2024-04-19T23:45:59.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.269+0000 7fd8ebf1e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.269+0000 7fd8ebf1e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35386/0 (socket says 172.21.15.155:35386) 2024-04-19T23:45:59.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.269+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/698043573 learned_addr learned my addr 172.21.15.155:0/698043573 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.269+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/698043573 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1a0b1a00 con 0x557b1a088800 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.269+0000 7fd8ebf1e700 1 --2- 172.21.15.155:0/698043573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x557b1ae59ec0 tx=0x557b1a179980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.269+0000 7fd8e8f18700 1 -- 172.21.15.155:0/698043573 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a141600 con 0x557b1a088800 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.269+0000 7fd8e8f18700 1 -- 172.21.15.155:0/698043573 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b1a3b3b00 con 0x557b1a088800 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.270+0000 7fd8edf74a80 1 -- 172.21.15.155:0/698043573 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b1a0b1860 con 0x557b1a088800 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.270+0000 7fd8e8f18700 1 -- 172.21.15.155:0/698043573 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a1418c0 con 0x557b1a088800 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.270+0000 7fd8edf74a80 1 -- 172.21.15.155:0/698043573 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b1a0b16c0 con 0x557b1a088800 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.270+0000 7fd8edf74a80 1 Processor -- start 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.270+0000 7fd8edf74a80 1 -- start start 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.270+0000 7fd8e8f18700 1 -- 172.21.15.155:0/698043573 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557b1ae2ab00 con 0x557b1a088800 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.270+0000 7fd8edf74a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 0x557b1a370b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.270+0000 7fd8edf74a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a0c4640 con 0x557b1a089400 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.270+0000 7fd8e8f18700 1 --2- 172.21.15.155:0/698043573 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a406000 0x557b1a371080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.270+0000 7fd8e8f18700 1 -- 172.21.15.155:0/698043573 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x557b1a103180 con 0x557b1a088800 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.271+0000 7fd8ebf1e700 1 --2- 172.21.15.155:0/698043573 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a406000 0x557b1a371080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.271+0000 7fd8ec71f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 0x557b1a370b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.271+0000 7fd8ec71f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 0x557b1a370b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35394/0 (socket says 172.21.15.155:35394) 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.271+0000 7fd8ec71f700 1 -- 172.21.15.155:0/225079033 learned_addr learned my addr 172.21.15.155:0/225079033 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.271+0000 7fd8ebf1e700 1 --2- 172.21.15.155:0/698043573 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a406000 0x557b1a371080 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x557b1af14f90 tx=0x557b1a3cc540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.271+0000 7fd8ec71f700 1 -- 172.21.15.155:0/225079033 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1a0b0000 con 0x557b1a089400 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.271+0000 7fd8ec71f700 1 --2- 172.21.15.155:0/225079033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 0x557b1a370b00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x557b1af14210 tx=0x557b1a3cc720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd07b0e6d3db694 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.271+0000 7fd8e6713700 1 -- 172.21.15.155:0/225079033 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a141600 con 0x557b1a089400 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.271+0000 7fd8e6713700 1 -- 172.21.15.155:0/225079033 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b1a129c80 con 0x557b1a089400 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.271+0000 7fd8e6713700 1 -- 172.21.15.155:0/225079033 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a1418c0 con 0x557b1a089400 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.272+0000 7fd8edf74a80 1 -- 172.21.15.155:0/225079033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 msgr2=0x557b1a370b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.272+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/225079033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 0x557b1a370b00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x557b1af14210 tx=0x557b1a3cc720 comp rx=0 tx=0).stop 2024-04-19T23:45:59.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.272+0000 7fd8edf74a80 1 -- 172.21.15.155:0/225079033 shutdown_connections 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.272+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/225079033 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 0x557b1a370b00 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.272+0000 7fd8edf74a80 1 -- 172.21.15.155:0/225079033 >> 172.21.15.155:0/225079033 conn(0x557b1a088c00 msgr2=0x557b1a175800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.272+0000 7fd8edf74a80 1 -- 172.21.15.155:0/225079033 shutdown_connections 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.272+0000 7fd8edf74a80 1 -- 172.21.15.155:0/225079033 wait complete. 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.272+0000 7fd8edf74a80 1 Processor -- start 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.272+0000 7fd8edf74a80 1 -- start start 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.272+0000 7fd8edf74a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 0x557b1a370b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.272+0000 7fd8edf74a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a0c48c0 con 0x557b1a089400 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.273+0000 7fd8ec71f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 0x557b1a370b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.273+0000 7fd8ec71f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 0x557b1a370b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35402/0 (socket says 172.21.15.155:35402) 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.273+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 learned_addr learned my addr 172.21.15.155:0/326570304 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.273+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1a0b0ea0 con 0x557b1a089400 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.273+0000 7fd8ec71f700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 0x557b1a370b00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x557b1ae599b0 tx=0x557b1a1798c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.273+0000 7fd8e4f10700 1 -- 172.21.15.155:0/326570304 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a141760 con 0x557b1a089400 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.273+0000 7fd8e4f10700 1 -- 172.21.15.155:0/326570304 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b1a129b00 con 0x557b1a089400 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.273+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b1a0b0820 con 0x557b1a089400 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.273+0000 7fd8e4f10700 1 -- 172.21.15.155:0/326570304 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a141600 con 0x557b1a089400 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.273+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b1a0b09c0 con 0x557b1a089400 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.274+0000 7fd8e4f10700 1 -- 172.21.15.155:0/326570304 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557b1ae2adc0 con 0x557b1a089400 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.274+0000 7fd8e4f10700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a406c00 0x557b1a371600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.274+0000 7fd8e4f10700 1 -- 172.21.15.155:0/326570304 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x557b1a103340 con 0x557b1a089400 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.274+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.274+0000 7fd8eb71d700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a406c00 0x557b1a371600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.274+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557b1a089800 0x557b1a371b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.274+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a089c00 con 0x557b1a089800 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.274+0000 7fd8ec71f700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557b1a089800 0x557b1a371b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8eb71d700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a406c00 0x557b1a371600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x557b1ae58030 tx=0x557b1a3cd320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8ec71f700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557b1a089800 0x557b1a371b80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8edf74a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8edf74a80 20 realm 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a407000 con 0x557b1a089800 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8edf74a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8edf74a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a407400 con 0x557b1a089800 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8edf74a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.275+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a407800 con 0x557b1a089800 2024-04-19T23:45:59.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.276+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.276+0000 7fd8edf74a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.276+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.276+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a407c00 con 0x557b1a089800 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.276+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.276+0000 7fd8edf74a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.276+0000 7fd8edf74a80 20 searching for the correct realm 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.276+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557b1a407000 0x557b1a372100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.276+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a407400 con 0x557b1a407000 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.276+0000 7fd8ebf1e700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557b1a407000 0x557b1a372100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.276+0000 7fd8ebf1e700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557b1a407000 0x557b1a372100 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.277+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.277+0000 7fd8ebf1e700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557b1a407400 0x557b1a372c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.277+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24000 con 0x557b1a407400 2024-04-19T23:45:59.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.277+0000 7fd8eb71d700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557b1a407400 0x557b1a372c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.277+0000 7fd8eb71d700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557b1a407400 0x557b1a372c00 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.277+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.277+0000 7fd8eb71d700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557b1af24000 0x557b1a373180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.277+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1af24000 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.278+0000 7fd8ec71f700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557b1af24000 0x557b1a373180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.278+0000 7fd8ec71f700 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557b1af24000 0x557b1a373180 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.278+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.278+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a089800 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.279+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.279+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a089800 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.279+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.279+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1af24000 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.279+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.279+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1af24000 2024-04-19T23:45:59.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.279+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.279+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407400 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.280+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.280+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407000 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.280+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.280+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a089800 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.280+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.280+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1af24000 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.280+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.280+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a089800 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.280+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.281+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407400 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.281+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.281+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407000 2024-04-19T23:45:59.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.281+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.281+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407000 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.281+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.281+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1af24000 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.281+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.281+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407000 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.282+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.282+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407000 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.282+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.282+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a089800 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.282+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.282+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a089800 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.282+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.282+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1af24000 2024-04-19T23:45:59.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.283+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.283+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407000 2024-04-19T23:45:59.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.283+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.283+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407400 2024-04-19T23:45:59.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.283+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.283+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a089800 2024-04-19T23:45:59.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.283+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.283+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1af24000 2024-04-19T23:45:59.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.284+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.284+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407000 2024-04-19T23:45:59.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.284+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.284+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1af24000 2024-04-19T23:45:59.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.284+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.284+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407400 2024-04-19T23:45:59.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.284+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.284+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407000 2024-04-19T23:45:59.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.285+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.285+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1af24000 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.285+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.285+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a089800 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.285+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.285+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407400 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.285+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.285+0000 7fd8edf74a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.285+0000 7fd8edf74a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.285+0000 7fd8edf74a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.285+0000 7fd8edf74a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a089c00 con 0x557b1a089800 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24c00 con 0x557b1a089800 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af25000 con 0x557b1a407400 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 20 zone default found 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 4 Realm: () 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 20 zonegroup default 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.286+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af25400 con 0x557b1af24000 2024-04-19T23:45:59.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8edf74a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af25800 con 0x557b1a407000 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8edf74a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af25c00 con 0x557b1a407000 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8edf74a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8edf74a80 20 started sync module instance, tier type = 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8edf74a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.287+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24c00 con 0x557b1a407400 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.288+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.288+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93987209116416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a089c00 con 0x557b1a407400 2024-04-19T23:45:59.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.288+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a407800 con 0x557b1a089800 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.289+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93987209116416] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.290+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.290+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93987209117568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a407c00 con 0x557b1a089800 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.290+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1a407000 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.291+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93987209117568] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.291+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.291+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93987209118720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af25000 con 0x557b1a407000 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.291+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24c00 con 0x557b1a407400 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.292+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.292+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93987209119872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24400 con 0x557b1a407400 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.292+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af25800 con 0x557b1a089800 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.292+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93987209118720] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.293+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93987209119872] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.296+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.296+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93987209121024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af25c00 con 0x557b1a089800 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.296+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af24800 con 0x557b1af24000 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.297+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93987209121024] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.297+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.297+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93987209122176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af25400 con 0x557b1af24000 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.297+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af25800 con 0x557b1af24000 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.298+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93987209122176] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.298+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.298+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93987209123328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af25c00 con 0x557b1af24000 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.298+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a407800 con 0x557b1af24000 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.300+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93987209123328] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.300+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.300+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93987209124480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a407c00 con 0x557b1af24000 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.300+0000 7fd8edf74a80 20 add_watcher() i=0 2024-04-19T23:45:59.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.300+0000 7fd8edf74a80 20 add_watcher() i=1 2024-04-19T23:45:59.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.300+0000 7fd8edf74a80 20 add_watcher() i=2 2024-04-19T23:45:59.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.300+0000 7fd8edf74a80 20 add_watcher() i=3 2024-04-19T23:45:59.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.300+0000 7fd8edf74a80 20 add_watcher() i=4 2024-04-19T23:45:59.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.300+0000 7fd8edf74a80 20 add_watcher() i=5 2024-04-19T23:45:59.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.300+0000 7fd8edf74a80 20 add_watcher() i=6 2024-04-19T23:45:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.302+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93987209124480] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.302+0000 7fd8edf74a80 20 add_watcher() i=7 2024-04-19T23:45:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.302+0000 7fd8edf74a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.302+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a407800 con 0x557b1a089800 2024-04-19T23:45:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.303+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.303+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93987210633216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a407c00 con 0x557b1a089800 2024-04-19T23:45:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.304+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93987210633216] v30'190 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.304+0000 7fd8d2eec700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.304+0000 7fd8edf74a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.304+0000 7fd8edf74a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.304+0000 7fd8edf74a80 1 Processor -- start 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.304+0000 7fd8edf74a80 1 -- start start 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.304+0000 7fd8edf74a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.304+0000 7fd8edf74a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a12a3c0 con 0x557b1af25400 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.305+0000 7fd8eb71d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.305+0000 7fd8eb71d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35414/0 (socket says 172.21.15.155:35414) 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.305+0000 7fd8eb71d700 1 -- 172.21.15.155:0/2329226404 learned_addr learned my addr 172.21.15.155:0/2329226404 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.305+0000 7fd8eb71d700 1 -- 172.21.15.155:0/2329226404 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1a0b0b60 con 0x557b1af25400 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.305+0000 7fd8eb71d700 1 --2- 172.21.15.155:0/2329226404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x557b1a4e20c0 tx=0x557b1a3cd680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5664bf528741143 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.305+0000 7fd8d26eb700 1 -- 172.21.15.155:0/2329226404 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a4f4000 con 0x557b1af25400 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.305+0000 7fd8d26eb700 1 -- 172.21.15.155:0/2329226404 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b1a4e8180 con 0x557b1af25400 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.305+0000 7fd8d26eb700 1 -- 172.21.15.155:0/2329226404 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a4f4160 con 0x557b1af25400 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.306+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2329226404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 msgr2=0x557b1a372680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.306+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/2329226404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x557b1a4e20c0 tx=0x557b1a3cd680 comp rx=0 tx=0).stop 2024-04-19T23:45:59.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.306+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2329226404 shutdown_connections 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.306+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/2329226404 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.306+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2329226404 >> 172.21.15.155:0/2329226404 conn(0x557b1af24800 msgr2=0x557b1a176000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.306+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2329226404 shutdown_connections 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.306+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2329226404 wait complete. 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.306+0000 7fd8edf74a80 1 Processor -- start 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.306+0000 7fd8edf74a80 1 -- start start 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.306+0000 7fd8edf74a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.306+0000 7fd8edf74a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b1a12a500 con 0x557b1af25400 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.307+0000 7fd8eb71d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.307+0000 7fd8eb71d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35418/0 (socket says 172.21.15.155:35418) 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.307+0000 7fd8eb71d700 1 -- 172.21.15.155:0/2941961890 learned_addr learned my addr 172.21.15.155:0/2941961890 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.307+0000 7fd8eb71d700 1 -- 172.21.15.155:0/2941961890 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b1a0b0d00 con 0x557b1af25400 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.307+0000 7fd8eb71d700 1 --2- 172.21.15.155:0/2941961890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x557b1a4e2300 tx=0x557b1a3cd7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.307+0000 7fd8d0ee8700 1 -- 172.21.15.155:0/2941961890 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a4f42c0 con 0x557b1af25400 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.307+0000 7fd8d0ee8700 1 -- 172.21.15.155:0/2941961890 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b1a4e8300 con 0x557b1af25400 2024-04-19T23:45:59.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.307+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2941961890 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b1a0b0340 con 0x557b1af25400 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.307+0000 7fd8d0ee8700 1 -- 172.21.15.155:0/2941961890 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557b1a4f4000 con 0x557b1af25400 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.307+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2941961890 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b1a0b0b60 con 0x557b1af25400 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.308+0000 7fd8d0ee8700 1 -- 172.21.15.155:0/2941961890 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557b1ae2bb80 con 0x557b1af25400 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.308+0000 7fd8d0ee8700 1 --2- 172.21.15.155:0/2941961890 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a576000 0x557b1a373700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.308+0000 7fd8d0ee8700 1 -- 172.21.15.155:0/2941961890 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x557b1a103500 con 0x557b1af25400 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.308+0000 7fd8edf74a80 5 note: GC not initialized 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.308+0000 7fd8ec71f700 1 --2- 172.21.15.155:0/2941961890 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a576000 0x557b1a373700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.309+0000 7fd8ec71f700 1 --2- 172.21.15.155:0/2941961890 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a576000 0x557b1a373700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x557b1a417aa0 tx=0x557b1a3cd4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.309+0000 7fd8ce6e3700 20 reqs_thread_entry: start 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.309+0000 7fd8edf74a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.309+0000 7fd8edf74a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.309+0000 7fd8cc6df700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:29 2024 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.310+0000 7fd8cbebd700 20 reqs_thread_entry: start 2024-04-19T23:45:59.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.310+0000 7fd8edf74a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:59.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.310+0000 7fd8edf74a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.310+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1af25c00 con 0x557b1a089800 2024-04-19T23:45:59.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.310+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~369 out=369b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 231+0+492 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.310+0000 7fd8edf74a80 20 rados_obj.operate() r=0 bl.length=369 2024-04-19T23:45:59.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.310+0000 7fd8edf74a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:59.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.310+0000 7fd8edf74a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:59.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.310+0000 7fd8edf74a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:59.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.310+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a576800 con 0x557b1a089800 2024-04-19T23:45:59.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.311+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v30'17 uv17 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.311+0000 7fd8edf74a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:59.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.311+0000 7fd8edf74a80 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:59.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.311+0000 7fd8edf74a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:45:59.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.311+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93987210635520 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a576c00 con 0x557b1a089800 2024-04-19T23:45:59.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.312+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 93987209121024 notify 128849018899 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x557b1a471d40 con 0x557b1a089800 2024-04-19T23:45:59.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.312+0000 7fd8e6713700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018899 cookie 93987209121024 notifier 4717 bl.length()=533 2024-04-19T23:45:59.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.312+0000 7fd8e6713700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-19T23:45:59.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.312+0000 7fd8e6713700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:59.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.312+0000 7fd8e6713700 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a5ea000 con 0x557b1a089800 2024-04-19T23:45:59.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.312+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(64 notify.4 [notify cookie 93987210635520 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.312+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.312+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 93987210635520 notify 128849018899 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557b1a471a00 con 0x557b1a089800 2024-04-19T23:45:59.316 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "foo", 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Foo", 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "foo@foo.com", 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:45:59.317 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:45:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:45:59.319 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:45:59.319 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:45:59.319 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:45:59.319 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:45:59.319 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:45:59.319 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:45:59.319 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:45:59.319 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:45:59.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.313+0000 7fd8d2eec700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:59.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.313+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93987210633216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a577000 con 0x557b1a089800 2024-04-19T23:45:59.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.314+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93987210633216] v30'191 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.314+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93987209116416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a577400 con 0x557b1a407400 2024-04-19T23:45:59.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.315+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93987209116416] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.315+0000 7fd8edf74a80 20 remove_watcher() i=0 2024-04-19T23:45:59.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.315+0000 7fd8edf74a80 2 removed watcher, disabling cache 2024-04-19T23:45:59.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.315+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93987209117568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a577800 con 0x557b1a089800 2024-04-19T23:45:59.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.316+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93987209117568] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.316+0000 7fd8edf74a80 20 remove_watcher() i=1 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.316+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93987209118720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a577c00 con 0x557b1a407000 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.317+0000 7fd8ebf1e700 1 -- 172.21.15.155:0/326570304 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93987209118720] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c7200 con 0x557b1a407000 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.317+0000 7fd8edf74a80 20 remove_watcher() i=2 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.317+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93987209119872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a5ea000 con 0x557b1a407400 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.318+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93987209119872] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c7440 con 0x557b1a407400 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.318+0000 7fd8edf74a80 20 remove_watcher() i=3 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.318+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93987209121024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a5ea800 con 0x557b1a089800 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.319+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93987209121024] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1a089800 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.319+0000 7fd8edf74a80 20 remove_watcher() i=4 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.319+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93987209122176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a5eac00 con 0x557b1af24000 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.320+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93987209122176] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.321+0000 7fd8edf74a80 20 remove_watcher() i=5 2024-04-19T23:45:59.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.321+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93987209123328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a5eb000 con 0x557b1af24000 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.322+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93987209123328] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.322+0000 7fd8edf74a80 20 remove_watcher() i=6 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.322+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93987209124480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557b1a5eb400 con 0x557b1af24000 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8ec71f700 1 -- 172.21.15.155:0/326570304 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93987209124480] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557b1a4c6b40 con 0x557b1af24000 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 20 remove_watcher() i=7 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557b1af24000 msgr2=0x557b1a373180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557b1af24000 0x557b1a373180 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557b1a089800 msgr2=0x557b1a371b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557b1a089800 0x557b1a371b80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557b1a407400 msgr2=0x557b1a372c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557b1a407400 0x557b1a372c00 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557b1a407000 msgr2=0x557b1a372100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557b1a407000 0x557b1a372100 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a406c00 msgr2=0x557b1a371600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a406c00 0x557b1a371600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x557b1ae58030 tx=0x557b1a3cd320 comp rx=0 tx=0).stop 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 msgr2=0x557b1a370b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/326570304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a089400 0x557b1a370b00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x557b1ae599b0 tx=0x557b1a1798c0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 reap_dead start 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8eb71d700 1 -- 172.21.15.155:0/326570304 reap_dead start 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 shutdown_connections 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 >> 172.21.15.155:0/326570304 conn(0x557b1a088c00 msgr2=0x557b1a175800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 shutdown_connections 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.323+0000 7fd8edf74a80 1 -- 172.21.15.155:0/326570304 wait complete. 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2941961890 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a576000 msgr2=0x557b1a373700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/2941961890 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a576000 0x557b1a373700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x557b1a417aa0 tx=0x557b1a3cd4a0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2941961890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 msgr2=0x557b1a372680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/2941961890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x557b1a4e2300 tx=0x557b1a3cd7a0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2941961890 shutdown_connections 2024-04-19T23:45:59.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/2941961890 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a576000 0x557b1a373700 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/2941961890 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1af25400 0x557b1a372680 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2941961890 >> 172.21.15.155:0/2941961890 conn(0x557b1af24800 msgr2=0x557b1a176000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2941961890 shutdown_connections 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/2941961890 wait complete. 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/698043573 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a406000 msgr2=0x557b1a371080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/698043573 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a406000 0x557b1a371080 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x557b1af14f90 tx=0x557b1a3cc540 comp rx=0 tx=0).stop 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/698043573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 msgr2=0x557b1a370580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/698043573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x557b1ae59ec0 tx=0x557b1a179980 comp rx=0 tx=0).stop 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/698043573 shutdown_connections 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/698043573 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557b1a406000 0x557b1a371080 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 --2- 172.21.15.155:0/698043573 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557b1a088800 0x557b1a370580 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/698043573 >> 172.21.15.155:0/698043573 conn(0x557b1a088400 msgr2=0x557b1a175000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/698043573 shutdown_connections 2024-04-19T23:45:59.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.324+0000 7fd8edf74a80 1 -- 172.21.15.155:0/698043573 wait complete. 2024-04-19T23:45:59.329 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:45:59.341 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:59.342 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-19T23:45:59.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-19T23:45:59.342 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-19T23:45:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:45:59.388 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.389+0000 7ff0e9b54a80 1 Processor -- start 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.390+0000 7ff0e9b54a80 1 -- start start 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.390+0000 7ff0e9b54a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55edc70cac00 0x55edc73b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.390+0000 7ff0e9b54a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55edc73f5500 con 0x55edc70ca800 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.390+0000 7ff0e9b54a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55edc716ca00 con 0x55edc70cac00 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.390+0000 7ff0e72fd700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55edc70cac00 0x55edc73b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.390+0000 7ff0e7afe700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55edc70ca800 0x55edc71b6800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:33584/0 (socket says 172.21.15.155:33584) 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.390+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2262889958 learned_addr learned my addr 172.21.15.155:0/2262889958 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.390+0000 7ff0e72fd700 1 -- 172.21.15.155:0/2262889958 >> v1:172.21.15.76:6789/0 conn(0x55edc70ca800 legacy=0x55edc71b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.390+0000 7ff0e72fd700 1 -- 172.21.15.155:0/2262889958 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edc70f3d40 con 0x55edc70cac00 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.391+0000 7ff0e72fd700 1 --2- 172.21.15.155:0/2262889958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cac00 0x55edc73b2580 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x55edc73ad890 tx=0x55edc71bb920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87a466ae563e659 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.391+0000 7ff0e6afc700 1 -- 172.21.15.155:0/2262889958 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc71834a0 con 0x55edc70cac00 2024-04-19T23:45:59.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.391+0000 7ff0e6afc700 1 -- 172.21.15.155:0/2262889958 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55edc73f5800 con 0x55edc70cac00 2024-04-19T23:45:59.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.391+0000 7ff0e6afc700 1 -- 172.21.15.155:0/2262889958 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc7183600 con 0x55edc70cac00 2024-04-19T23:45:59.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.391+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2262889958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cac00 msgr2=0x55edc73b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.391+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2262889958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cac00 0x55edc73b2580 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x55edc73ad890 tx=0x55edc71bb920 comp rx=0 tx=0).stop 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.391+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2262889958 shutdown_connections 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.391+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2262889958 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cac00 0x55edc73b2580 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.391+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2262889958 >> 172.21.15.155:0/2262889958 conn(0x55edc70ca400 msgr2=0x55edc71b6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.391+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2262889958 shutdown_connections 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.391+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2262889958 wait complete. 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.392+0000 7ff0e9b54a80 1 Processor -- start 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.392+0000 7ff0e9b54a80 1 -- start start 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.392+0000 7ff0e9b54a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.392+0000 7ff0e9b54a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edc716c500 con 0x55edc70ca800 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.392+0000 7ff0e7afe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.392+0000 7ff0e7afe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35426/0 (socket says 172.21.15.155:35426) 2024-04-19T23:45:59.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.393+0000 7ff0e7afe700 1 -- 172.21.15.155:0/537820083 learned_addr learned my addr 172.21.15.155:0/537820083 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.393+0000 7ff0e7afe700 1 -- 172.21.15.155:0/537820083 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edc70f3ba0 con 0x55edc70ca800 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.393+0000 7ff0e7afe700 1 --2- 172.21.15.155:0/537820083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55edc7e91980 tx=0x55edc71bbb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857f354f2f0f2a50 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.393+0000 7ff0e62fb700 1 -- 172.21.15.155:0/537820083 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc71834a0 con 0x55edc70ca800 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.393+0000 7ff0e62fb700 1 -- 172.21.15.155:0/537820083 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55edc73f5b00 con 0x55edc70ca800 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.393+0000 7ff0e62fb700 1 -- 172.21.15.155:0/537820083 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc7183600 con 0x55edc70ca800 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.393+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/537820083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 msgr2=0x55edc73b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.393+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/537820083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55edc7e91980 tx=0x55edc71bbb60 comp rx=0 tx=0).stop 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.393+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/537820083 shutdown_connections 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.393+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/537820083 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.393+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/537820083 >> 172.21.15.155:0/537820083 conn(0x55edc70ca400 msgr2=0x55edc71b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.394+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/537820083 shutdown_connections 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.394+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/537820083 wait complete. 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.394+0000 7ff0e9b54a80 1 Processor -- start 2024-04-19T23:45:59.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.394+0000 7ff0e9b54a80 1 -- start start 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.394+0000 7ff0e9b54a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.394+0000 7ff0e9b54a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edc716c3c0 con 0x55edc70ca800 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.394+0000 7ff0e7afe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.394+0000 7ff0e7afe700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35434/0 (socket says 172.21.15.155:35434) 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.394+0000 7ff0e7afe700 1 -- 172.21.15.155:0/3788364491 learned_addr learned my addr 172.21.15.155:0/3788364491 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.395+0000 7ff0e7afe700 1 -- 172.21.15.155:0/3788364491 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edc70f3a00 con 0x55edc70ca800 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.395+0000 7ff0e7afe700 1 --2- 172.21.15.155:0/3788364491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x55edc7e919e0 tx=0x55edc71bba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.395+0000 7ff0e4af8700 1 -- 172.21.15.155:0/3788364491 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc71838c0 con 0x55edc70ca800 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.395+0000 7ff0e4af8700 1 -- 172.21.15.155:0/3788364491 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55edc716bc80 con 0x55edc70ca800 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.395+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/3788364491 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55edc70f3860 con 0x55edc70ca800 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.395+0000 7ff0e4af8700 1 -- 172.21.15.155:0/3788364491 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc71834a0 con 0x55edc70ca800 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.395+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/3788364491 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edc70f36c0 con 0x55edc70ca800 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e9b54a80 1 Processor -- start 2024-04-19T23:45:59.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e9b54a80 1 -- start start 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e4af8700 1 -- 172.21.15.155:0/3788364491 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55edc7e6cb00 con 0x55edc70ca800 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e9b54a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 0x55edc73b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e9b54a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edc7106640 con 0x55edc70cb400 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e4af8700 1 --2- 172.21.15.155:0/3788364491 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc7452000 0x55edc73b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e82ff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 0x55edc73b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e4af8700 1 -- 172.21.15.155:0/3788364491 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55edc7145180 con 0x55edc70ca800 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e82ff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 0x55edc73b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35438/0 (socket says 172.21.15.155:35438) 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e82ff700 1 -- 172.21.15.155:0/1031217834 learned_addr learned my addr 172.21.15.155:0/1031217834 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e7afe700 1 --2- 172.21.15.155:0/3788364491 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc7452000 0x55edc73b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e82ff700 1 -- 172.21.15.155:0/1031217834 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edc70f2000 con 0x55edc70cb400 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e7afe700 1 --2- 172.21.15.155:0/3788364491 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc7452000 0x55edc73b3080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55edc7f48f90 tx=0x55edc741a240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.396+0000 7ff0e82ff700 1 --2- 172.21.15.155:0/1031217834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 0x55edc73b2b00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x55edc7e91b90 tx=0x55edc741a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db529a58aafc52d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e22f3700 1 -- 172.21.15.155:0/1031217834 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc71838c0 con 0x55edc70cb400 2024-04-19T23:45:59.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e22f3700 1 -- 172.21.15.155:0/1031217834 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55edc73f4300 con 0x55edc70cb400 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e22f3700 1 -- 172.21.15.155:0/1031217834 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc71834a0 con 0x55edc70cb400 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/1031217834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 msgr2=0x55edc73b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/1031217834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 0x55edc73b2b00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x55edc7e91b90 tx=0x55edc741a9c0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/1031217834 shutdown_connections 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/1031217834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 0x55edc73b2b00 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/1031217834 >> 172.21.15.155:0/1031217834 conn(0x55edc70cac00 msgr2=0x55edc71b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/1031217834 shutdown_connections 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/1031217834 wait complete. 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e9b54a80 1 Processor -- start 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.397+0000 7ff0e9b54a80 1 -- start start 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.398+0000 7ff0e9b54a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 0x55edc73b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.398+0000 7ff0e9b54a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edc71068c0 con 0x55edc70cb400 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.398+0000 7ff0e82ff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 0x55edc73b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.398+0000 7ff0e82ff700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 0x55edc73b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35442/0 (socket says 172.21.15.155:35442) 2024-04-19T23:45:59.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.398+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 learned_addr learned my addr 172.21.15.155:0/384834140 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.398+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edc70f2ea0 con 0x55edc70cb400 2024-04-19T23:45:59.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.398+0000 7ff0e82ff700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 0x55edc73b2b00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x55edc7f486c0 tx=0x55edc71bbf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.398+0000 7ff0e0af0700 1 -- 172.21.15.155:0/384834140 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc7183b80 con 0x55edc70cb400 2024-04-19T23:45:59.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.398+0000 7ff0e0af0700 1 -- 172.21.15.155:0/384834140 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55edc716bc80 con 0x55edc70cb400 2024-04-19T23:45:59.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.399+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55edc70f2820 con 0x55edc70cb400 2024-04-19T23:45:59.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.399+0000 7ff0e0af0700 1 -- 172.21.15.155:0/384834140 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc71838c0 con 0x55edc70cb400 2024-04-19T23:45:59.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.399+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edc70f29c0 con 0x55edc70cb400 2024-04-19T23:45:59.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.399+0000 7ff0e0af0700 1 -- 172.21.15.155:0/384834140 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55edc7e6cdc0 con 0x55edc70cb400 2024-04-19T23:45:59.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e0af0700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc7452c00 0x55edc73b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e0af0700 1 -- 172.21.15.155:0/384834140 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55edc7145340 con 0x55edc70cb400 2024-04-19T23:45:59.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e72fd700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc7452c00 0x55edc73b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55edc70cb800 0x55edc73b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc70cbc00 con 0x55edc70cb800 2024-04-19T23:45:59.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e82ff700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55edc70cb800 0x55edc73b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e72fd700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc7452c00 0x55edc73b3600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55edc73ad890 tx=0x55edc71bb800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e82ff700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55edc70cb800 0x55edc73b3b80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e9b54a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e9b54a80 20 realm 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.400+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453000 con 0x55edc70cb800 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453400 con 0x55edc70cb800 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453800 con 0x55edc70cb800 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453c00 con 0x55edc70cb800 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 20 searching for the correct realm 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55edc7453000 0x55edc73b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453400 con 0x55edc7453000 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.401+0000 7ff0e7afe700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55edc7453000 0x55edc73b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.402+0000 7ff0e7afe700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55edc7453000 0x55edc73b4100 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.402+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.402+0000 7ff0e7afe700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55edc7453400 0x55edc73b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.402+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512000 con 0x55edc7453400 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.402+0000 7ff0e72fd700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55edc7453400 0x55edc73b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.402+0000 7ff0e72fd700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55edc7453400 0x55edc73b4c00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.403+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.403+0000 7ff0e72fd700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55edc7512000 0x55edc73b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.403+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7512000 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.403+0000 7ff0e82ff700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55edc7512000 0x55edc73b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.403+0000 7ff0e82ff700 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55edc7512000 0x55edc73b5180 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.404+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.404+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc70cb800 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.404+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.404+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc70cb800 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.404+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.404+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7512000 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.404+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.404+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7512000 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.405+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.405+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453400 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.405+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.405+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453000 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.405+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.405+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc70cb800 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.405+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.405+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7512000 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.406+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.406+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc70cb800 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.406+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.406+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453400 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.406+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.406+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453000 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.406+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.406+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453000 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.406+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.407+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7512000 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.407+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.407+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453000 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.407+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.407+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453000 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.407+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.407+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc70cb800 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.408+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.408+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc70cb800 2024-04-19T23:45:59.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.408+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.408+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7512000 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.408+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.408+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453000 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.409+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.409+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453400 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.409+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.409+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc70cb800 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.409+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.409+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7512000 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.409+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.409+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453000 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.410+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.410+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7512000 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.410+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.410+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453400 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.410+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.410+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453000 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.410+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.410+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7512000 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc70cb800 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453400 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e9b54a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e9b54a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:45:59.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e9b54a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e9b54a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc70cbc00 con 0x55edc70cb800 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e9b54a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.411+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512c00 con 0x55edc70cb800 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513000 con 0x55edc7453400 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 20 zone default found 2024-04-19T23:45:59.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 4 Realm: () 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 20 zonegroup default 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513400 con 0x55edc7512000 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513800 con 0x55edc7453000 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.412+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513c00 con 0x55edc7453000 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.413+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.413+0000 7ff0e9b54a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.413+0000 7ff0e9b54a80 20 started sync module instance, tier type = 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.413+0000 7ff0e9b54a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.413+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512c00 con 0x55edc7453400 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.414+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(44 notify.0 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.414+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94479738116864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc70cbc00 con 0x55edc7453400 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.414+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453800 con 0x55edc70cb800 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.415+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94479738116864] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.415+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(46 notify.1 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.415+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94479738118016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453c00 con 0x55edc70cb800 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.415+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7453000 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.416+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.416+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94479738119168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513000 con 0x55edc7453000 2024-04-19T23:45:59.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.416+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512c00 con 0x55edc7453400 2024-04-19T23:45:59.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.417+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94479738118016] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.418+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94479738119168] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.419+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(50 notify.3 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.419+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94479738120320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512400 con 0x55edc7453400 2024-04-19T23:45:59.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.419+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513800 con 0x55edc70cb800 2024-04-19T23:45:59.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.420+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94479738120320] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.420+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(52 notify.4 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.420+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94479738121472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513c00 con 0x55edc70cb800 2024-04-19T23:45:59.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.420+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512800 con 0x55edc7512000 2024-04-19T23:45:59.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.421+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94479738121472] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.421+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(54 notify.5 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.421+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94479738122624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513400 con 0x55edc7512000 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.421+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513800 con 0x55edc7512000 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.422+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94479738122624] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.422+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(56 notify.6 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.422+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94479738123776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513c00 con 0x55edc7512000 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.422+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453800 con 0x55edc7512000 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.423+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94479738123776] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.423+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(58 notify.7 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.423+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94479738124928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453c00 con 0x55edc7512000 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.423+0000 7ff0e9b54a80 20 add_watcher() i=0 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.423+0000 7ff0e9b54a80 20 add_watcher() i=1 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.423+0000 7ff0e9b54a80 20 add_watcher() i=2 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.423+0000 7ff0e9b54a80 20 add_watcher() i=3 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.423+0000 7ff0e9b54a80 20 add_watcher() i=4 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.423+0000 7ff0e9b54a80 20 add_watcher() i=5 2024-04-19T23:45:59.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.423+0000 7ff0e9b54a80 20 add_watcher() i=6 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.424+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94479738124928] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.424+0000 7ff0e9b54a80 20 add_watcher() i=7 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.424+0000 7ff0e9b54a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.424+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453800 con 0x55edc70cb800 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.424+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.424+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94479739666432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453c00 con 0x55edc70cb800 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.425+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94479739666432] v30'192 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.426+0000 7ff0ceacc700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.426+0000 7ff0e9b54a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.426+0000 7ff0e9b54a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.426+0000 7ff0e9b54a80 1 Processor -- start 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.426+0000 7ff0e9b54a80 1 -- start start 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.426+0000 7ff0e9b54a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.426+0000 7ff0e9b54a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edc716c3c0 con 0x55edc7513400 2024-04-19T23:45:59.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.426+0000 7ff0e72fd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.426+0000 7ff0e72fd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35444/0 (socket says 172.21.15.155:35444) 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.426+0000 7ff0e72fd700 1 -- 172.21.15.155:0/1172312671 learned_addr learned my addr 172.21.15.155:0/1172312671 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.426+0000 7ff0e72fd700 1 -- 172.21.15.155:0/1172312671 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edc70f2b60 con 0x55edc7513400 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.427+0000 7ff0e72fd700 1 --2- 172.21.15.155:0/1172312671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55edc752c000 tx=0x55edc741b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2802d25302ac693 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.427+0000 7ff0ce2cb700 1 -- 172.21.15.155:0/1172312671 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc7183760 con 0x55edc7513400 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.427+0000 7ff0ce2cb700 1 -- 172.21.15.155:0/1172312671 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55edc753c000 con 0x55edc7513400 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.427+0000 7ff0ce2cb700 1 -- 172.21.15.155:0/1172312671 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc753e000 con 0x55edc7513400 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.427+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/1172312671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 msgr2=0x55edc73b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.427+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/1172312671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55edc752c000 tx=0x55edc741b6e0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/1172312671 shutdown_connections 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/1172312671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/1172312671 >> 172.21.15.155:0/1172312671 conn(0x55edc7512800 msgr2=0x55edc71b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/1172312671 shutdown_connections 2024-04-19T23:45:59.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/1172312671 wait complete. 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e9b54a80 1 Processor -- start 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e9b54a80 1 -- start start 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e9b54a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e9b54a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edc716c500 con 0x55edc7513400 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e72fd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e72fd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:35446/0 (socket says 172.21.15.155:35446) 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.428+0000 7ff0e72fd700 1 -- 172.21.15.155:0/2566323994 learned_addr learned my addr 172.21.15.155:0/2566323994 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.429+0000 7ff0e72fd700 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edc70f2d00 con 0x55edc7513400 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.429+0000 7ff0e72fd700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x55edc752c1e0 tx=0x55edc741b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.429+0000 7ff0ccac8700 1 -- 172.21.15.155:0/2566323994 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc753e160 con 0x55edc7513400 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.429+0000 7ff0ccac8700 1 -- 172.21.15.155:0/2566323994 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55edc753c180 con 0x55edc7513400 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.429+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55edc70f2340 con 0x55edc7513400 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.429+0000 7ff0ccac8700 1 -- 172.21.15.155:0/2566323994 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55edc753e2c0 con 0x55edc7513400 2024-04-19T23:45:59.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.429+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edc70f3d40 con 0x55edc7513400 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.430+0000 7ff0ccac8700 1 -- 172.21.15.155:0/2566323994 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55edc7e6db80 con 0x55edc7513400 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.430+0000 7ff0ccac8700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc75b6000 0x55edc73b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.430+0000 7ff0ccac8700 1 -- 172.21.15.155:0/2566323994 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5706+0+0 (secure 0 0 0) 0x55edc7145500 con 0x55edc7513400 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.430+0000 7ff0e82ff700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc75b6000 0x55edc73b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.430+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55edc7513800 0x55edc75ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.430+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513c00 con 0x55edc7513800 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.430+0000 7ff0e7afe700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55edc7513800 0x55edc75ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.430+0000 7ff0e82ff700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc75b6000 0x55edc73b5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55edc74b9c80 tx=0x55edc741b5c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.430+0000 7ff0e7afe700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55edc7513800 0x55edc75ce000 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.431+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc7513800 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.432+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55edc75b6400 0x55edc75ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.432+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b6800 con 0x55edc75b6400 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.432+0000 7ff0e72fd700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55edc75b6400 0x55edc75ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.432+0000 7ff0e72fd700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55edc75b6400 0x55edc75ce580 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.433+0000 7ff0e72fd700 1 -- 172.21.15.155:0/2566323994 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc75b6400 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.433+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55edc75b6c00 0x55edc75ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.433+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b7000 con 0x55edc75b6c00 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.433+0000 7ff0e82ff700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55edc75b6c00 0x55edc75ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.433+0000 7ff0e82ff700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55edc75b6c00 0x55edc75ceb00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.434+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.434+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b7400 con 0x55edc7513800 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.435+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'193 uv163 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc7513800 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.435+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55edc75b7800 0x55edc75cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.435+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b7c00 con 0x55edc75b7800 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.435+0000 7ff0e7afe700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55edc75b7800 0x55edc75cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:45:59.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.436+0000 7ff0e7afe700 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55edc75b7800 0x55edc75cf080 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:45:59.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.437+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'65 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc75b7800 2024-04-19T23:45:59.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.437+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75de000 con 0x55edc75b6c00 2024-04-19T23:45:59.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.437+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.438+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75de400 con 0x55edc7513800 2024-04-19T23:45:59.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.439+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc7513800 2024-04-19T23:45:59.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.439+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75de800 con 0x55edc75b6400 2024-04-19T23:45:59.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.440+0000 7ff0e72fd700 1 -- 172.21.15.155:0/2566323994 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc75b6400 2024-04-19T23:45:59.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.440+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75dec00 con 0x55edc75b7800 2024-04-19T23:45:59.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.441+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc75b7800 2024-04-19T23:45:59.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.441+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75df000 con 0x55edc75b6c00 2024-04-19T23:45:59.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.442+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.442+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75df400 con 0x55edc75b7800 2024-04-19T23:45:59.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.443+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'66 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc75b7800 2024-04-19T23:45:59.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.443+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75df800 con 0x55edc75b6400 2024-04-19T23:45:59.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.444+0000 7ff0e72fd700 1 -- 172.21.15.155:0/2566323994 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc75b6400 2024-04-19T23:45:59.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.444+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75dfc00 con 0x55edc75b7800 2024-04-19T23:45:59.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.445+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc75b7800 2024-04-19T23:45:59.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.445+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75de800 con 0x55edc75b6400 2024-04-19T23:45:59.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.446+0000 7ff0e72fd700 1 -- 172.21.15.155:0/2566323994 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'52 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc75b6400 2024-04-19T23:45:59.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.446+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75de400 con 0x55edc7513800 2024-04-19T23:45:59.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.447+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'194 uv165 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc7513800 2024-04-19T23:45:59.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.447+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b6800 con 0x55edc75b6c00 2024-04-19T23:45:59.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.448+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'64 uv50 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.448+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b7400 con 0x55edc75b7800 2024-04-19T23:45:59.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.449+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'67 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc75b7800 2024-04-19T23:45:59.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.449+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b7c00 con 0x55edc75b6c00 2024-04-19T23:45:59.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.450+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.450+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512c00 con 0x55edc7513800 2024-04-19T23:45:59.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.451+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc7513800 2024-04-19T23:45:59.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.451+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513000 con 0x55edc7513800 2024-04-19T23:45:59.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.452+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'195 uv167 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc7513800 2024-04-19T23:45:59.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.452+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7513c00 con 0x55edc75b6c00 2024-04-19T23:45:59.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.453+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'65 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.453+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc70cbc00 con 0x55edc75b7800 2024-04-19T23:45:59.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.454+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'35 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc75b7800 2024-04-19T23:45:59.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.454+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b7400 con 0x55edc75b6c00 2024-04-19T23:45:59.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.455+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.455+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b7000 con 0x55edc75b6c00 2024-04-19T23:45:59.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.456+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.456+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b6800 con 0x55edc75b6c00 2024-04-19T23:45:59.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.457+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'21 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.457+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b7c00 con 0x55edc75b6c00 2024-04-19T23:45:59.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.458+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.458+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75dec00 con 0x55edc75b6400 2024-04-19T23:45:59.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.459+0000 7ff0e72fd700 1 -- 172.21.15.155:0/2566323994 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc75b6400 2024-04-19T23:45:59.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.459+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75df400 con 0x55edc75b6c00 2024-04-19T23:45:59.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.460+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.460+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75dfc00 con 0x55edc75b6400 2024-04-19T23:45:59.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.461+0000 7ff0e72fd700 1 -- 172.21.15.155:0/2566323994 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc75b6400 2024-04-19T23:45:59.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.461+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75de400 con 0x55edc75b6c00 2024-04-19T23:45:59.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.462+0000 7ff0e82ff700 1 -- 172.21.15.155:0/2566323994 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'66 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc75b6c00 2024-04-19T23:45:59.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.462+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75de000 con 0x55edc75b6400 2024-04-19T23:45:59.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.463+0000 7ff0e72fd700 1 -- 172.21.15.155:0/2566323994 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'53 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc75b6400 2024-04-19T23:45:59.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.463+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75df000 con 0x55edc75b7800 2024-04-19T23:45:59.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.464+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc75b7800 2024-04-19T23:45:59.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.465+0000 7ff0ca2c3700 20 reqs_thread_entry: start 2024-04-19T23:45:59.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.465+0000 7ff0e9b54a80 20 init_complete bucket index max shards: 11 2024-04-19T23:45:59.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0e9b54a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:45:59.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0c82bf700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:46:29 2024 2024-04-19T23:45:59.465 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:45:59.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0c7a9d700 20 reqs_thread_entry: start 2024-04-19T23:45:59.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0e9b54a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:45:59.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0e9b54a80 20 rados->read ofs=0 len=0 2024-04-19T23:45:59.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453c00 con 0x55edc70cb800 2024-04-19T23:45:59.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0e9b54a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:45:59.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0e9b54a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:45:59.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0e9b54a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:45:59.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0e9b54a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:45:59.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.466+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7512c00 con 0x55edc7453400 2024-04-19T23:45:59.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.467+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv40 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.467 INFO:teuthology.orchestra.run.smithi155.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-19T23:45:59.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.467+0000 7ff0ceacc700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:45:59.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.467+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94479739666432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75df400 con 0x55edc70cb800 2024-04-19T23:45:59.467 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.468+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94479739666432] v30'196 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.468+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94479738116864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75de400 con 0x55edc7453400 2024-04-19T23:45:59.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.469+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94479738116864] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.469+0000 7ff0e9b54a80 20 remove_watcher() i=0 2024-04-19T23:45:59.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.469+0000 7ff0e9b54a80 2 removed watcher, disabling cache 2024-04-19T23:45:59.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.469+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94479738118016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75df800 con 0x55edc70cb800 2024-04-19T23:45:59.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.471+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94479738118016] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.471+0000 7ff0e9b54a80 20 remove_watcher() i=1 2024-04-19T23:45:59.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.471+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94479738119168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75de800 con 0x55edc7453000 2024-04-19T23:45:59.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.472+0000 7ff0e7afe700 1 -- 172.21.15.155:0/384834140 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94479738119168] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7507200 con 0x55edc7453000 2024-04-19T23:45:59.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.472+0000 7ff0e9b54a80 20 remove_watcher() i=2 2024-04-19T23:45:59.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.472+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94479738120320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75dec00 con 0x55edc7453400 2024-04-19T23:45:59.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.473+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94479738120320] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7507440 con 0x55edc7453400 2024-04-19T23:45:59.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.473+0000 7ff0e9b54a80 20 remove_watcher() i=3 2024-04-19T23:45:59.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.473+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94479738121472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75dfc00 con 0x55edc70cb800 2024-04-19T23:45:59.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.474+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94479738121472] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc70cb800 2024-04-19T23:45:59.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.474+0000 7ff0e9b54a80 20 remove_watcher() i=4 2024-04-19T23:45:59.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.474+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94479738122624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75de000 con 0x55edc7512000 2024-04-19T23:45:59.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.475+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94479738122624] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.475+0000 7ff0e9b54a80 20 remove_watcher() i=5 2024-04-19T23:45:59.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.475+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94479738123776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc7453c00 con 0x55edc7512000 2024-04-19T23:45:59.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.476+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94479738123776] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.476+0000 7ff0e9b54a80 20 remove_watcher() i=6 2024-04-19T23:45:59.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.476+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94479738124928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55edc75b7400 con 0x55edc7512000 2024-04-19T23:45:59.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e82ff700 1 -- 172.21.15.155:0/384834140 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94479738124928] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55edc7506b40 con 0x55edc7512000 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 20 remove_watcher() i=7 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55edc7512000 msgr2=0x55edc73b5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55edc7512000 0x55edc73b5180 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55edc70cb800 msgr2=0x55edc73b3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55edc70cb800 0x55edc73b3b80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55edc7453400 msgr2=0x55edc73b4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55edc7453400 0x55edc73b4c00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55edc7453000 msgr2=0x55edc73b4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55edc7453000 0x55edc73b4100 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc7452c00 msgr2=0x55edc73b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc7452c00 0x55edc73b3600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55edc73ad890 tx=0x55edc71bb800 comp rx=0 tx=0).stop 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 msgr2=0x55edc73b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/384834140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70cb400 0x55edc73b2b00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x55edc7f486c0 tx=0x55edc71bbf20 comp rx=0 tx=0).stop 2024-04-19T23:45:59.479 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.477+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 reap_dead start 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e72fd700 1 -- 172.21.15.155:0/384834140 reap_dead start 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 shutdown_connections 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 >> 172.21.15.155:0/384834140 conn(0x55edc70cac00 msgr2=0x55edc71b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 shutdown_connections 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/384834140 wait complete. 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55edc75b6400 msgr2=0x55edc75ce580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55edc75b6400 0x55edc75ce580 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55edc7513800 msgr2=0x55edc75ce000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55edc7513800 0x55edc75ce000 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55edc75b7800 msgr2=0x55edc75cf080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55edc75b7800 0x55edc75cf080 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55edc75b6c00 msgr2=0x55edc75ceb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55edc75b6c00 0x55edc75ceb00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc75b6000 msgr2=0x55edc73b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc75b6000 0x55edc73b5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55edc74b9c80 tx=0x55edc741b5c0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 msgr2=0x55edc73b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x55edc752c1e0 tx=0x55edc741b800 comp rx=0 tx=0).stop 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e7afe700 1 -- 172.21.15.155:0/2566323994 reap_dead start 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 shutdown_connections 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/2566323994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc7513400 0x55edc73b4680 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 >> 172.21.15.155:0/2566323994 conn(0x55edc7512800 msgr2=0x55edc71b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 shutdown_connections 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/2566323994 wait complete. 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/3788364491 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc7452000 msgr2=0x55edc73b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/3788364491 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc7452000 0x55edc73b3080 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55edc7f48f90 tx=0x55edc741a240 comp rx=0 tx=0).stop 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/3788364491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 msgr2=0x55edc73b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.478+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/3788364491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x55edc7e919e0 tx=0x55edc71bba40 comp rx=0 tx=0).stop 2024-04-19T23:45:59.481 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.479+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/3788364491 shutdown_connections 2024-04-19T23:45:59.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.479+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/3788364491 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55edc7452000 0x55edc73b3080 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.479+0000 7ff0e9b54a80 1 --2- 172.21.15.155:0/3788364491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55edc70ca800 0x55edc73b2580 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:45:59.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.479+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/3788364491 >> 172.21.15.155:0/3788364491 conn(0x55edc70ca400 msgr2=0x55edc71b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:45:59.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.479+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/3788364491 shutdown_connections 2024-04-19T23:45:59.482 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:45:59.479+0000 7ff0e9b54a80 1 -- 172.21.15.155:0/3788364491 wait complete. 2024-04-19T23:45:59.482 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-19T23:45:59.486 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:45:59.491 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-19T23:46:34.492 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-04-19T23:46:34.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-04-19T23:46:34.493 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-04-19T23:46:34.546 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:34.547 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:34.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.547+0000 7fc13ed69a80 1 Processor -- start 2024-04-19T23:46:34.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.547+0000 7fc13ed69a80 1 -- start start 2024-04-19T23:46:34.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.547+0000 7fc13ed69a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55d95a8e8c00 0x55d95abd0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.547+0000 7fc13ed69a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d95ac13500 con 0x55d95a8e8800 2024-04-19T23:46:34.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.547+0000 7fc13ed69a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d95a98aa00 con 0x55d95a8e8c00 2024-04-19T23:46:34.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.547+0000 7fc13c512700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55d95a8e8c00 0x55d95abd0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.547+0000 7fc13cd13700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55d95a8e8800 0x55d95a9d4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55644/0 (socket says 172.21.15.155:55644) 2024-04-19T23:46:34.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.547+0000 7fc13cd13700 1 -- 172.21.15.155:0/3761418697 learned_addr learned my addr 172.21.15.155:0/3761418697 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:34.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.548+0000 7fc13bd11700 1 -- 172.21.15.155:0/3761418697 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903664057 0 0) 0x55d95b6b6000 con 0x55d95a8e8800 2024-04-19T23:46:34.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.548+0000 7fc13bd11700 1 -- 172.21.15.155:0/3761418697 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55d95ac13680 con 0x55d95a8e8800 2024-04-19T23:46:34.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.548+0000 7fc13c512700 1 -- 172.21.15.155:0/3761418697 >> v1:172.21.15.76:6789/0 conn(0x55d95a8e8800 legacy=0x55d95a9d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.548+0000 7fc13c512700 1 -- 172.21.15.155:0/3761418697 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d95a911d40 con 0x55d95a8e8c00 2024-04-19T23:46:34.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.548+0000 7fc13c512700 1 --2- 172.21.15.155:0/3761418697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8c00 0x55d95abd0580 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x55d95abcb890 tx=0x55d95a9d9980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc994a5cf5865bd server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.548+0000 7fc13bd11700 1 -- 172.21.15.155:0/3761418697 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95a9a14a0 con 0x55d95a8e8c00 2024-04-19T23:46:34.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.548+0000 7fc13bd11700 1 -- 172.21.15.155:0/3761418697 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d95ac13680 con 0x55d95a8e8c00 2024-04-19T23:46:34.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.548+0000 7fc13bd11700 1 -- 172.21.15.155:0/3761418697 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95a9a1600 con 0x55d95a8e8c00 2024-04-19T23:46:34.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.549+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3761418697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8c00 msgr2=0x55d95abd0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.549+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/3761418697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8c00 0x55d95abd0580 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x55d95abcb890 tx=0x55d95a9d9980 comp rx=0 tx=0).stop 2024-04-19T23:46:34.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.549+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3761418697 shutdown_connections 2024-04-19T23:46:34.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.549+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/3761418697 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8c00 0x55d95abd0580 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.549+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3761418697 >> 172.21.15.155:0/3761418697 conn(0x55d95a8e8400 msgr2=0x55d95a9d4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.549+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3761418697 shutdown_connections 2024-04-19T23:46:34.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.549+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3761418697 wait complete. 2024-04-19T23:46:34.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.550+0000 7fc13ed69a80 1 Processor -- start 2024-04-19T23:46:34.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.550+0000 7fc13ed69a80 1 -- start start 2024-04-19T23:46:34.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.550+0000 7fc13ed69a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.550+0000 7fc13ed69a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d95a98a500 con 0x55d95a8e8800 2024-04-19T23:46:34.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.550+0000 7fc13cd13700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.550+0000 7fc13cd13700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40456/0 (socket says 172.21.15.155:40456) 2024-04-19T23:46:34.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.550+0000 7fc13cd13700 1 -- 172.21.15.155:0/837181900 learned_addr learned my addr 172.21.15.155:0/837181900 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.550+0000 7fc13cd13700 1 -- 172.21.15.155:0/837181900 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d95a911ba0 con 0x55d95a8e8800 2024-04-19T23:46:34.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.551+0000 7fc13cd13700 1 --2- 172.21.15.155:0/837181900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x55d95b6b9770 tx=0x55d95a9d9b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b205451c281f84 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.551+0000 7fc13b510700 1 -- 172.21.15.155:0/837181900 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95a9a11e0 con 0x55d95a8e8800 2024-04-19T23:46:34.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.551+0000 7fc13b510700 1 -- 172.21.15.155:0/837181900 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d95ac13b00 con 0x55d95a8e8800 2024-04-19T23:46:34.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.551+0000 7fc13b510700 1 -- 172.21.15.155:0/837181900 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95a9a14a0 con 0x55d95a8e8800 2024-04-19T23:46:34.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.551+0000 7fc13ed69a80 1 -- 172.21.15.155:0/837181900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 msgr2=0x55d95abd0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.551+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/837181900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x55d95b6b9770 tx=0x55d95a9d9b60 comp rx=0 tx=0).stop 2024-04-19T23:46:34.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.551+0000 7fc13ed69a80 1 -- 172.21.15.155:0/837181900 shutdown_connections 2024-04-19T23:46:34.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.551+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/837181900 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.551+0000 7fc13ed69a80 1 -- 172.21.15.155:0/837181900 >> 172.21.15.155:0/837181900 conn(0x55d95a8e8400 msgr2=0x55d95a9d5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.551+0000 7fc13ed69a80 1 -- 172.21.15.155:0/837181900 shutdown_connections 2024-04-19T23:46:34.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.551+0000 7fc13ed69a80 1 -- 172.21.15.155:0/837181900 wait complete. 2024-04-19T23:46:34.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.552+0000 7fc13ed69a80 1 Processor -- start 2024-04-19T23:46:34.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.552+0000 7fc13ed69a80 1 -- start start 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.552+0000 7fc13ed69a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.552+0000 7fc13ed69a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d95a98a3c0 con 0x55d95a8e8800 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.552+0000 7fc13cd13700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.552+0000 7fc13cd13700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40462/0 (socket says 172.21.15.155:40462) 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.552+0000 7fc13cd13700 1 -- 172.21.15.155:0/1322269225 learned_addr learned my addr 172.21.15.155:0/1322269225 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.553+0000 7fc13cd13700 1 -- 172.21.15.155:0/1322269225 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d95a911a00 con 0x55d95a8e8800 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.553+0000 7fc13cd13700 1 --2- 172.21.15.155:0/1322269225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x55d95b6b9e30 tx=0x55d95a9d9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.553+0000 7fc139d0d700 1 -- 172.21.15.155:0/1322269225 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95a9a1600 con 0x55d95a8e8800 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.553+0000 7fc139d0d700 1 -- 172.21.15.155:0/1322269225 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d95a989c80 con 0x55d95a8e8800 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.553+0000 7fc139d0d700 1 -- 172.21.15.155:0/1322269225 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95a9a11e0 con 0x55d95a8e8800 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.553+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1322269225 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d95a911860 con 0x55d95a8e8800 2024-04-19T23:46:34.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.553+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1322269225 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d95a9116c0 con 0x55d95a8e8800 2024-04-19T23:46:34.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.554+0000 7fc13ed69a80 1 Processor -- start 2024-04-19T23:46:34.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.554+0000 7fc13ed69a80 1 -- start start 2024-04-19T23:46:34.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.554+0000 7fc139d0d700 1 -- 172.21.15.155:0/1322269225 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d95b68ab00 con 0x55d95a8e8800 2024-04-19T23:46:34.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.554+0000 7fc13ed69a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.554+0000 7fc13ed69a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d95a98a000 con 0x55d95a8e9400 2024-04-19T23:46:34.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.554+0000 7fc139d0d700 1 --2- 172.21.15.155:0/1322269225 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95ac6a000 0x55d95abd1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.554+0000 7fc139d0d700 1 -- 172.21.15.155:0/1322269225 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d95a963180 con 0x55d95a8e8800 2024-04-19T23:46:34.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.554+0000 7fc13d514700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.554+0000 7fc13d514700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40466/0 (socket says 172.21.15.155:40466) 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.554+0000 7fc13d514700 1 -- 172.21.15.155:0/14335049 learned_addr learned my addr 172.21.15.155:0/14335049 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.554+0000 7fc13cd13700 1 --2- 172.21.15.155:0/1322269225 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95ac6a000 0x55d95abd1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.555+0000 7fc13d514700 1 -- 172.21.15.155:0/14335049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d95a910000 con 0x55d95a8e9400 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.555+0000 7fc13cd13700 1 --2- 172.21.15.155:0/1322269225 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95ac6a000 0x55d95abd1080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55d95b776f00 tx=0x55d95ac34240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.555+0000 7fc13d514700 1 --2- 172.21.15.155:0/14335049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x55d95b776e10 tx=0x55d95ac34a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7a643c1aaf12a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.555+0000 7fc137508700 1 -- 172.21.15.155:0/14335049 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95a9a1600 con 0x55d95a8e9400 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.555+0000 7fc137508700 1 -- 172.21.15.155:0/14335049 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d95ac12480 con 0x55d95a8e9400 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.555+0000 7fc137508700 1 -- 172.21.15.155:0/14335049 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95a9a11e0 con 0x55d95a8e9400 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.555+0000 7fc13ed69a80 1 -- 172.21.15.155:0/14335049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 msgr2=0x55d95abd0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.555+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/14335049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x55d95b776e10 tx=0x55d95ac34a20 comp rx=0 tx=0).stop 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.555+0000 7fc13ed69a80 1 -- 172.21.15.155:0/14335049 shutdown_connections 2024-04-19T23:46:34.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.556+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/14335049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.556+0000 7fc13ed69a80 1 -- 172.21.15.155:0/14335049 >> 172.21.15.155:0/14335049 conn(0x55d95a8e8c00 msgr2=0x55d95a9d5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.556+0000 7fc13ed69a80 1 -- 172.21.15.155:0/14335049 shutdown_connections 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.556+0000 7fc13ed69a80 1 -- 172.21.15.155:0/14335049 wait complete. 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.556+0000 7fc13ed69a80 1 Processor -- start 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.556+0000 7fc13ed69a80 1 -- start start 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.556+0000 7fc13ed69a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.556+0000 7fc13ed69a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d95a924640 con 0x55d95a8e9400 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.556+0000 7fc13d514700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.556+0000 7fc13d514700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40470/0 (socket says 172.21.15.155:40470) 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.556+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 learned_addr learned my addr 172.21.15.155:0/3259619679 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.557+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d95a910ea0 con 0x55d95a8e9400 2024-04-19T23:46:34.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.557+0000 7fc13d514700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55d95b6b9f50 tx=0x55d95a9d9f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.557+0000 7fc135d05700 1 -- 172.21.15.155:0/3259619679 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95a9a1a20 con 0x55d95a8e9400 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.557+0000 7fc135d05700 1 -- 172.21.15.155:0/3259619679 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d95ac12180 con 0x55d95a8e9400 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.557+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d95a910820 con 0x55d95a8e9400 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.557+0000 7fc135d05700 1 -- 172.21.15.155:0/3259619679 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95a9a1600 con 0x55d95a8e9400 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.557+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d95a9109c0 con 0x55d95a8e9400 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.558+0000 7fc135d05700 1 -- 172.21.15.155:0/3259619679 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d95b68adc0 con 0x55d95a8e9400 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.558+0000 7fc135d05700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95ac6ac00 0x55d95abd1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.558+0000 7fc135d05700 1 -- 172.21.15.155:0/3259619679 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d95a963340 con 0x55d95a8e9400 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.558+0000 7fc13ed69a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.558+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d95a8e9800 0x55d95abd1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.558+0000 7fc13c512700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95ac6ac00 0x55d95abd1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.558+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95a8e9c00 con 0x55d95a8e9800 2024-04-19T23:46:34.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.558+0000 7fc13d514700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d95a8e9800 0x55d95abd1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13c512700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95ac6ac00 0x55d95abd1600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55d95abcb890 tx=0x55d95a9d9800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13d514700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d95a8e9800 0x55d95abd1b80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13ed69a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13ed69a80 20 realm 2024-04-19T23:46:34.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13ed69a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6b000 con 0x55d95a8e9800 2024-04-19T23:46:34.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13ed69a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13ed69a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13ed69a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6b400 con 0x55d95a8e9800 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13ed69a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13ed69a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.559+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6b800 con 0x55d95a8e9800 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.560+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.560+0000 7fc13ed69a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.560+0000 7fc13ed69a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.560+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6bc00 con 0x55d95a8e9800 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.560+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.560+0000 7fc13ed69a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.560+0000 7fc13ed69a80 20 searching for the correct realm 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.560+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d95ac6b000 0x55d95abd2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.560+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6b400 con 0x55d95ac6b000 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.560+0000 7fc13cd13700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d95ac6b000 0x55d95abd2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.561+0000 7fc13cd13700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d95ac6b000 0x55d95abd2100 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.561+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.561+0000 7fc13cd13700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d95ac6b400 0x55d95abd2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.561+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30000 con 0x55d95ac6b400 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.561+0000 7fc13c512700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d95ac6b400 0x55d95abd2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.561+0000 7fc13c512700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d95ac6b400 0x55d95abd2c00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.562+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.562+0000 7fc13c512700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d95ad30000 0x55d95abd3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.562+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ad30000 2024-04-19T23:46:34.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.562+0000 7fc13d514700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d95ad30000 0x55d95abd3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.562+0000 7fc13d514700 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d95ad30000 0x55d95abd3180 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.563+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.563+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95a8e9800 2024-04-19T23:46:34.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.563+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.563+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95a8e9800 2024-04-19T23:46:34.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.563+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.563+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95a8e9800 2024-04-19T23:46:34.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.563+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.585 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.563+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ad30000 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.564+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.564+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b400 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.564+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.564+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b000 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.564+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.564+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95a8e9800 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.564+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.564+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ad30000 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.565+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.565+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95a8e9800 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.565+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.565+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b400 2024-04-19T23:46:34.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.565+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.565+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b000 2024-04-19T23:46:34.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.566+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.566+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b000 2024-04-19T23:46:34.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.566+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.566+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b400 2024-04-19T23:46:34.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.566+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.566+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b000 2024-04-19T23:46:34.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.566+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.566+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b000 2024-04-19T23:46:34.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.567+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.567+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95a8e9800 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.567+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.567+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95a8e9800 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.567+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.567+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ad30000 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.568+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.568+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b000 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.568+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.568+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b400 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.568+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.568+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95a8e9800 2024-04-19T23:46:34.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.568+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.568+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ad30000 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.569+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.569+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b000 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.569+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.569+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ad30000 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.569+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.569+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b400 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.569+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.569+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b000 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.570+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.570+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ad30000 2024-04-19T23:46:34.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.570+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.570+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95a8e9800 2024-04-19T23:46:34.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.570+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.570+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b400 2024-04-19T23:46:34.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:34.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:34.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:34.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:34.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95a8e9c00 con 0x55d95a8e9800 2024-04-19T23:46:34.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30c00 con 0x55d95a8e9800 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.571+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31000 con 0x55d95ac6b400 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 20 zone default found 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 4 Realm: () 2024-04-19T23:46:34.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:34.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:34.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:34.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 20 zonegroup default 2024-04-19T23:46:34.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31400 con 0x55d95ad30000 2024-04-19T23:46:34.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31800 con 0x55d95ac6b000 2024-04-19T23:46:34.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.572+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31c00 con 0x55d95ac6b000 2024-04-19T23:46:34.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.573+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.573+0000 7fc13ed69a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.573+0000 7fc13ed69a80 20 started sync module instance, tier type = 2024-04-19T23:46:34.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.573+0000 7fc13ed69a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:34.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.573+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30c00 con 0x55d95ac6b400 2024-04-19T23:46:34.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.574+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.574+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94392018565888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95a8e9c00 con 0x55d95ac6b400 2024-04-19T23:46:34.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.574+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6b800 con 0x55d95a8e9800 2024-04-19T23:46:34.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.575+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94392018565888] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.575+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.575+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94392018567040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6bc00 con 0x55d95a8e9800 2024-04-19T23:46:34.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.575+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ac6b000 2024-04-19T23:46:34.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.577+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94392018567040] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.577+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.577+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94392018568192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31000 con 0x55d95ac6b000 2024-04-19T23:46:34.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.577+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30c00 con 0x55d95ac6b400 2024-04-19T23:46:34.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.578+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.578+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94392018569344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30400 con 0x55d95ac6b400 2024-04-19T23:46:34.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.578+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31800 con 0x55d95a8e9800 2024-04-19T23:46:34.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.578+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94392018568192] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.580+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.580+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94392018570496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31c00 con 0x55d95a8e9800 2024-04-19T23:46:34.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.580+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30800 con 0x55d95ad30000 2024-04-19T23:46:34.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.580+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94392018569344] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.581+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94392018570496] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.581+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.581+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94392018571648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31400 con 0x55d95ad30000 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.582+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31800 con 0x55d95ad30000 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.583+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94392018571648] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.583+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.583+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94392018572800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31c00 con 0x55d95ad30000 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.583+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6b800 con 0x55d95ad30000 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.584+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94392018572800] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.584+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.584+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94392018573952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6bc00 con 0x55d95ad30000 2024-04-19T23:46:34.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.584+0000 7fc13ed69a80 20 add_watcher() i=0 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.584+0000 7fc13ed69a80 20 add_watcher() i=1 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.584+0000 7fc13ed69a80 20 add_watcher() i=2 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.584+0000 7fc13ed69a80 20 add_watcher() i=3 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.584+0000 7fc13ed69a80 20 add_watcher() i=4 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.584+0000 7fc13ed69a80 20 add_watcher() i=5 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.584+0000 7fc13ed69a80 20 add_watcher() i=6 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.585+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94392018573952] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.585+0000 7fc13ed69a80 20 add_watcher() i=7 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.585+0000 7fc13ed69a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.585+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6b800 con 0x55d95a8e9800 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.585+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.585+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94392020107264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6bc00 con 0x55d95a8e9800 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.587+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94392020107264] v32'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.587+0000 7fc123ce1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.587+0000 7fc13ed69a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.587+0000 7fc13ed69a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.587+0000 7fc13ed69a80 1 Processor -- start 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.587+0000 7fc13ed69a80 1 -- start start 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.587+0000 7fc13ed69a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.587+0000 7fc13ed69a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d95a924780 con 0x55d95ad31400 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.587+0000 7fc13c512700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.587+0000 7fc13c512700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40476/0 (socket says 172.21.15.155:40476) 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.587+0000 7fc13c512700 1 -- 172.21.15.155:0/1491171047 learned_addr learned my addr 172.21.15.155:0/1491171047 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.588+0000 7fc13c512700 1 -- 172.21.15.155:0/1491171047 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d95a910b60 con 0x55d95ad31400 2024-04-19T23:46:34.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.588+0000 7fc13c512700 1 --2- 172.21.15.155:0/1491171047 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55d95ac7f440 tx=0x55d95ac35da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9aac6fdaf349d20 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.588+0000 7fc1234e0700 1 -- 172.21.15.155:0/1491171047 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95a9a1760 con 0x55d95ad31400 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.588+0000 7fc1234e0700 1 -- 172.21.15.155:0/1491171047 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d95ad58000 con 0x55d95ad31400 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.588+0000 7fc1234e0700 1 -- 172.21.15.155:0/1491171047 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95ad5a000 con 0x55d95ad31400 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.589+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1491171047 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 msgr2=0x55d95abd2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.589+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/1491171047 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55d95ac7f440 tx=0x55d95ac35da0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.589+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1491171047 shutdown_connections 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.589+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/1491171047 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.589+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1491171047 >> 172.21.15.155:0/1491171047 conn(0x55d95ad30800 msgr2=0x55d95a9d6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.589+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1491171047 shutdown_connections 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.589+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1491171047 wait complete. 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.589+0000 7fc13ed69a80 1 Processor -- start 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.589+0000 7fc13ed69a80 1 -- start start 2024-04-19T23:46:34.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.589+0000 7fc13ed69a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.589+0000 7fc13ed69a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d95a98a000 con 0x55d95ad31400 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.590+0000 7fc13c512700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.590+0000 7fc13c512700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40492/0 (socket says 172.21.15.155:40492) 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.590+0000 7fc13c512700 1 -- 172.21.15.155:0/1333373107 learned_addr learned my addr 172.21.15.155:0/1333373107 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.590+0000 7fc13c512700 1 -- 172.21.15.155:0/1333373107 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d95a910d00 con 0x55d95ad31400 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.590+0000 7fc13c512700 1 --2- 172.21.15.155:0/1333373107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55d95ad45200 tx=0x55d95a9d99e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.590+0000 7fc121cdd700 1 -- 172.21.15.155:0/1333373107 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95ad5a160 con 0x55d95ad31400 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.590+0000 7fc121cdd700 1 -- 172.21.15.155:0/1333373107 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d95ad58180 con 0x55d95ad31400 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.590+0000 7fc121cdd700 1 -- 172.21.15.155:0/1333373107 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d95ad5a2c0 con 0x55d95ad31400 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.590+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1333373107 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d95a910340 con 0x55d95ad31400 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.590+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1333373107 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d95a911d40 con 0x55d95ad31400 2024-04-19T23:46:34.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.591+0000 7fc121cdd700 1 -- 172.21.15.155:0/1333373107 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d95b68bb80 con 0x55d95ad31400 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.591+0000 7fc121cdd700 1 --2- 172.21.15.155:0/1333373107 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95add4000 0x55d95abd3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.591+0000 7fc121cdd700 1 -- 172.21.15.155:0/1333373107 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d95a963500 con 0x55d95ad31400 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.591+0000 7fc13ed69a80 5 note: GC not initialized 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.591+0000 7fc13d514700 1 --2- 172.21.15.155:0/1333373107 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95add4000 0x55d95abd3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.592+0000 7fc13d514700 1 --2- 172.21.15.155:0/1333373107 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95add4000 0x55d95abd3700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55d95accdf50 tx=0x55d95ac35bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.592+0000 7fc11f4d8700 20 reqs_thread_entry: start 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.592+0000 7fc13ed69a80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.592+0000 7fc13ed69a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.593+0000 7fc11d4d4700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:04 2024 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.593+0000 7fc11ccb2700 20 reqs_thread_entry: start 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.593+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31c00 con 0x55d95a8e9800 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.593+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.593+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add4400 con 0x55d95ac6b400 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.593+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.593+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add4800 con 0x55d95a8e9800 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.593+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.594+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add4c00 con 0x55d95ac6b000 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.594+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.594+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5000 con 0x55d95ac6b000 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.594+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.594+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5400 con 0x55d95ac6b000 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.594+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.594+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5800 con 0x55d95a8e9800 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.594+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.595+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5c00 con 0x55d95a8e9800 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.595+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.595+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ae40000 con 0x55d95ac6b000 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.595+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.595+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ae40400 con 0x55d95ac6b000 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.595+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.595+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ae40800 con 0x55d95ad30000 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.596+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.596+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ae40c00 con 0x55d95a8e9800 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.596+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.596+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ae41000 con 0x55d95ac6b400 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.596+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.596+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ae41400 con 0x55d95ac6b000 2024-04-19T23:46:34.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.597+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.597+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ae41800 con 0x55d95ad30000 2024-04-19T23:46:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.597+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.597+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ae41c00 con 0x55d95ad30000 2024-04-19T23:46:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.597+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.597+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ae41000 con 0x55d95ac6b000 2024-04-19T23:46:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.598+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.598+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add4400 con 0x55d95ad30000 2024-04-19T23:46:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.598+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.598+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add4800 con 0x55d95a8e9800 2024-04-19T23:46:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.598+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.598+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5800 con 0x55d95ac6b000 2024-04-19T23:46:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.598+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.598+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5c00 con 0x55d95ad30000 2024-04-19T23:46:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.599+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.599+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add4c00 con 0x55d95ac6b400 2024-04-19T23:46:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.599+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.599+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5000 con 0x55d95ad30000 2024-04-19T23:46:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.599+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.599+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5400 con 0x55d95a8e9800 2024-04-19T23:46:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.599+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.599+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad30c00 con 0x55d95a8e9800 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.600+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.600+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31c00 con 0x55d95ac6b000 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.600+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.600+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31000 con 0x55d95a8e9800 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.600+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.600+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6b800 con 0x55d95a8e9800 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.600+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.600+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6bc00 con 0x55d95ac6b000 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.601+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.601+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95a8e9c00 con 0x55d95ac6b000 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.601+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.601+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5800 con 0x55d95ac6b000 2024-04-19T23:46:34.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.601+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.601+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add4400 con 0x55d95ad30000 2024-04-19T23:46:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.601+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.602+0000 7fc123ce1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.602+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94392020107264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add4800 con 0x55d95a8e9800 2024-04-19T23:46:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.603+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94392020107264] v32'198 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.603+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94392018565888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5c00 con 0x55d95ac6b400 2024-04-19T23:46:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.604+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94392018565888] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.604+0000 7fc13ed69a80 20 remove_watcher() i=0 2024-04-19T23:46:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.604+0000 7fc13ed69a80 2 removed watcher, disabling cache 2024-04-19T23:46:34.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.604+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94392018567040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5000 con 0x55d95a8e9800 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.606+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94392018567040] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.606+0000 7fc13ed69a80 20 remove_watcher() i=1 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.606+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94392018568192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95add5400 con 0x55d95ac6b000 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.607+0000 7fc13cd13700 1 -- 172.21.15.155:0/3259619679 <== osd.3 v2:172.21.15.155:6808/41835 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94392018568192] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21200 con 0x55d95ac6b000 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.607+0000 7fc13ed69a80 20 remove_watcher() i=2 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.607+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94392018569344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ac6bc00 con 0x55d95ac6b400 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.608+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94392018569344] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad21440 con 0x55d95ac6b400 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.608+0000 7fc13ed69a80 20 remove_watcher() i=3 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.608+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94392018570496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad31c00 con 0x55d95a8e9800 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.609+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.1 v2:172.21.15.155:6800/41833 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94392018570496] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95a8e9800 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.609+0000 7fc13ed69a80 20 remove_watcher() i=4 2024-04-19T23:46:34.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.609+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94392018571648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad18000 con 0x55d95ad30000 2024-04-19T23:46:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.610+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94392018571648] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.611+0000 7fc13ed69a80 20 remove_watcher() i=5 2024-04-19T23:46:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.611+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94392018572800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad18400 con 0x55d95ad30000 2024-04-19T23:46:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.612+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94392018572800] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.612+0000 7fc13ed69a80 20 remove_watcher() i=6 2024-04-19T23:46:34.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.612+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94392018573952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d95ad18800 con 0x55d95ad30000 2024-04-19T23:46:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13d514700 1 -- 172.21.15.155:0/3259619679 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94392018573952] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d95ad20b40 con 0x55d95ad30000 2024-04-19T23:46:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 20 remove_watcher() i=7 2024-04-19T23:46:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d95ad30000 msgr2=0x55d95abd3180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d95ad30000 0x55d95abd3180 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d95a8e9800 msgr2=0x55d95abd1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d95a8e9800 0x55d95abd1b80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d95ac6b400 msgr2=0x55d95abd2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d95ac6b400 0x55d95abd2c00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d95ac6b000 msgr2=0x55d95abd2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d95ac6b000 0x55d95abd2100 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95ac6ac00 msgr2=0x55d95abd1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95ac6ac00 0x55d95abd1600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55d95abcb890 tx=0x55d95a9d9800 comp rx=0 tx=0).stop 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 msgr2=0x55d95abd0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55d95b6b9f50 tx=0x55d95a9d9f20 comp rx=0 tx=0).stop 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13c512700 1 -- 172.21.15.155:0/3259619679 reap_dead start 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 shutdown_connections 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/3259619679 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e9400 0x55d95abd0b00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 >> 172.21.15.155:0/3259619679 conn(0x55d95a8e8c00 msgr2=0x55d95a9d5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 shutdown_connections 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/3259619679 wait complete. 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1333373107 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95add4000 msgr2=0x55d95abd3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/1333373107 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95add4000 0x55d95abd3700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55d95accdf50 tx=0x55d95ac35bc0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1333373107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 msgr2=0x55d95abd2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.613+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/1333373107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55d95ad45200 tx=0x55d95a9d99e0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1333373107 shutdown_connections 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/1333373107 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95add4000 0x55d95abd3700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/1333373107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95ad31400 0x55d95abd2680 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1333373107 >> 172.21.15.155:0/1333373107 conn(0x55d95ad30800 msgr2=0x55d95a9d6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1333373107 shutdown_connections 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1333373107 wait complete. 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1322269225 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95ac6a000 msgr2=0x55d95abd1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/1322269225 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95ac6a000 0x55d95abd1080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55d95b776f00 tx=0x55d95ac34240 comp rx=0 tx=0).stop 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1322269225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 msgr2=0x55d95abd0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/1322269225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x55d95b6b9e30 tx=0x55d95a9d9920 comp rx=0 tx=0).stop 2024-04-19T23:46:34.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1322269225 shutdown_connections 2024-04-19T23:46:34.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/1322269225 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d95ac6a000 0x55d95abd1080 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 --2- 172.21.15.155:0/1322269225 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d95a8e8800 0x55d95abd0580 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1322269225 >> 172.21.15.155:0/1322269225 conn(0x55d95a8e8400 msgr2=0x55d95a9d5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1322269225 shutdown_connections 2024-04-19T23:46:34.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.614+0000 7fc13ed69a80 1 -- 172.21.15.155:0/1322269225 wait complete. 2024-04-19T23:46:34.634 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:46:34.634 INFO:teuthology.orchestra.run.smithi155.stdout: "entries": [ 2024-04-19T23:46:34.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.634 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "anonymous", 2024-04-19T23:46:34.634 INFO:teuthology.orchestra.run.smithi155.stdout: "buckets": [ 2024-04-19T23:46:34.634 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.634 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "", 2024-04-19T23:46:34.634 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "anonymous", 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: "buckets": [ 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "", 2024-04-19T23:46:34.635 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo", 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.636 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_obj", 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 4, 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo2", 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.637 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:34.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.638 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo3", 2024-04-19T23:46:34.638 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.638 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.638 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.638 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:34.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.638 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.638 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo4", 2024-04-19T23:46:34.638 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: "summary": [ 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "anonymous", 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [], 2024-04-19T23:46:34.639 INFO:teuthology.orchestra.run.smithi155.stdout: "total": { 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 0, 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 0 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_obj", 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.640 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 4, 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: "total": { 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 4, 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.641 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:46:34.642 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-19T23:46:34.642 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-19T23:46:34.642 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-19T23:46:34.642 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-19T23:46:34.686 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:34.686 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:34.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.687+0000 7fd684c42a80 1 Processor -- start 2024-04-19T23:46:34.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.687+0000 7fd684c42a80 1 -- start start 2024-04-19T23:46:34.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.687+0000 7fd684c42a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56187b7bac00 0x56187baa2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.687+0000 7fd684c42a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56187bae5500 con 0x56187b7ba800 2024-04-19T23:46:34.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.687+0000 7fd684c42a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x56187b85ca00 con 0x56187b7bac00 2024-04-19T23:46:34.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.687+0000 7fd6823eb700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56187b7bac00 0x56187baa2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.687+0000 7fd682bec700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x56187b7ba800 0x56187b8a6800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55656/0 (socket says 172.21.15.155:55656) 2024-04-19T23:46:34.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.687+0000 7fd682bec700 1 -- 172.21.15.155:0/716937552 learned_addr learned my addr 172.21.15.155:0/716937552 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:34.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd6823eb700 1 -- 172.21.15.155:0/716937552 >> v1:172.21.15.76:6789/0 conn(0x56187b7ba800 legacy=0x56187b8a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd6823eb700 1 -- 172.21.15.155:0/716937552 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56187b7e3d40 con 0x56187b7bac00 2024-04-19T23:46:34.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd681bea700 1 -- 172.21.15.155:0/716937552 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463463049 0 0) 0x56187c588000 con 0x56187b7ba800 2024-04-19T23:46:34.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd6823eb700 1 --2- 172.21.15.155:0/716937552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bac00 0x56187baa2580 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x56187ba9d890 tx=0x56187b8ab920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2d2b45c234b97 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd681bea700 1 -- 172.21.15.155:0/716937552 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187b8734a0 con 0x56187b7bac00 2024-04-19T23:46:34.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd681bea700 1 -- 172.21.15.155:0/716937552 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56187bae5800 con 0x56187b7bac00 2024-04-19T23:46:34.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd681bea700 1 -- 172.21.15.155:0/716937552 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187b873600 con 0x56187b7bac00 2024-04-19T23:46:34.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd684c42a80 1 -- 172.21.15.155:0/716937552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bac00 msgr2=0x56187baa2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd684c42a80 1 --2- 172.21.15.155:0/716937552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bac00 0x56187baa2580 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x56187ba9d890 tx=0x56187b8ab920 comp rx=0 tx=0).stop 2024-04-19T23:46:34.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd684c42a80 1 -- 172.21.15.155:0/716937552 shutdown_connections 2024-04-19T23:46:34.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd684c42a80 1 --2- 172.21.15.155:0/716937552 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bac00 0x56187baa2580 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.688+0000 7fd684c42a80 1 -- 172.21.15.155:0/716937552 >> 172.21.15.155:0/716937552 conn(0x56187b7ba400 msgr2=0x56187b8a6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.690 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.689+0000 7fd684c42a80 1 -- 172.21.15.155:0/716937552 shutdown_connections 2024-04-19T23:46:34.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.689+0000 7fd684c42a80 1 -- 172.21.15.155:0/716937552 wait complete. 2024-04-19T23:46:34.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.689+0000 7fd684c42a80 1 Processor -- start 2024-04-19T23:46:34.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.689+0000 7fd684c42a80 1 -- start start 2024-04-19T23:46:34.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.689+0000 7fd684c42a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.689+0000 7fd684c42a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187b85c500 con 0x56187b7ba800 2024-04-19T23:46:34.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.690+0000 7fd682bec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.690+0000 7fd682bec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40506/0 (socket says 172.21.15.155:40506) 2024-04-19T23:46:34.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.690+0000 7fd682bec700 1 -- 172.21.15.155:0/369862171 learned_addr learned my addr 172.21.15.155:0/369862171 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.690+0000 7fd682bec700 1 -- 172.21.15.155:0/369862171 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56187b7e3ba0 con 0x56187b7ba800 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.690+0000 7fd682bec700 1 --2- 172.21.15.155:0/369862171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x56187c58b770 tx=0x56187b8abb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db9a138b5293608 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.690+0000 7fd6813e9700 1 -- 172.21.15.155:0/369862171 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187b8734a0 con 0x56187b7ba800 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.690+0000 7fd6813e9700 1 -- 172.21.15.155:0/369862171 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56187bae5b00 con 0x56187b7ba800 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.690+0000 7fd6813e9700 1 -- 172.21.15.155:0/369862171 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187b873600 con 0x56187b7ba800 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd684c42a80 1 -- 172.21.15.155:0/369862171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 msgr2=0x56187baa2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd684c42a80 1 --2- 172.21.15.155:0/369862171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x56187c58b770 tx=0x56187b8abb60 comp rx=0 tx=0).stop 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd684c42a80 1 -- 172.21.15.155:0/369862171 shutdown_connections 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd684c42a80 1 --2- 172.21.15.155:0/369862171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd684c42a80 1 -- 172.21.15.155:0/369862171 >> 172.21.15.155:0/369862171 conn(0x56187b7ba400 msgr2=0x56187b8a7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd684c42a80 1 -- 172.21.15.155:0/369862171 shutdown_connections 2024-04-19T23:46:34.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd684c42a80 1 -- 172.21.15.155:0/369862171 wait complete. 2024-04-19T23:46:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd684c42a80 1 Processor -- start 2024-04-19T23:46:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd684c42a80 1 -- start start 2024-04-19T23:46:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd684c42a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd684c42a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187b85c3c0 con 0x56187b7ba800 2024-04-19T23:46:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd682bec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd682bec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40520/0 (socket says 172.21.15.155:40520) 2024-04-19T23:46:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.691+0000 7fd682bec700 1 -- 172.21.15.155:0/2283505891 learned_addr learned my addr 172.21.15.155:0/2283505891 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.692+0000 7fd682bec700 1 -- 172.21.15.155:0/2283505891 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56187b7e3a00 con 0x56187b7ba800 2024-04-19T23:46:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.692+0000 7fd682bec700 1 --2- 172.21.15.155:0/2283505891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x56187c58be30 tx=0x56187b8aba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.692+0000 7fd67fbe6700 1 -- 172.21.15.155:0/2283505891 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187b8738c0 con 0x56187b7ba800 2024-04-19T23:46:34.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.692+0000 7fd67fbe6700 1 -- 172.21.15.155:0/2283505891 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56187b85bc80 con 0x56187b7ba800 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.692+0000 7fd67fbe6700 1 -- 172.21.15.155:0/2283505891 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187b8734a0 con 0x56187b7ba800 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.692+0000 7fd684c42a80 1 -- 172.21.15.155:0/2283505891 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56187b7e3860 con 0x56187b7ba800 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.692+0000 7fd684c42a80 1 -- 172.21.15.155:0/2283505891 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56187b7e36c0 con 0x56187b7ba800 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd684c42a80 1 Processor -- start 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd684c42a80 1 -- start start 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd684c42a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 0x56187baa2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd684c42a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187b85c000 con 0x56187b7bb400 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd67fbe6700 1 -- 172.21.15.155:0/2283505891 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56187c55cb00 con 0x56187b7ba800 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd6833ed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 0x56187baa2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd6833ed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 0x56187baa2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40522/0 (socket says 172.21.15.155:40522) 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd6833ed700 1 -- 172.21.15.155:0/2510905739 learned_addr learned my addr 172.21.15.155:0/2510905739 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd67fbe6700 1 --2- 172.21.15.155:0/2283505891 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bb44000 0x56187baa3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd67fbe6700 1 -- 172.21.15.155:0/2283505891 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x56187b835180 con 0x56187b7ba800 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd682bec700 1 --2- 172.21.15.155:0/2283505891 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bb44000 0x56187baa3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.693+0000 7fd6833ed700 1 -- 172.21.15.155:0/2510905739 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56187b7e2000 con 0x56187b7bb400 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd6833ed700 1 --2- 172.21.15.155:0/2510905739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 0x56187baa2b00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x56187c655b60 tx=0x56187bb0ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a141f6335e0ff657 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd682bec700 1 --2- 172.21.15.155:0/2283505891 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bb44000 0x56187baa3080 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56187c654f90 tx=0x56187bb0c240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd67d3e1700 1 -- 172.21.15.155:0/2510905739 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187b8738c0 con 0x56187b7bb400 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd67d3e1700 1 -- 172.21.15.155:0/2510905739 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56187bae4300 con 0x56187b7bb400 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd67d3e1700 1 -- 172.21.15.155:0/2510905739 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187b8734a0 con 0x56187b7bb400 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd684c42a80 1 -- 172.21.15.155:0/2510905739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 msgr2=0x56187baa2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd684c42a80 1 --2- 172.21.15.155:0/2510905739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 0x56187baa2b00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x56187c655b60 tx=0x56187bb0ca20 comp rx=0 tx=0).stop 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd684c42a80 1 -- 172.21.15.155:0/2510905739 shutdown_connections 2024-04-19T23:46:34.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd684c42a80 1 --2- 172.21.15.155:0/2510905739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 0x56187baa2b00 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd684c42a80 1 -- 172.21.15.155:0/2510905739 >> 172.21.15.155:0/2510905739 conn(0x56187b7bac00 msgr2=0x56187b8a7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd684c42a80 1 -- 172.21.15.155:0/2510905739 shutdown_connections 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd684c42a80 1 -- 172.21.15.155:0/2510905739 wait complete. 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd684c42a80 1 Processor -- start 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.694+0000 7fd684c42a80 1 -- start start 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.695+0000 7fd684c42a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 0x56187baa2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.695+0000 7fd684c42a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187b7f6640 con 0x56187b7bb400 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.695+0000 7fd6833ed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 0x56187baa2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.695+0000 7fd6833ed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 0x56187baa2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40526/0 (socket says 172.21.15.155:40526) 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.695+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 learned_addr learned my addr 172.21.15.155:0/4247470644 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.695+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56187b7e2ea0 con 0x56187b7bb400 2024-04-19T23:46:34.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.695+0000 7fd6833ed700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 0x56187baa2b00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x56187c58bf50 tx=0x56187bb0c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.696+0000 7fd67bbde700 1 -- 172.21.15.155:0/4247470644 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187b873b80 con 0x56187b7bb400 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.696+0000 7fd67bbde700 1 -- 172.21.15.155:0/4247470644 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56187b85bc80 con 0x56187b7bb400 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.696+0000 7fd67bbde700 1 -- 172.21.15.155:0/4247470644 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187b8738c0 con 0x56187b7bb400 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.696+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56187b7e2820 con 0x56187b7bb400 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.696+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56187b7e29c0 con 0x56187b7bb400 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.696+0000 7fd684c42a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.696+0000 7fd67bbde700 1 -- 172.21.15.155:0/4247470644 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56187c55cdc0 con 0x56187b7bb400 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd67bbde700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bb44c00 0x56187baa3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd67bbde700 1 -- 172.21.15.155:0/4247470644 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x56187b835340 con 0x56187b7bb400 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd6823eb700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bb44c00 0x56187baa3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd684c42a80 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56187b7bb800 0x56187baa3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187b7bbc00 con 0x56187b7bb800 2024-04-19T23:46:34.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd6833ed700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56187b7bb800 0x56187baa3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd6823eb700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bb44c00 0x56187baa3600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x56187ba9d890 tx=0x56187b8ab800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd6833ed700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56187b7bb800 0x56187baa3b80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd684c42a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd684c42a80 20 realm 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd684c42a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.697+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45000 con 0x56187b7bb800 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45400 con 0x56187b7bb800 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45800 con 0x56187b7bb800 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45c00 con 0x56187b7bb800 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 20 searching for the correct realm 2024-04-19T23:46:34.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56187bb45000 0x56187baa4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.698+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45400 con 0x56187bb45000 2024-04-19T23:46:34.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.699+0000 7fd682bec700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56187bb45000 0x56187baa4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.699+0000 7fd682bec700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56187bb45000 0x56187baa4100 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.699+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.699+0000 7fd682bec700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56187bb45400 0x56187baa4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.699+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02000 con 0x56187bb45400 2024-04-19T23:46:34.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.699+0000 7fd6823eb700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56187bb45400 0x56187baa4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.700+0000 7fd6823eb700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56187bb45400 0x56187baa4c00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.700+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.700+0000 7fd6823eb700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56187bc02000 0x56187baa5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.700+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bc02000 2024-04-19T23:46:34.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.700+0000 7fd6833ed700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56187bc02000 0x56187baa5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.701+0000 7fd6833ed700 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56187bc02000 0x56187baa5180 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.701+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.701+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187b7bb800 2024-04-19T23:46:34.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.701+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.701+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187b7bb800 2024-04-19T23:46:34.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.701+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.701+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187b7bb800 2024-04-19T23:46:34.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.701+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.701+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bc02000 2024-04-19T23:46:34.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.702+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.702+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45400 2024-04-19T23:46:34.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.702+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.702+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45000 2024-04-19T23:46:34.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.702+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.702+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187b7bb800 2024-04-19T23:46:34.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.702+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.703+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bc02000 2024-04-19T23:46:34.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.703+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.703+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187b7bb800 2024-04-19T23:46:34.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.703+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.703+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45400 2024-04-19T23:46:34.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.703+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.703+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45000 2024-04-19T23:46:34.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.704+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.704+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45000 2024-04-19T23:46:34.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.704+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.704+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45400 2024-04-19T23:46:34.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.704+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.704+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45000 2024-04-19T23:46:34.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.704+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.704+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45000 2024-04-19T23:46:34.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.704+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.704+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187b7bb800 2024-04-19T23:46:34.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.705+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.705+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187b7bb800 2024-04-19T23:46:34.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.705+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.705+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bc02000 2024-04-19T23:46:34.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.705+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.705+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45000 2024-04-19T23:46:34.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.705+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.705+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45400 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.706+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.706+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187b7bb800 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.706+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.706+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bc02000 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.706+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.706+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45000 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.706+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.706+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bc02000 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.707+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.707+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45400 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.707+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.707+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45000 2024-04-19T23:46:34.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.707+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.707+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bc02000 2024-04-19T23:46:34.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187b7bb800 2024-04-19T23:46:34.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45400 2024-04-19T23:46:34.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd684c42a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:34.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd684c42a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:34.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd684c42a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:34.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd684c42a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd684c42a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187b7bbc00 con 0x56187b7bb800 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd684c42a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd684c42a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.708+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02c00 con 0x56187b7bb800 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03000 con 0x56187bb45400 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:34.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 20 zone default found 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 4 Realm: () 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 20 zonegroup default 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03400 con 0x56187bc02000 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03800 con 0x56187bb45000 2024-04-19T23:46:34.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.709+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03c00 con 0x56187bb45000 2024-04-19T23:46:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.710+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.710+0000 7fd684c42a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.710+0000 7fd684c42a80 20 started sync module instance, tier type = 2024-04-19T23:46:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.710+0000 7fd684c42a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.710+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02c00 con 0x56187bb45400 2024-04-19T23:46:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.711+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.711+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94663153916672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187b7bbc00 con 0x56187bb45400 2024-04-19T23:46:34.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.711+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45800 con 0x56187b7bb800 2024-04-19T23:46:34.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.712+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94663153916672] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.712+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.712+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94663153917824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45c00 con 0x56187b7bb800 2024-04-19T23:46:34.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.712+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bb45000 2024-04-19T23:46:34.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.713+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94663153917824] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.714+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.714+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94663153918976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03000 con 0x56187bb45000 2024-04-19T23:46:34.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.714+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02c00 con 0x56187bb45400 2024-04-19T23:46:34.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.715+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.715+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94663153920128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02400 con 0x56187bb45400 2024-04-19T23:46:34.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.715+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03800 con 0x56187b7bb800 2024-04-19T23:46:34.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.715+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94663153918976] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.716+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94663153920128] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.716+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.716+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94663153921280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03c00 con 0x56187b7bb800 2024-04-19T23:46:34.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.716+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02800 con 0x56187bc02000 2024-04-19T23:46:34.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.717+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.717+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94663153922432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03400 con 0x56187bc02000 2024-04-19T23:46:34.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.717+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03800 con 0x56187bc02000 2024-04-19T23:46:34.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.717+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94663153921280] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.718+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.718+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94663153922432] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.718+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94663153923584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03c00 con 0x56187bc02000 2024-04-19T23:46:34.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.718+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45800 con 0x56187bc02000 2024-04-19T23:46:34.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.719+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94663153923584] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.719+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.719+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94663153924736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45c00 con 0x56187bc02000 2024-04-19T23:46:34.747 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.719+0000 7fd684c42a80 20 add_watcher() i=0 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.719+0000 7fd684c42a80 20 add_watcher() i=1 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.719+0000 7fd684c42a80 20 add_watcher() i=2 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.719+0000 7fd684c42a80 20 add_watcher() i=3 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.719+0000 7fd684c42a80 20 add_watcher() i=4 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.719+0000 7fd684c42a80 20 add_watcher() i=5 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.719+0000 7fd684c42a80 20 add_watcher() i=6 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.720+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94663153924736] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.720+0000 7fd684c42a80 20 add_watcher() i=7 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.720+0000 7fd684c42a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.720+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45800 con 0x56187b7bb800 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.720+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.720+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94663155458048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45c00 con 0x56187b7bb800 2024-04-19T23:46:34.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.721+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94663155458048] v32'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.722+0000 7fd669bba700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:34.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.722+0000 7fd684c42a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:34.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.722+0000 7fd684c42a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:34.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.722+0000 7fd684c42a80 1 Processor -- start 2024-04-19T23:46:34.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.722+0000 7fd684c42a80 1 -- start start 2024-04-19T23:46:34.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.722+0000 7fd684c42a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.722+0000 7fd684c42a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187b7f6780 con 0x56187bc03400 2024-04-19T23:46:34.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.722+0000 7fd6823eb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.722+0000 7fd6823eb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40536/0 (socket says 172.21.15.155:40536) 2024-04-19T23:46:34.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.722+0000 7fd6823eb700 1 -- 172.21.15.155:0/872525640 learned_addr learned my addr 172.21.15.155:0/872525640 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.722+0000 7fd6823eb700 1 -- 172.21.15.155:0/872525640 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56187b7e2b60 con 0x56187bc03400 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.723+0000 7fd6823eb700 1 --2- 172.21.15.155:0/872525640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x56187bb4ad50 tx=0x56187bb0dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef68b3f6485ef077 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.723+0000 7fd6693b9700 1 -- 172.21.15.155:0/872525640 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187b873760 con 0x56187bc03400 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.723+0000 7fd6693b9700 1 -- 172.21.15.155:0/872525640 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56187bc2a000 con 0x56187bc03400 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.723+0000 7fd6693b9700 1 -- 172.21.15.155:0/872525640 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187bc2c000 con 0x56187bc03400 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.723+0000 7fd684c42a80 1 -- 172.21.15.155:0/872525640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 msgr2=0x56187baa4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.723+0000 7fd684c42a80 1 --2- 172.21.15.155:0/872525640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x56187bb4ad50 tx=0x56187bb0dda0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.723+0000 7fd684c42a80 1 -- 172.21.15.155:0/872525640 shutdown_connections 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.723+0000 7fd684c42a80 1 --2- 172.21.15.155:0/872525640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.723+0000 7fd684c42a80 1 -- 172.21.15.155:0/872525640 >> 172.21.15.155:0/872525640 conn(0x56187bc02800 msgr2=0x56187b8a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.724+0000 7fd684c42a80 1 -- 172.21.15.155:0/872525640 shutdown_connections 2024-04-19T23:46:34.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.724+0000 7fd684c42a80 1 -- 172.21.15.155:0/872525640 wait complete. 2024-04-19T23:46:34.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.724+0000 7fd684c42a80 1 Processor -- start 2024-04-19T23:46:34.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.724+0000 7fd684c42a80 1 -- start start 2024-04-19T23:46:34.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.724+0000 7fd684c42a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.724+0000 7fd684c42a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187b85c000 con 0x56187bc03400 2024-04-19T23:46:34.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.724+0000 7fd6823eb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.724+0000 7fd6823eb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40546/0 (socket says 172.21.15.155:40546) 2024-04-19T23:46:34.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.724+0000 7fd6823eb700 1 -- 172.21.15.155:0/1149289608 learned_addr learned my addr 172.21.15.155:0/1149289608 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.724+0000 7fd6823eb700 1 -- 172.21.15.155:0/1149289608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56187b7e2d00 con 0x56187bc03400 2024-04-19T23:46:34.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.725+0000 7fd6823eb700 1 --2- 172.21.15.155:0/1149289608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x56187bc17200 tx=0x56187b8ab980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.725+0000 7fd667bb6700 1 -- 172.21.15.155:0/1149289608 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187bc2c160 con 0x56187bc03400 2024-04-19T23:46:34.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.725+0000 7fd667bb6700 1 -- 172.21.15.155:0/1149289608 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56187bc2a180 con 0x56187bc03400 2024-04-19T23:46:34.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.725+0000 7fd684c42a80 1 -- 172.21.15.155:0/1149289608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56187b7e2340 con 0x56187bc03400 2024-04-19T23:46:34.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.725+0000 7fd667bb6700 1 -- 172.21.15.155:0/1149289608 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56187bc2c2c0 con 0x56187bc03400 2024-04-19T23:46:34.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.725+0000 7fd684c42a80 1 -- 172.21.15.155:0/1149289608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56187b7e3d40 con 0x56187bc03400 2024-04-19T23:46:34.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.726+0000 7fd667bb6700 1 -- 172.21.15.155:0/1149289608 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56187c55db80 con 0x56187bc03400 2024-04-19T23:46:34.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.726+0000 7fd667bb6700 1 --2- 172.21.15.155:0/1149289608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bca6000 0x56187baa5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.726+0000 7fd667bb6700 1 -- 172.21.15.155:0/1149289608 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x56187b835500 con 0x56187bc03400 2024-04-19T23:46:34.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.726+0000 7fd6833ed700 1 --2- 172.21.15.155:0/1149289608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bca6000 0x56187baa5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.726+0000 7fd684c42a80 5 note: GC not initialized 2024-04-19T23:46:34.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.726+0000 7fd6833ed700 1 --2- 172.21.15.155:0/1149289608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bca6000 0x56187baa5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x56187c654150 tx=0x56187bb0dbc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.727+0000 7fd6653b1700 20 reqs_thread_entry: start 2024-04-19T23:46:34.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.727+0000 7fd684c42a80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:34.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.727+0000 7fd684c42a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:34.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.727+0000 7fd6633ad700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:05 2024 2024-04-19T23:46:34.753 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:34.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.727+0000 7fd662b8b700 20 reqs_thread_entry: start 2024-04-19T23:46:34.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.727+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03c00 con 0x56187b7bb800 2024-04-19T23:46:34.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.727+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.728+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca6400 con 0x56187bb45400 2024-04-19T23:46:34.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.728+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.728+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca6800 con 0x56187b7bb800 2024-04-19T23:46:34.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.728+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.728+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca6c00 con 0x56187bb45000 2024-04-19T23:46:34.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.728+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.728+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7000 con 0x56187bb45000 2024-04-19T23:46:34.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.728+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.728+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7400 con 0x56187bb45000 2024-04-19T23:46:34.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.729+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.729+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7800 con 0x56187b7bb800 2024-04-19T23:46:34.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.729+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.729+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7c00 con 0x56187b7bb800 2024-04-19T23:46:34.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.729+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.729+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bd12000 con 0x56187bb45000 2024-04-19T23:46:34.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.729+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.729+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bd12400 con 0x56187bb45000 2024-04-19T23:46:34.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.730+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.730+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bd12800 con 0x56187bc02000 2024-04-19T23:46:34.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.730+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.730+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bd12c00 con 0x56187b7bb800 2024-04-19T23:46:34.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.730+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.731+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bd13000 con 0x56187bb45400 2024-04-19T23:46:34.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.731+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.731+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bd13400 con 0x56187bb45000 2024-04-19T23:46:34.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.731+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.731+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bd13800 con 0x56187bc02000 2024-04-19T23:46:34.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.731+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.731+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bd13c00 con 0x56187bc02000 2024-04-19T23:46:34.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.732+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.732+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bd13000 con 0x56187bb45000 2024-04-19T23:46:34.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.732+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.732+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca6400 con 0x56187bc02000 2024-04-19T23:46:34.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.732+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.732+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca6800 con 0x56187b7bb800 2024-04-19T23:46:34.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.732+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.732+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7800 con 0x56187bb45000 2024-04-19T23:46:34.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.733+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.733+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7c00 con 0x56187bc02000 2024-04-19T23:46:34.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.733+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.733+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca6c00 con 0x56187bb45400 2024-04-19T23:46:34.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.733+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.733+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7000 con 0x56187bc02000 2024-04-19T23:46:34.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.734+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.734+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7400 con 0x56187b7bb800 2024-04-19T23:46:34.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.734+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.734+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc02c00 con 0x56187b7bb800 2024-04-19T23:46:34.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.734+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.734+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03c00 con 0x56187bb45000 2024-04-19T23:46:34.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.734+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.734+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03000 con 0x56187b7bb800 2024-04-19T23:46:34.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.734+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.734+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45800 con 0x56187b7bb800 2024-04-19T23:46:34.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.735+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.735+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45c00 con 0x56187bb45000 2024-04-19T23:46:34.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.735+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.735+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187b7bbc00 con 0x56187bb45000 2024-04-19T23:46:34.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.735+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.735+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7800 con 0x56187bb45000 2024-04-19T23:46:34.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.735+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.735+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca6400 con 0x56187bc02000 2024-04-19T23:46:34.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.736+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187bc02000 2024-04-19T23:46:34.759 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:46:34.759 INFO:teuthology.orchestra.run.smithi155.stdout: "entries": [ 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "anonymous", 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: "buckets": [ 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "", 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "anonymous", 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "list_buckets", 2024-04-19T23:46:34.760 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 231, 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: "buckets": [ 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.761 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "", 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "list_buckets", 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 322, 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.762 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo", 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 5, 2024-04-19T23:46:34.763 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 5 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 236, 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 2, 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_obj", 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.764 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 4, 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "get_acls", 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 1026, 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 2, 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 2 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "get_obj", 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 4, 2024-04-19T23:46:34.765 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "list_bucket", 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 515, 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "put_acls", 2024-04-19T23:46:34.766 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 2, 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 2 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "put_obj", 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 30000042, 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 11, 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 11 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo2", 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.768 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo3", 2024-04-19T23:46:34.769 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.770 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.770 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.770 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.770 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:34.770 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.770 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.770 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.770 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.770 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.770 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo4", 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.771 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.772 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: "summary": [ 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "anonymous", 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.773 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "list_buckets", 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 231, 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: "total": { 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 231, 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.774 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 8, 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 8 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 236, 2024-04-19T23:46:34.775 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 5, 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_obj", 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 4, 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "get_acls", 2024-04-19T23:46:34.776 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 1026, 2024-04-19T23:46:34.777 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.777 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 2, 2024-04-19T23:46:34.777 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 2 2024-04-19T23:46:34.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.777 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.777 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "get_obj", 2024-04-19T23:46:34.777 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 4, 2024-04-19T23:46:34.777 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.777 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.777 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.777 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.736+0000 7fd669bba700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:34.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.736+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94663155458048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca6800 con 0x56187b7bb800 2024-04-19T23:46:34.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.737+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94663155458048] v32'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.737+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94663153916672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7c00 con 0x56187bb45400 2024-04-19T23:46:34.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.738+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94663153916672] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.739+0000 7fd684c42a80 20 remove_watcher() i=0 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.739+0000 7fd684c42a80 2 removed watcher, disabling cache 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.739+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94663153917824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7000 con 0x56187b7bb800 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.740+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94663153917824] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.740+0000 7fd684c42a80 20 remove_watcher() i=1 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.740+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94663153918976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bca7400 con 0x56187bb45000 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.741+0000 7fd682bec700 1 -- 172.21.15.155:0/4247470644 <== osd.3 v2:172.21.15.155:6808/41835 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94663153918976] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb200 con 0x56187bb45000 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.741+0000 7fd684c42a80 20 remove_watcher() i=2 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.741+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94663153920128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bb45c00 con 0x56187bb45400 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.742+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94663153920128] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdb440 con 0x56187bb45400 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.742+0000 7fd684c42a80 20 remove_watcher() i=3 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.742+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94663153921280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bc03c00 con 0x56187b7bb800 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.743+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.1 v2:172.21.15.155:6800/41833 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94663153921280] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdab40 con 0x56187b7bb800 2024-04-19T23:46:34.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.743+0000 7fd684c42a80 20 remove_watcher() i=4 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.743+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94663153922432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bbb8000 con 0x56187bc02000 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.745+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94663153922432] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdad80 con 0x56187bc02000 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.745+0000 7fd684c42a80 20 remove_watcher() i=5 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.745+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94663153923584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bbb8400 con 0x56187bc02000 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.746+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94663153923584] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdad80 con 0x56187bc02000 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.746+0000 7fd684c42a80 20 remove_watcher() i=6 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.746+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94663153924736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56187bbb8800 con 0x56187bc02000 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd6833ed700 1 -- 172.21.15.155:0/4247470644 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94663153924736] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56187bbdad80 con 0x56187bc02000 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 20 remove_watcher() i=7 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56187bc02000 msgr2=0x56187baa5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56187bc02000 0x56187baa5180 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56187b7bb800 msgr2=0x56187baa3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56187b7bb800 0x56187baa3b80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56187bb45400 msgr2=0x56187baa4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56187bb45400 0x56187baa4c00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56187bb45000 msgr2=0x56187baa4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56187bb45000 0x56187baa4100 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bb44c00 msgr2=0x56187baa3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bb44c00 0x56187baa3600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x56187ba9d890 tx=0x56187b8ab800 comp rx=0 tx=0).stop 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 msgr2=0x56187baa2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 --2- 172.21.15.155:0/4247470644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7bb400 0x56187baa2b00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x56187c58bf50 tx=0x56187bb0c840 comp rx=0 tx=0).stop 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 reap_dead start 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd6823eb700 1 -- 172.21.15.155:0/4247470644 reap_dead start 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 shutdown_connections 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 >> 172.21.15.155:0/4247470644 conn(0x56187b7bac00 msgr2=0x56187b8a7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 shutdown_connections 2024-04-19T23:46:34.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.747+0000 7fd684c42a80 1 -- 172.21.15.155:0/4247470644 wait complete. 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/1149289608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bca6000 msgr2=0x56187baa5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 --2- 172.21.15.155:0/1149289608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bca6000 0x56187baa5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x56187c654150 tx=0x56187bb0dbc0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/1149289608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 msgr2=0x56187baa4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 --2- 172.21.15.155:0/1149289608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x56187bc17200 tx=0x56187b8ab980 comp rx=0 tx=0).stop 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/1149289608 shutdown_connections 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 --2- 172.21.15.155:0/1149289608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bca6000 0x56187baa5700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 --2- 172.21.15.155:0/1149289608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187bc03400 0x56187baa4680 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/1149289608 >> 172.21.15.155:0/1149289608 conn(0x56187bc02800 msgr2=0x56187b8a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/1149289608 shutdown_connections 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/1149289608 wait complete. 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/2283505891 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bb44000 msgr2=0x56187baa3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 --2- 172.21.15.155:0/2283505891 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bb44000 0x56187baa3080 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56187c654f90 tx=0x56187bb0c240 comp rx=0 tx=0).stop 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/2283505891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 msgr2=0x56187baa2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 --2- 172.21.15.155:0/2283505891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x56187c58be30 tx=0x56187b8aba40 comp rx=0 tx=0).stop 2024-04-19T23:46:34.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/2283505891 shutdown_connections 2024-04-19T23:46:34.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 --2- 172.21.15.155:0/2283505891 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56187bb44000 0x56187baa3080 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 --2- 172.21.15.155:0/2283505891 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56187b7ba800 0x56187baa2580 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/2283505891 >> 172.21.15.155:0/2283505891 conn(0x56187b7ba400 msgr2=0x56187b8a7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/2283505891 shutdown_connections 2024-04-19T23:46:34.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.748+0000 7fd684c42a80 1 -- 172.21.15.155:0/2283505891 wait complete. 2024-04-19T23:46:34.789 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.789 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "list_bucket", 2024-04-19T23:46:34.789 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 515, 2024-04-19T23:46:34.789 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.789 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.789 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.789 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.789 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.789 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "list_buckets", 2024-04-19T23:46:34.789 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 322, 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "put_acls", 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 2, 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 2 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "put_obj", 2024-04-19T23:46:34.790 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 30000042, 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 11, 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 11 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: "total": { 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 2103, 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 30000042, 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 35, 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 34 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.791 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:46:34.792 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-19T23:46:34.792 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-19T23:46:34.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-19T23:46:34.792 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-19T23:46:34.874 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:34.875 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:34.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.875+0000 7fc79bf25a80 1 Processor -- start 2024-04-19T23:46:34.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.875+0000 7fc79bf25a80 1 -- start start 2024-04-19T23:46:34.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.875+0000 7fc79bf25a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x557aafb94c00 0x557aafe7c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.875+0000 7fc79bf25a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557aafebf500 con 0x557aafb94800 2024-04-19T23:46:34.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.875+0000 7fc79bf25a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x557aafc36a00 con 0x557aafb94c00 2024-04-19T23:46:34.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.875+0000 7fc7996ce700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x557aafb94c00 0x557aafe7c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.875+0000 7fc799ecf700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x557aafb94800 0x557aafc80800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55660/0 (socket says 172.21.15.155:55660) 2024-04-19T23:46:34.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.875+0000 7fc799ecf700 1 -- 172.21.15.155:0/493971350 learned_addr learned my addr 172.21.15.155:0/493971350 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:34.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc7996ce700 1 -- 172.21.15.155:0/493971350 >> v1:172.21.15.76:6789/0 conn(0x557aafb94800 legacy=0x557aafc80800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc7996ce700 1 -- 172.21.15.155:0/493971350 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aafbbdd40 con 0x557aafb94c00 2024-04-19T23:46:34.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc798ecd700 1 -- 172.21.15.155:0/493971350 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955388076 0 0) 0x557ab0962000 con 0x557aafb94800 2024-04-19T23:46:34.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc7996ce700 1 --2- 172.21.15.155:0/493971350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94c00 0x557aafe7c580 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x557aafe77890 tx=0x557aafc85920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e70b3eb98b8ae4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc798ecd700 1 -- 172.21.15.155:0/493971350 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557aafc4d4a0 con 0x557aafb94c00 2024-04-19T23:46:34.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc798ecd700 1 -- 172.21.15.155:0/493971350 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557aafebf800 con 0x557aafb94c00 2024-04-19T23:46:34.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc798ecd700 1 -- 172.21.15.155:0/493971350 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557aafc4d600 con 0x557aafb94c00 2024-04-19T23:46:34.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc79bf25a80 1 -- 172.21.15.155:0/493971350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94c00 msgr2=0x557aafe7c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/493971350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94c00 0x557aafe7c580 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x557aafe77890 tx=0x557aafc85920 comp rx=0 tx=0).stop 2024-04-19T23:46:34.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc79bf25a80 1 -- 172.21.15.155:0/493971350 shutdown_connections 2024-04-19T23:46:34.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/493971350 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94c00 0x557aafe7c580 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc79bf25a80 1 -- 172.21.15.155:0/493971350 >> 172.21.15.155:0/493971350 conn(0x557aafb94400 msgr2=0x557aafc80000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc79bf25a80 1 -- 172.21.15.155:0/493971350 shutdown_connections 2024-04-19T23:46:34.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.876+0000 7fc79bf25a80 1 -- 172.21.15.155:0/493971350 wait complete. 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.877+0000 7fc79bf25a80 1 Processor -- start 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.877+0000 7fc79bf25a80 1 -- start start 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.877+0000 7fc79bf25a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.877+0000 7fc79bf25a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aafc36500 con 0x557aafb94800 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.877+0000 7fc799ecf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.877+0000 7fc799ecf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40562/0 (socket says 172.21.15.155:40562) 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.877+0000 7fc799ecf700 1 -- 172.21.15.155:0/1155847842 learned_addr learned my addr 172.21.15.155:0/1155847842 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc799ecf700 1 -- 172.21.15.155:0/1155847842 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aafbbdba0 con 0x557aafb94800 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc799ecf700 1 --2- 172.21.15.155:0/1155847842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x557ab0965770 tx=0x557aafc85b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707e6fac37b3075a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc7986cc700 1 -- 172.21.15.155:0/1155847842 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557aafc4d1e0 con 0x557aafb94800 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc7986cc700 1 -- 172.21.15.155:0/1155847842 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557aafebfb00 con 0x557aafb94800 2024-04-19T23:46:34.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc7986cc700 1 -- 172.21.15.155:0/1155847842 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557aafc4d4a0 con 0x557aafb94800 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1155847842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 msgr2=0x557aafe7c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/1155847842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x557ab0965770 tx=0x557aafc85b60 comp rx=0 tx=0).stop 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1155847842 shutdown_connections 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/1155847842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1155847842 >> 172.21.15.155:0/1155847842 conn(0x557aafb94400 msgr2=0x557aafc81000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1155847842 shutdown_connections 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.878+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1155847842 wait complete. 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.879+0000 7fc79bf25a80 1 Processor -- start 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.879+0000 7fc79bf25a80 1 -- start start 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.879+0000 7fc79bf25a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.879+0000 7fc79bf25a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aafc363c0 con 0x557aafb94800 2024-04-19T23:46:34.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.879+0000 7fc799ecf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.879+0000 7fc799ecf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40574/0 (socket says 172.21.15.155:40574) 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.879+0000 7fc799ecf700 1 -- 172.21.15.155:0/3332106965 learned_addr learned my addr 172.21.15.155:0/3332106965 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.880+0000 7fc799ecf700 1 -- 172.21.15.155:0/3332106965 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aafbbda00 con 0x557aafb94800 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.880+0000 7fc799ecf700 1 --2- 172.21.15.155:0/3332106965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x557ab0965e30 tx=0x557aafc85a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.880+0000 7fc796ec9700 1 -- 172.21.15.155:0/3332106965 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557aafc4d600 con 0x557aafb94800 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.880+0000 7fc796ec9700 1 -- 172.21.15.155:0/3332106965 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557aafc35c80 con 0x557aafb94800 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.880+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3332106965 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557aafbbd860 con 0x557aafb94800 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.880+0000 7fc796ec9700 1 -- 172.21.15.155:0/3332106965 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557aafc4d1e0 con 0x557aafb94800 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.880+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3332106965 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557aafbbd6c0 con 0x557aafb94800 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc79bf25a80 1 Processor -- start 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc79bf25a80 1 -- start start 2024-04-19T23:46:34.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc796ec9700 1 -- 172.21.15.155:0/3332106965 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557ab0936b00 con 0x557aafb94800 2024-04-19T23:46:34.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc79bf25a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 0x557aafe7cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc79bf25a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aafc36000 con 0x557aafb95400 2024-04-19T23:46:34.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc796ec9700 1 --2- 172.21.15.155:0/3332106965 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557aaff1a000 0x557aafe7d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc796ec9700 1 -- 172.21.15.155:0/3332106965 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x557aafc0f180 con 0x557aafb94800 2024-04-19T23:46:34.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc79a6d0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 0x557aafe7cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc79a6d0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 0x557aafe7cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40580/0 (socket says 172.21.15.155:40580) 2024-04-19T23:46:34.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc79a6d0700 1 -- 172.21.15.155:0/3531446723 learned_addr learned my addr 172.21.15.155:0/3531446723 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc799ecf700 1 --2- 172.21.15.155:0/3332106965 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557aaff1a000 0x557aafe7d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc79a6d0700 1 -- 172.21.15.155:0/3531446723 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aafbbc000 con 0x557aafb95400 2024-04-19T23:46:34.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.881+0000 7fc799ecf700 1 --2- 172.21.15.155:0/3332106965 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557aaff1a000 0x557aafe7d080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x557ab0a26f00 tx=0x557aafee0240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc79a6d0700 1 --2- 172.21.15.155:0/3531446723 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 0x557aafe7cb00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x557ab0965ef0 tx=0x557aafee0d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfc654e5ed245a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc7946c4700 1 -- 172.21.15.155:0/3531446723 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557aafc4d600 con 0x557aafb95400 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc7946c4700 1 -- 172.21.15.155:0/3531446723 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557aafebe300 con 0x557aafb95400 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc7946c4700 1 -- 172.21.15.155:0/3531446723 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557aafc4d1e0 con 0x557aafb95400 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3531446723 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 msgr2=0x557aafe7cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/3531446723 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 0x557aafe7cb00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x557ab0965ef0 tx=0x557aafee0d20 comp rx=0 tx=0).stop 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3531446723 shutdown_connections 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/3531446723 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 0x557aafe7cb00 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3531446723 >> 172.21.15.155:0/3531446723 conn(0x557aafb94c00 msgr2=0x557aafc81800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3531446723 shutdown_connections 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3531446723 wait complete. 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc79bf25a80 1 Processor -- start 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc79bf25a80 1 -- start start 2024-04-19T23:46:34.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.882+0000 7fc79bf25a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 0x557aafe7cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.883+0000 7fc79bf25a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aafbd0640 con 0x557aafb95400 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.883+0000 7fc79a6d0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 0x557aafe7cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.883+0000 7fc79a6d0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 0x557aafe7cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40584/0 (socket says 172.21.15.155:40584) 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.883+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 learned_addr learned my addr 172.21.15.155:0/4084871842 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.883+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aafbbcea0 con 0x557aafb95400 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.883+0000 7fc79a6d0700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 0x557aafe7cb00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x557ab0965f80 tx=0x557aafc85f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.883+0000 7fc792ec1700 1 -- 172.21.15.155:0/4084871842 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557aafc4da20 con 0x557aafb95400 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.883+0000 7fc792ec1700 1 -- 172.21.15.155:0/4084871842 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557aafc35c80 con 0x557aafb95400 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.883+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557aafbbc820 con 0x557aafb95400 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.883+0000 7fc792ec1700 1 -- 172.21.15.155:0/4084871842 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557aafc4d600 con 0x557aafb95400 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.883+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557aafbbc9c0 con 0x557aafb95400 2024-04-19T23:46:34.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.884+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.884+0000 7fc792ec1700 1 -- 172.21.15.155:0/4084871842 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557ab0936dc0 con 0x557aafb95400 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.884+0000 7fc792ec1700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557aaff1ac00 0x557aafe7d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc792ec1700 1 -- 172.21.15.155:0/4084871842 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x557aafc0f340 con 0x557aafb95400 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc7996ce700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557aaff1ac00 0x557aafe7d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557aafb95800 0x557aafe7db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aafb95c00 con 0x557aafb95800 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc79a6d0700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557aafb95800 0x557aafe7db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc7996ce700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557aaff1ac00 0x557aafe7d600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x557aafe77890 tx=0x557aafc85800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc79a6d0700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557aafb95800 0x557aafe7db80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc79bf25a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc79bf25a80 20 realm 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.885+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaff1b000 con 0x557aafb95800 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaff1b400 con 0x557aafb95800 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaff1b800 con 0x557aafb95800 2024-04-19T23:46:34.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaff1bc00 con 0x557aafb95800 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 20 searching for the correct realm 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557aaff1b000 0x557aafe7e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.886+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaff1b400 con 0x557aaff1b000 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.887+0000 7fc799ecf700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557aaff1b000 0x557aafe7e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.887+0000 7fc799ecf700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557aaff1b000 0x557aafe7e100 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.887+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.887+0000 7fc799ecf700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557aaff1b400 0x557aafe7ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.887+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0000 con 0x557aaff1b400 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.887+0000 7fc7996ce700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557aaff1b400 0x557aafe7ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.888+0000 7fc7996ce700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557aaff1b400 0x557aafe7ec00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.888+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.888+0000 7fc7996ce700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557aaffe0000 0x557aafe7f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.888+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaffe0000 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.888+0000 7fc79a6d0700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557aaffe0000 0x557aafe7f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.888+0000 7fc79a6d0700 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557aaffe0000 0x557aafe7f180 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.889+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.889+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aafb95800 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.889+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.889+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aafb95800 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.889+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.889+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aafb95800 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.889+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.889+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaffe0000 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.890+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.890+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b400 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.890+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.890+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b000 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.890+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.890+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aafb95800 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.890+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.890+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaffe0000 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.891+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.891+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aafb95800 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.891+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.891+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b400 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.891+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.891+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b000 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.891+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.891+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b000 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.892+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.892+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b400 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.892+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.892+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b000 2024-04-19T23:46:34.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.892+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.892+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b000 2024-04-19T23:46:34.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.892+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.892+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aafb95800 2024-04-19T23:46:34.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.892+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.892+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aafb95800 2024-04-19T23:46:34.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.893+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.893+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaffe0000 2024-04-19T23:46:34.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.893+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.893+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b000 2024-04-19T23:46:34.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.893+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.893+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b400 2024-04-19T23:46:34.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.893+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.893+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aafb95800 2024-04-19T23:46:34.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.894+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.894+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaffe0000 2024-04-19T23:46:34.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.894+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.894+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b000 2024-04-19T23:46:34.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.894+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.894+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaffe0000 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.895+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.895+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b400 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.895+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.895+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b000 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.895+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.895+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaffe0000 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.895+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.895+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aafb95800 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b400 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aafb95c00 con 0x557aafb95800 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0c00 con 0x557aafb95800 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:34.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe1000 con 0x557aaff1b400 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.896+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 20 zone default found 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 4 Realm: () 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 20 zonegroup default 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe1400 con 0x557aaffe0000 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe1800 con 0x557aaff1b000 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe1c00 con 0x557aaff1b000 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 20 started sync module instance, tier type = 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.897+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0c00 con 0x557aaff1b400 2024-04-19T23:46:34.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.898+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.898+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93985425537792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aafb95c00 con 0x557aaff1b400 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.898+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaff1b800 con 0x557aafb95800 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.899+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93985425537792] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.900+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.900+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93985425538944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaff1bc00 con 0x557aafb95800 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.900+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaff1b000 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.901+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.901+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93985425540096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe1000 con 0x557aaff1b000 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.901+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0c00 con 0x557aaff1b400 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.901+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93985425538944] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.902+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.902+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93985425541248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0400 con 0x557aaff1b400 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.902+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe1800 con 0x557aafb95800 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.902+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93985425540096] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.903+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93985425541248] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.903+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.903+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93985425542400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe1c00 con 0x557aafb95800 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.903+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe0800 con 0x557aaffe0000 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.904+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93985425542400] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.904+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.905+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93985425543552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe1400 con 0x557aaffe0000 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.905+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe1800 con 0x557aaffe0000 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.906+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93985425543552] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.906+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.906+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93985425544704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe1c00 con 0x557aaffe0000 2024-04-19T23:46:34.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.906+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaff1b800 con 0x557aaffe0000 2024-04-19T23:46:34.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.907+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93985425544704] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.907+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.907+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93985425545856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaff1bc00 con 0x557aaffe0000 2024-04-19T23:46:34.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.907+0000 7fc79bf25a80 20 add_watcher() i=0 2024-04-19T23:46:34.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.907+0000 7fc79bf25a80 20 add_watcher() i=1 2024-04-19T23:46:34.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.907+0000 7fc79bf25a80 20 add_watcher() i=2 2024-04-19T23:46:34.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.907+0000 7fc79bf25a80 20 add_watcher() i=3 2024-04-19T23:46:34.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.907+0000 7fc79bf25a80 20 add_watcher() i=4 2024-04-19T23:46:34.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.907+0000 7fc79bf25a80 20 add_watcher() i=5 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.907+0000 7fc79bf25a80 20 add_watcher() i=6 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.908+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93985425545856] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.908+0000 7fc79bf25a80 20 add_watcher() i=7 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.908+0000 7fc79bf25a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.908+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaff1b800 con 0x557aafb95800 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.908+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.908+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93985427095552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaff1bc00 con 0x557aafb95800 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.909+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93985427095552] v32'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.909+0000 7fc780e9d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.909+0000 7fc79bf25a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.909+0000 7fc79bf25a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.909+0000 7fc79bf25a80 1 Processor -- start 2024-04-19T23:46:34.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.910+0000 7fc79bf25a80 1 -- start start 2024-04-19T23:46:34.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.910+0000 7fc79bf25a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.910+0000 7fc79bf25a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aafbd0780 con 0x557aaffe1400 2024-04-19T23:46:34.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.910+0000 7fc7996ce700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.910+0000 7fc7996ce700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40594/0 (socket says 172.21.15.155:40594) 2024-04-19T23:46:34.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.910+0000 7fc7996ce700 1 -- 172.21.15.155:0/595728229 learned_addr learned my addr 172.21.15.155:0/595728229 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.910+0000 7fc7996ce700 1 -- 172.21.15.155:0/595728229 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aafbbcb60 con 0x557aaffe1400 2024-04-19T23:46:34.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.910+0000 7fc7996ce700 1 --2- 172.21.15.155:0/595728229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x557aaff2f440 tx=0x557aafee1da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451f0ddcdf1324bc server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.910+0000 7fc78069c700 1 -- 172.21.15.155:0/595728229 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557aafc4d760 con 0x557aaffe1400 2024-04-19T23:46:34.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.911+0000 7fc78069c700 1 -- 172.21.15.155:0/595728229 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ab0008000 con 0x557aaffe1400 2024-04-19T23:46:34.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.911+0000 7fc78069c700 1 -- 172.21.15.155:0/595728229 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ab000a000 con 0x557aaffe1400 2024-04-19T23:46:34.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.911+0000 7fc79bf25a80 1 -- 172.21.15.155:0/595728229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 msgr2=0x557aafe7e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.911+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/595728229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x557aaff2f440 tx=0x557aafee1da0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.911+0000 7fc79bf25a80 1 -- 172.21.15.155:0/595728229 shutdown_connections 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.911+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/595728229 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.911+0000 7fc79bf25a80 1 -- 172.21.15.155:0/595728229 >> 172.21.15.155:0/595728229 conn(0x557aaffe0800 msgr2=0x557aafc82000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.911+0000 7fc79bf25a80 1 -- 172.21.15.155:0/595728229 shutdown_connections 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.911+0000 7fc79bf25a80 1 -- 172.21.15.155:0/595728229 wait complete. 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.911+0000 7fc79bf25a80 1 Processor -- start 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.911+0000 7fc79bf25a80 1 -- start start 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc79bf25a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc79bf25a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aafc36000 con 0x557aaffe1400 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc7996ce700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc7996ce700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40604/0 (socket says 172.21.15.155:40604) 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc7996ce700 1 -- 172.21.15.155:0/1939201140 learned_addr learned my addr 172.21.15.155:0/1939201140 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc7996ce700 1 -- 172.21.15.155:0/1939201140 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aafbbcd00 con 0x557aaffe1400 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc7996ce700 1 --2- 172.21.15.155:0/1939201140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x557aafff5200 tx=0x557aafc85980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc77ee99700 1 -- 172.21.15.155:0/1939201140 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ab000a160 con 0x557aaffe1400 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc77ee99700 1 -- 172.21.15.155:0/1939201140 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ab0008180 con 0x557aaffe1400 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1939201140 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557aafbbc340 con 0x557aaffe1400 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc77ee99700 1 -- 172.21.15.155:0/1939201140 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ab000a2c0 con 0x557aaffe1400 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.912+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1939201140 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557aafbbdd40 con 0x557aaffe1400 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.913+0000 7fc77ee99700 1 -- 172.21.15.155:0/1939201140 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557ab0937b80 con 0x557aaffe1400 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.913+0000 7fc77ee99700 1 --2- 172.21.15.155:0/1939201140 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557ab0080000 0x557aafe7f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.913+0000 7fc77ee99700 1 -- 172.21.15.155:0/1939201140 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x557aafc0f500 con 0x557aaffe1400 2024-04-19T23:46:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.913+0000 7fc79a6d0700 1 --2- 172.21.15.155:0/1939201140 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557ab0080000 0x557aafe7f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.913+0000 7fc79bf25a80 5 note: GC not initialized 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.914+0000 7fc79a6d0700 1 --2- 172.21.15.155:0/1939201140 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557ab0080000 0x557aafe7f700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x557aaff77f50 tx=0x557aafee1bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.914+0000 7fc77c694700 20 reqs_thread_entry: start 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.915+0000 7fc79bf25a80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.915+0000 7fc79bf25a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.915+0000 7fc77a690700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:05 2024 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.915+0000 7fc779e6e700 20 reqs_thread_entry: start 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.915+0000 7fc79bf25a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.915+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557aaffe1c00 con 0x557aafb95800 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.915+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.915+0000 7fc79bf25a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:46:34.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.915+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557ab0080400 con 0x557aaffe0000 2024-04-19T23:46:34.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.916+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.935 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:46:34.935 INFO:teuthology.orchestra.run.smithi155.stdout: "entries": [ 2024-04-19T23:46:34.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.935 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:34.935 INFO:teuthology.orchestra.run.smithi155.stdout: "buckets": [ 2024-04-19T23:46:34.935 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "", 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "list_buckets", 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 322, 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.936 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo", 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.937 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.938 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 5, 2024-04-19T23:46:34.938 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 5 2024-04-19T23:46:34.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.938 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.938 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:34.938 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 236, 2024-04-19T23:46:34.938 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.938 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 2, 2024-04-19T23:46:34.938 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.938 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_obj", 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 4, 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "get_acls", 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 1026, 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 2, 2024-04-19T23:46:34.939 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 2 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "get_obj", 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 4, 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "list_bucket", 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 515, 2024-04-19T23:46:34.940 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "put_acls", 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 2, 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 2 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "put_obj", 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.941 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 30000042, 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 11, 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 11 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo2", 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.942 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.943 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.944 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.944 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.944 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.944 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.917+0000 7fc780e9d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.917+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93985427095552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557ab0080800 con 0x557aafb95800 2024-04-19T23:46:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.918+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93985427095552] v32'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.918+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93985425537792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557ab0080c00 con 0x557aaff1b400 2024-04-19T23:46:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.919+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93985425537792] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.919+0000 7fc79bf25a80 20 remove_watcher() i=0 2024-04-19T23:46:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.919+0000 7fc79bf25a80 2 removed watcher, disabling cache 2024-04-19T23:46:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.919+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93985425538944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557ab0081000 con 0x557aafb95800 2024-04-19T23:46:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.920+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93985425538944] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.920+0000 7fc79bf25a80 20 remove_watcher() i=1 2024-04-19T23:46:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.920+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93985425540096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557ab0081400 con 0x557aaff1b000 2024-04-19T23:46:34.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.922+0000 7fc799ecf700 1 -- 172.21.15.155:0/4084871842 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93985425540096] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc5200 con 0x557aaff1b000 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.922+0000 7fc79bf25a80 20 remove_watcher() i=2 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.922+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93985425541248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557ab0081800 con 0x557aaff1b400 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.923+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93985425541248] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc5440 con 0x557aaff1b400 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.923+0000 7fc79bf25a80 20 remove_watcher() i=3 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.923+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93985425542400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557ab0081c00 con 0x557aafb95800 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.924+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93985425542400] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aafb95800 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.924+0000 7fc79bf25a80 20 remove_watcher() i=4 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.924+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93985425543552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557ab0080400 con 0x557aaffe0000 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.925+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93985425543552] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.925+0000 7fc79bf25a80 20 remove_watcher() i=5 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.925+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93985425544704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557ab0080800 con 0x557aaffe0000 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.926+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93985425544704] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.926+0000 7fc79bf25a80 20 remove_watcher() i=6 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.926+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93985425545856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557ab0081000 con 0x557aaffe0000 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.927+0000 7fc79a6d0700 1 -- 172.21.15.155:0/4084871842 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93985425545856] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557aaffc4b40 con 0x557aaffe0000 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.927+0000 7fc79bf25a80 20 remove_watcher() i=7 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.927+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557aaffe0000 msgr2=0x557aafe7f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.927+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557aaffe0000 0x557aafe7f180 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.927+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557aafb95800 msgr2=0x557aafe7db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.927+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557aafb95800 0x557aafe7db80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.927+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557aaff1b400 msgr2=0x557aafe7ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.927+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557aaff1b400 0x557aafe7ec00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.927+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557aaff1b000 msgr2=0x557aafe7e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.927+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557aaff1b000 0x557aafe7e100 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557aaff1ac00 msgr2=0x557aafe7d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557aaff1ac00 0x557aafe7d600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x557aafe77890 tx=0x557aafc85800 comp rx=0 tx=0).stop 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 msgr2=0x557aafe7cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/4084871842 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb95400 0x557aafe7cb00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x557ab0965f80 tx=0x557aafc85f20 comp rx=0 tx=0).stop 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 reap_dead start 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc7996ce700 1 -- 172.21.15.155:0/4084871842 reap_dead start 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 shutdown_connections 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 >> 172.21.15.155:0/4084871842 conn(0x557aafb94c00 msgr2=0x557aafc81800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 shutdown_connections 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/4084871842 wait complete. 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1939201140 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557ab0080000 msgr2=0x557aafe7f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/1939201140 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557ab0080000 0x557aafe7f700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x557aaff77f50 tx=0x557aafee1bc0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1939201140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 msgr2=0x557aafe7e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/1939201140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x557aafff5200 tx=0x557aafc85980 comp rx=0 tx=0).stop 2024-04-19T23:46:34.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1939201140 shutdown_connections 2024-04-19T23:46:34.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/1939201140 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557ab0080000 0x557aafe7f700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/1939201140 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aaffe1400 0x557aafe7e680 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1939201140 >> 172.21.15.155:0/1939201140 conn(0x557aaffe0800 msgr2=0x557aafc82000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1939201140 shutdown_connections 2024-04-19T23:46:34.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/1939201140 wait complete. 2024-04-19T23:46:34.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3332106965 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557aaff1a000 msgr2=0x557aafe7d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/3332106965 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557aaff1a000 0x557aafe7d080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x557ab0a26f00 tx=0x557aafee0240 comp rx=0 tx=0).stop 2024-04-19T23:46:34.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3332106965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 msgr2=0x557aafe7c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:34.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.928+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/3332106965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x557ab0965e30 tx=0x557aafc85a40 comp rx=0 tx=0).stop 2024-04-19T23:46:34.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.929+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3332106965 shutdown_connections 2024-04-19T23:46:34.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.929+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/3332106965 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557aaff1a000 0x557aafe7d080 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.929+0000 7fc79bf25a80 1 --2- 172.21.15.155:0/3332106965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557aafb94800 0x557aafe7c580 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:34.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.929+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3332106965 >> 172.21.15.155:0/3332106965 conn(0x557aafb94400 msgr2=0x557aafc81000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:34.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.929+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3332106965 shutdown_connections 2024-04-19T23:46:34.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:34.929+0000 7fc79bf25a80 1 -- 172.21.15.155:0/3332106965 wait complete. 2024-04-19T23:46:34.956 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo3", 2024-04-19T23:46:34.956 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.956 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.956 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.956 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.956 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.956 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:34.956 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.957 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo4", 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.958 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.959 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: "summary": [ 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 8, 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 8 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.960 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 236, 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 5, 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_obj", 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 4, 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:34.961 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "get_acls", 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 1026, 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 2, 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 2 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "get_obj", 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 4, 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.962 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "list_bucket", 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 515, 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "list_buckets", 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 322, 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.963 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "put_acls", 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 2, 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 2 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "put_obj", 2024-04-19T23:46:34.964 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 30000042, 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 11, 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 11 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: "total": { 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 2103, 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 30000042, 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 35, 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 34 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.965 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:34.966 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:34.966 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:46:34.966 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-19T23:46:34.966 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-19T23:46:34.966 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-19T23:46:34.967 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-04-19T23:46:35.014 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:35.014 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:35.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.015+0000 7fb173feda80 1 Processor -- start 2024-04-19T23:46:35.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.015+0000 7fb173feda80 1 -- start start 2024-04-19T23:46:35.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.015+0000 7fb173feda80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.015+0000 7fb173feda80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e0cab9d500 con 0x55e0ca872c00 2024-04-19T23:46:35.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.015+0000 7fb173feda80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e0ca914a00 con 0x55e0ca872800 2024-04-19T23:46:35.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.015+0000 7fb171f97700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.015+0000 7fb171f97700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40620/0 (socket says 172.21.15.155:40620) 2024-04-19T23:46:35.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.015+0000 7fb171796700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55e0ca872c00 0x55e0ca95e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55674/0 (socket says 172.21.15.155:55674) 2024-04-19T23:46:35.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.015+0000 7fb171f97700 1 -- 172.21.15.155:0/4022209351 learned_addr learned my addr 172.21.15.155:0/4022209351 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.016+0000 7fb171f97700 1 -- 172.21.15.155:0/4022209351 >> v1:172.21.15.76:6789/0 conn(0x55e0ca872c00 legacy=0x55e0ca95e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.016+0000 7fb171f97700 1 -- 172.21.15.155:0/4022209351 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0ca89bd40 con 0x55e0ca872800 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.016+0000 7fb170f95700 1 -- 172.21.15.155:0/4022209351 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927711113 0 0) 0x55e0cb640000 con 0x55e0ca872c00 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.016+0000 7fb171f97700 1 --2- 172.21.15.155:0/4022209351 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x55e0cab559e0 tx=0x55e0ca963920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f6d710e169ed1f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.016+0000 7fb170f95700 1 -- 172.21.15.155:0/4022209351 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0ca92b4a0 con 0x55e0ca872800 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.016+0000 7fb170f95700 1 -- 172.21.15.155:0/4022209351 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0cab9d800 con 0x55e0ca872800 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.016+0000 7fb170f95700 1 -- 172.21.15.155:0/4022209351 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0ca92b600 con 0x55e0ca872800 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.016+0000 7fb173feda80 1 -- 172.21.15.155:0/4022209351 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 msgr2=0x55e0cab5a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.016+0000 7fb173feda80 1 --2- 172.21.15.155:0/4022209351 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x55e0cab559e0 tx=0x55e0ca963920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.017+0000 7fb173feda80 1 -- 172.21.15.155:0/4022209351 shutdown_connections 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.017+0000 7fb173feda80 1 --2- 172.21.15.155:0/4022209351 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.017+0000 7fb173feda80 1 -- 172.21.15.155:0/4022209351 >> 172.21.15.155:0/4022209351 conn(0x55e0ca872400 msgr2=0x55e0ca95e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.017+0000 7fb173feda80 1 -- 172.21.15.155:0/4022209351 shutdown_connections 2024-04-19T23:46:35.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.017+0000 7fb173feda80 1 -- 172.21.15.155:0/4022209351 wait complete. 2024-04-19T23:46:35.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.017+0000 7fb173feda80 1 Processor -- start 2024-04-19T23:46:35.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.017+0000 7fb173feda80 1 -- start start 2024-04-19T23:46:35.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.018+0000 7fb173feda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.018+0000 7fb173feda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ca914500 con 0x55e0ca872800 2024-04-19T23:46:35.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.018+0000 7fb171f97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.018+0000 7fb171f97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40624/0 (socket says 172.21.15.155:40624) 2024-04-19T23:46:35.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.018+0000 7fb171f97700 1 -- 172.21.15.155:0/2762892234 learned_addr learned my addr 172.21.15.155:0/2762892234 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.018+0000 7fb171f97700 1 -- 172.21.15.155:0/2762892234 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0ca89bba0 con 0x55e0ca872800 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.018+0000 7fb171f97700 1 --2- 172.21.15.155:0/2762892234 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x55e0cab55f50 tx=0x55e0ca963800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ec045b3e777dcb server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.018+0000 7fb170794700 1 -- 172.21.15.155:0/2762892234 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0ca92b760 con 0x55e0ca872800 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.018+0000 7fb170794700 1 -- 172.21.15.155:0/2762892234 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0cab9db00 con 0x55e0ca872800 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.018+0000 7fb170794700 1 -- 172.21.15.155:0/2762892234 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0ca92b4a0 con 0x55e0ca872800 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.019+0000 7fb173feda80 1 -- 172.21.15.155:0/2762892234 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 msgr2=0x55e0cab5a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.019+0000 7fb173feda80 1 --2- 172.21.15.155:0/2762892234 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x55e0cab55f50 tx=0x55e0ca963800 comp rx=0 tx=0).stop 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.019+0000 7fb173feda80 1 -- 172.21.15.155:0/2762892234 shutdown_connections 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.019+0000 7fb173feda80 1 --2- 172.21.15.155:0/2762892234 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.019+0000 7fb173feda80 1 -- 172.21.15.155:0/2762892234 >> 172.21.15.155:0/2762892234 conn(0x55e0ca872400 msgr2=0x55e0ca95f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.019+0000 7fb173feda80 1 -- 172.21.15.155:0/2762892234 shutdown_connections 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.019+0000 7fb173feda80 1 -- 172.21.15.155:0/2762892234 wait complete. 2024-04-19T23:46:35.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.019+0000 7fb173feda80 1 Processor -- start 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.019+0000 7fb173feda80 1 -- start start 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.020+0000 7fb173feda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.020+0000 7fb173feda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ca9143c0 con 0x55e0ca872800 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.020+0000 7fb171f97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.020+0000 7fb171f97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40638/0 (socket says 172.21.15.155:40638) 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.020+0000 7fb171f97700 1 -- 172.21.15.155:0/703612947 learned_addr learned my addr 172.21.15.155:0/703612947 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.020+0000 7fb171f97700 1 -- 172.21.15.155:0/703612947 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0ca89ba00 con 0x55e0ca872800 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.020+0000 7fb171f97700 1 --2- 172.21.15.155:0/703612947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x55e0cb639980 tx=0x55e0ca963920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.020+0000 7fb16ef91700 1 -- 172.21.15.155:0/703612947 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0ca92b600 con 0x55e0ca872800 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.020+0000 7fb16ef91700 1 -- 172.21.15.155:0/703612947 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0cab9dc80 con 0x55e0ca872800 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.020+0000 7fb173feda80 1 -- 172.21.15.155:0/703612947 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0ca89b860 con 0x55e0ca872800 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.020+0000 7fb16ef91700 1 -- 172.21.15.155:0/703612947 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0ca92b8c0 con 0x55e0ca872800 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.021+0000 7fb173feda80 1 -- 172.21.15.155:0/703612947 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0ca89b6c0 con 0x55e0ca872800 2024-04-19T23:46:35.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.021+0000 7fb173feda80 1 Processor -- start 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.021+0000 7fb173feda80 1 -- start start 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.021+0000 7fb173feda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 0x55e0cab5ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.021+0000 7fb173feda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ca914000 con 0x55e0ca873400 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.021+0000 7fb16ef91700 1 -- 172.21.15.155:0/703612947 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55e0cb614b00 con 0x55e0ca872800 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.021+0000 7fb172798700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 0x55e0cab5ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.021+0000 7fb172798700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 0x55e0cab5ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40648/0 (socket says 172.21.15.155:40648) 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.021+0000 7fb172798700 1 -- 172.21.15.155:0/396107665 learned_addr learned my addr 172.21.15.155:0/396107665 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.021+0000 7fb16ef91700 1 --2- 172.21.15.155:0/703612947 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cabf4000 0x55e0cab5b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb16ef91700 1 -- 172.21.15.155:0/703612947 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55e0ca8ed180 con 0x55e0ca872800 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb171f97700 1 --2- 172.21.15.155:0/703612947 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cabf4000 0x55e0cab5b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb172798700 1 -- 172.21.15.155:0/396107665 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0ca89a000 con 0x55e0ca873400 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb172798700 1 --2- 172.21.15.155:0/396107665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 0x55e0cab5ab00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x55e0cb705ec0 tx=0x55e0cabbc780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deed2f0fcfa83fc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb171f97700 1 --2- 172.21.15.155:0/703612947 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cabf4000 0x55e0cab5b080 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55e0cb704f60 tx=0x55e0cabbc8a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb16c78c700 1 -- 172.21.15.155:0/396107665 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0ca92b600 con 0x55e0ca873400 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb16c78c700 1 -- 172.21.15.155:0/396107665 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0ca913c80 con 0x55e0ca873400 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb16c78c700 1 -- 172.21.15.155:0/396107665 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0ca92b8c0 con 0x55e0ca873400 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb173feda80 1 -- 172.21.15.155:0/396107665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 msgr2=0x55e0cab5ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb173feda80 1 --2- 172.21.15.155:0/396107665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 0x55e0cab5ab00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x55e0cb705ec0 tx=0x55e0cabbc780 comp rx=0 tx=0).stop 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb173feda80 1 -- 172.21.15.155:0/396107665 shutdown_connections 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb173feda80 1 --2- 172.21.15.155:0/396107665 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 0x55e0cab5ab00 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.022+0000 7fb173feda80 1 -- 172.21.15.155:0/396107665 >> 172.21.15.155:0/396107665 conn(0x55e0ca872c00 msgr2=0x55e0ca95f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.023+0000 7fb173feda80 1 -- 172.21.15.155:0/396107665 shutdown_connections 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.023+0000 7fb173feda80 1 -- 172.21.15.155:0/396107665 wait complete. 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.023+0000 7fb173feda80 1 Processor -- start 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.023+0000 7fb173feda80 1 -- start start 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.023+0000 7fb173feda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 0x55e0cab5ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.023+0000 7fb173feda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ca8ae640 con 0x55e0ca873400 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.023+0000 7fb172798700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 0x55e0cab5ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.023+0000 7fb172798700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 0x55e0cab5ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40652/0 (socket says 172.21.15.155:40652) 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.023+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 learned_addr learned my addr 172.21.15.155:0/2320660948 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.023+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0ca89aea0 con 0x55e0ca873400 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.024+0000 7fb172798700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 0x55e0cab5ab00 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55e0cb7040f0 tx=0x55e0cabbc5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.024+0000 7fb16af89700 1 -- 172.21.15.155:0/2320660948 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0ca92b760 con 0x55e0ca873400 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.024+0000 7fb16af89700 1 -- 172.21.15.155:0/2320660948 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0ca913b00 con 0x55e0ca873400 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.024+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0ca89a820 con 0x55e0ca873400 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.024+0000 7fb16af89700 1 -- 172.21.15.155:0/2320660948 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0ca92b600 con 0x55e0ca873400 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.024+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0ca89a9c0 con 0x55e0ca873400 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.025+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.025+0000 7fb16af89700 1 -- 172.21.15.155:0/2320660948 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55e0cb614dc0 con 0x55e0ca873400 2024-04-19T23:46:35.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.025+0000 7fb16af89700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cabf4c00 0x55e0cab5b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.025+0000 7fb16af89700 1 -- 172.21.15.155:0/2320660948 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55e0ca8ed340 con 0x55e0ca873400 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.025+0000 7fb171796700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cabf4c00 0x55e0cab5b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.025+0000 7fb173feda80 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55e0ca873800 0x55e0cab5bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.025+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0ca873c00 con 0x55e0ca873800 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.025+0000 7fb172798700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55e0ca873800 0x55e0cab5bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb171796700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cabf4c00 0x55e0cab5b600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55e0cac13d70 tx=0x55e0cabbd920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb172798700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55e0ca873800 0x55e0cab5bb80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 20 realm 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cabf5000 con 0x55e0ca873800 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cabf5400 con 0x55e0ca873800 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cabf5800 con 0x55e0ca873800 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.026+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cabf5c00 con 0x55e0ca873800 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.027+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.027+0000 7fb173feda80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.027+0000 7fb173feda80 20 searching for the correct realm 2024-04-19T23:46:35.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.027+0000 7fb173feda80 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55e0cabf5000 0x55e0cab5c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.027+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cabf5400 con 0x55e0cabf5000 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.027+0000 7fb171f97700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55e0cabf5000 0x55e0cab5c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.027+0000 7fb171f97700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55e0cabf5000 0x55e0cab5c100 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.027+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.027+0000 7fb171f97700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55e0cabf5400 0x55e0cab5cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.027+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe000 con 0x55e0cabf5400 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.028+0000 7fb171796700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55e0cabf5400 0x55e0cab5cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.028+0000 7fb171796700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55e0cabf5400 0x55e0cab5cc00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.028+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.028+0000 7fb171796700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55e0cb6fe000 0x55e0cab5d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.028+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cb6fe000 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.028+0000 7fb172798700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55e0cb6fe000 0x55e0cab5d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.029+0000 7fb172798700 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55e0cb6fe000 0x55e0cab5d180 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.029+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.029+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0ca873800 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.029+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.029+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0ca873800 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.030+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.030+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0ca873800 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.030+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.030+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cb6fe000 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.030+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.030+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5400 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.030+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.030+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5000 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.030+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.030+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0ca873800 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.031+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.031+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cb6fe000 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.031+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.031+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0ca873800 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.031+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.031+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5400 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.032+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.032+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5000 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.032+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.032+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5000 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.032+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.032+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5400 2024-04-19T23:46:35.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.032+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.032+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5000 2024-04-19T23:46:35.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.032+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.032+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5000 2024-04-19T23:46:35.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.033+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.033+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0ca873800 2024-04-19T23:46:35.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.033+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.033+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0ca873800 2024-04-19T23:46:35.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.033+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.033+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cb6fe000 2024-04-19T23:46:35.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.034+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.034+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5000 2024-04-19T23:46:35.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.034+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.034+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5400 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.034+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.034+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0ca873800 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.034+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.034+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cb6fe000 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.035+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.035+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5000 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.035+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.035+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cb6fe000 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.035+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.035+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5400 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.036+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.036+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5000 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.036+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.036+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cb6fe000 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.036+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.036+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0ca873800 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.036+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.036+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5400 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0ca873c00 con 0x55e0ca873800 2024-04-19T23:46:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fec00 con 0x55e0ca873800 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6ff000 con 0x55e0cabf5400 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 zone default found 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 4 Realm: () 2024-04-19T23:46:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 zonegroup default 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.037+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6ff400 con 0x55e0cb6fe000 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb173feda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6ff800 con 0x55e0cabf5000 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb173feda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6ffc00 con 0x55e0cabf5000 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb173feda80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb173feda80 20 started sync module instance, tier type = 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb173feda80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.038+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fec00 con 0x55e0cabf5400 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.039+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.039+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94423961901824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0ca873c00 con 0x55e0cabf5400 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.039+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cabf5800 con 0x55e0ca873800 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.040+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94423961901824] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.040+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.041+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94423961902976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cabf5c00 con 0x55e0ca873800 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.041+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cabf5000 2024-04-19T23:46:35.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.042+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94423961902976] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.042+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.042+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94423961904128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6ff000 con 0x55e0cabf5000 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.042+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fec00 con 0x55e0cabf5400 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.043+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.043+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94423961905280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe400 con 0x55e0cabf5400 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.043+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6ff800 con 0x55e0ca873800 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.043+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94423961904128] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.044+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94423961905280] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.044+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.044+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94423961906432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6ffc00 con 0x55e0ca873800 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.044+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6fe800 con 0x55e0cb6fe000 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.045+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.045+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94423961907584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6ff400 con 0x55e0cb6fe000 2024-04-19T23:46:35.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.045+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6ff800 con 0x55e0cb6fe000 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.045+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94423961906432] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.046+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94423961907584] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.046+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.046+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94423961908736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6ffc00 con 0x55e0cb6fe000 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.046+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cabf5800 con 0x55e0cb6fe000 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.048+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94423961908736] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.048+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.048+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94423961909888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cabf5c00 con 0x55e0cb6fe000 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.048+0000 7fb173feda80 20 add_watcher() i=0 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.048+0000 7fb173feda80 20 add_watcher() i=1 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.048+0000 7fb173feda80 20 add_watcher() i=2 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.048+0000 7fb173feda80 20 add_watcher() i=3 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.048+0000 7fb173feda80 20 add_watcher() i=4 2024-04-19T23:46:35.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.048+0000 7fb173feda80 20 add_watcher() i=5 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.048+0000 7fb173feda80 20 add_watcher() i=6 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.049+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94423961909888] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.049+0000 7fb173feda80 20 add_watcher() i=7 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.049+0000 7fb173feda80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.049+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cabf5800 con 0x55e0ca873800 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.049+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.049+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94423963435008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cabf5c00 con 0x55e0ca873800 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.050+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94423963435008] v32'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.050+0000 7fb158f65700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.050+0000 7fb173feda80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.050+0000 7fb173feda80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.050+0000 7fb173feda80 1 Processor -- start 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.050+0000 7fb173feda80 1 -- start start 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.050+0000 7fb173feda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.065 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.050+0000 7fb173feda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ca8ae780 con 0x55e0cb6ff400 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.051+0000 7fb171796700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.051+0000 7fb171796700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40654/0 (socket says 172.21.15.155:40654) 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.051+0000 7fb171796700 1 -- 172.21.15.155:0/3882136340 learned_addr learned my addr 172.21.15.155:0/3882136340 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.051+0000 7fb171796700 1 -- 172.21.15.155:0/3882136340 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0ca89ab60 con 0x55e0cb6ff400 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.051+0000 7fb171796700 1 --2- 172.21.15.155:0/3882136340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x55e0cac5fe30 tx=0x55e0cabbdd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed43b4343af7d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.051+0000 7fb158764700 1 -- 172.21.15.155:0/3882136340 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0cacde000 con 0x55e0cb6ff400 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.051+0000 7fb158764700 1 -- 172.21.15.155:0/3882136340 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0cace6000 con 0x55e0cb6ff400 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.051+0000 7fb158764700 1 -- 172.21.15.155:0/3882136340 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0cacde160 con 0x55e0cb6ff400 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.052+0000 7fb173feda80 1 -- 172.21.15.155:0/3882136340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 msgr2=0x55e0cab5c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.052+0000 7fb173feda80 1 --2- 172.21.15.155:0/3882136340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x55e0cac5fe30 tx=0x55e0cabbdd40 comp rx=0 tx=0).stop 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.052+0000 7fb173feda80 1 -- 172.21.15.155:0/3882136340 shutdown_connections 2024-04-19T23:46:35.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.052+0000 7fb173feda80 1 --2- 172.21.15.155:0/3882136340 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.052+0000 7fb173feda80 1 -- 172.21.15.155:0/3882136340 >> 172.21.15.155:0/3882136340 conn(0x55e0cb6fe800 msgr2=0x55e0ca960000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.052+0000 7fb173feda80 1 -- 172.21.15.155:0/3882136340 shutdown_connections 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.052+0000 7fb173feda80 1 -- 172.21.15.155:0/3882136340 wait complete. 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.052+0000 7fb173feda80 1 Processor -- start 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.052+0000 7fb173feda80 1 -- start start 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.053+0000 7fb173feda80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.053+0000 7fb173feda80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ca914000 con 0x55e0cb6ff400 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.053+0000 7fb171796700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.053+0000 7fb171796700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40664/0 (socket says 172.21.15.155:40664) 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.053+0000 7fb171796700 1 -- 172.21.15.155:0/1029796609 learned_addr learned my addr 172.21.15.155:0/1029796609 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.053+0000 7fb171796700 1 -- 172.21.15.155:0/1029796609 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0ca89ad00 con 0x55e0cb6ff400 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.053+0000 7fb171796700 1 --2- 172.21.15.155:0/1029796609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x55e0cace3290 tx=0x55e0cabbde60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.053+0000 7fb156f61700 1 -- 172.21.15.155:0/1029796609 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0cacde2c0 con 0x55e0cb6ff400 2024-04-19T23:46:35.067 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.053+0000 7fb156f61700 1 -- 172.21.15.155:0/1029796609 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0cace6180 con 0x55e0cb6ff400 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.053+0000 7fb156f61700 1 -- 172.21.15.155:0/1029796609 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0cacde000 con 0x55e0cb6ff400 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.053+0000 7fb173feda80 1 -- 172.21.15.155:0/1029796609 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0ca89a340 con 0x55e0cb6ff400 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.054+0000 7fb173feda80 1 -- 172.21.15.155:0/1029796609 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0ca89ab60 con 0x55e0cb6ff400 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.054+0000 7fb156f61700 1 -- 172.21.15.155:0/1029796609 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55e0cb615b80 con 0x55e0cb6ff400 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.054+0000 7fb156f61700 1 --2- 172.21.15.155:0/1029796609 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cad62000 0x55e0cab5d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.054+0000 7fb156f61700 1 -- 172.21.15.155:0/1029796609 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55e0ca8ed500 con 0x55e0cb6ff400 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.055+0000 7fb173feda80 5 note: GC not initialized 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.055+0000 7fb172798700 1 --2- 172.21.15.155:0/1029796609 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cad62000 0x55e0cab5d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.055+0000 7fb172798700 1 --2- 172.21.15.155:0/1029796609 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cad62000 0x55e0cab5d700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55e0cac5fce0 tx=0x55e0cabbdb60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.055+0000 7fb15475c700 20 reqs_thread_entry: start 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.056+0000 7fb173feda80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.056+0000 7fb173feda80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.056+0000 7fb152758700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:05 2024 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:35.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.056+0000 7fb151f36700 20 reqs_thread_entry: start 2024-04-19T23:46:35.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.056+0000 7fb173feda80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.056+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cb6ffc00 con 0x55e0ca873800 2024-04-19T23:46:35.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.056+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.056+0000 7fb173feda80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:46:35.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.056+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cad62400 con 0x55e0cb6fe000 2024-04-19T23:46:35.069 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.057+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.058+0000 7fb158f65700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.074 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.058+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94423963435008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cad62800 con 0x55e0ca873800 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.059+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94423963435008] v32'204 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.059+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94423961901824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cad62c00 con 0x55e0cabf5400 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.060+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94423961901824] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.060+0000 7fb173feda80 20 remove_watcher() i=0 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.060+0000 7fb173feda80 2 removed watcher, disabling cache 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.060+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94423961902976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cad63000 con 0x55e0ca873800 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.061+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94423961902976] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.062+0000 7fb173feda80 20 remove_watcher() i=1 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.062+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94423961904128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cad63400 con 0x55e0cabf5000 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.063+0000 7fb171f97700 1 -- 172.21.15.155:0/2320660948 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94423961904128] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac65200 con 0x55e0cabf5000 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.063+0000 7fb173feda80 20 remove_watcher() i=2 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.063+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94423961905280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cad63800 con 0x55e0cabf5400 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.064+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94423961905280] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac65440 con 0x55e0cabf5400 2024-04-19T23:46:35.075 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.064+0000 7fb173feda80 20 remove_watcher() i=3 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.064+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94423961906432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cad63c00 con 0x55e0ca873800 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.065+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94423961906432] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0ca873800 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.065+0000 7fb173feda80 20 remove_watcher() i=4 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.065+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94423961907584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cad62400 con 0x55e0cb6fe000 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.066+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94423961907584] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.066+0000 7fb173feda80 20 remove_watcher() i=5 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.066+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94423961908736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cad62800 con 0x55e0cb6fe000 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.067+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94423961908736] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.067+0000 7fb173feda80 20 remove_watcher() i=6 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.067+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94423961909888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e0cad63000 con 0x55e0cb6fe000 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.068+0000 7fb172798700 1 -- 172.21.15.155:0/2320660948 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94423961909888] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0cac64b40 con 0x55e0cb6fe000 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.068+0000 7fb173feda80 20 remove_watcher() i=7 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55e0cb6fe000 msgr2=0x55e0cab5d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55e0cb6fe000 0x55e0cab5d180 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55e0ca873800 msgr2=0x55e0cab5bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55e0ca873800 0x55e0cab5bb80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55e0cabf5400 msgr2=0x55e0cab5cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55e0cabf5400 0x55e0cab5cc00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55e0cabf5000 msgr2=0x55e0cab5c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55e0cabf5000 0x55e0cab5c100 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cabf4c00 msgr2=0x55e0cab5b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cabf4c00 0x55e0cab5b600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55e0cac13d70 tx=0x55e0cabbd920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 msgr2=0x55e0cab5ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 --2- 172.21.15.155:0/2320660948 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca873400 0x55e0cab5ab00 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55e0cb7040f0 tx=0x55e0cabbc5a0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 reap_dead start 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb171796700 1 -- 172.21.15.155:0/2320660948 reap_dead start 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 shutdown_connections 2024-04-19T23:46:35.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 >> 172.21.15.155:0/2320660948 conn(0x55e0ca872c00 msgr2=0x55e0ca95f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 shutdown_connections 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/2320660948 wait complete. 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/1029796609 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cad62000 msgr2=0x55e0cab5d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 --2- 172.21.15.155:0/1029796609 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cad62000 0x55e0cab5d700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55e0cac5fce0 tx=0x55e0cabbdb60 comp rx=0 tx=0).stop 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/1029796609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 msgr2=0x55e0cab5c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 --2- 172.21.15.155:0/1029796609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x55e0cace3290 tx=0x55e0cabbde60 comp rx=0 tx=0).stop 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/1029796609 shutdown_connections 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 --2- 172.21.15.155:0/1029796609 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cad62000 0x55e0cab5d700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 --2- 172.21.15.155:0/1029796609 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0cb6ff400 0x55e0cab5c680 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/1029796609 >> 172.21.15.155:0/1029796609 conn(0x55e0cb6fe800 msgr2=0x55e0ca960000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/1029796609 shutdown_connections 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.069+0000 7fb173feda80 1 -- 172.21.15.155:0/1029796609 wait complete. 2024-04-19T23:46:35.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.070+0000 7fb173feda80 1 -- 172.21.15.155:0/703612947 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cabf4000 msgr2=0x55e0cab5b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.070+0000 7fb173feda80 1 --2- 172.21.15.155:0/703612947 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cabf4000 0x55e0cab5b080 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55e0cb704f60 tx=0x55e0cabbc8a0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.070+0000 7fb173feda80 1 -- 172.21.15.155:0/703612947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 msgr2=0x55e0cab5a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.070+0000 7fb173feda80 1 --2- 172.21.15.155:0/703612947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x55e0cb639980 tx=0x55e0ca963920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.070+0000 7fb173feda80 1 -- 172.21.15.155:0/703612947 shutdown_connections 2024-04-19T23:46:35.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.070+0000 7fb173feda80 1 --2- 172.21.15.155:0/703612947 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55e0cabf4000 0x55e0cab5b080 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.070+0000 7fb173feda80 1 --2- 172.21.15.155:0/703612947 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55e0ca872800 0x55e0cab5a580 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.070+0000 7fb173feda80 1 -- 172.21.15.155:0/703612947 >> 172.21.15.155:0/703612947 conn(0x55e0ca872400 msgr2=0x55e0ca95f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.070+0000 7fb173feda80 1 -- 172.21.15.155:0/703612947 shutdown_connections 2024-04-19T23:46:35.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.070+0000 7fb173feda80 1 -- 172.21.15.155:0/703612947 wait complete. 2024-04-19T23:46:35.080 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:46:35.080 INFO:teuthology.orchestra.run.smithi155.stdout: "entries": [ 2024-04-19T23:46:35.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.080 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:35.080 INFO:teuthology.orchestra.run.smithi155.stdout: "buckets": [ 2024-04-19T23:46:35.080 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.080 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "", 2024-04-19T23:46:35.080 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo", 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.081 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 5, 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 5 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo2", 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:35.082 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo3", 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.083 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo4", 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.084 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "summary": [ 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.085 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "create_bucket", 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 8, 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 8 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "total": { 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 8, 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 8 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.086 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:46:35.087 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-04-19T23:46:35.087 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-19T23:46:35.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-19T23:46:35.087 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-04-19T23:46:35.134 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:35.134 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:35.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.134+0000 7fdc96dada80 1 Processor -- start 2024-04-19T23:46:35.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.134+0000 7fdc96dada80 1 -- start start 2024-04-19T23:46:35.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.135+0000 7fdc96dada80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55c571106800 0x55c5713ee580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.135+0000 7fdc96dada80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c571431500 con 0x55c571106c00 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.135+0000 7fdc96dada80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c5711a8a00 con 0x55c571106800 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.135+0000 7fdc94d57700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55c571106800 0x55c5713ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.135+0000 7fdc94556700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55c571106c00 0x55c5711f2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55682/0 (socket says 172.21.15.155:55682) 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.135+0000 7fdc94556700 1 -- 172.21.15.155:0/2315721323 learned_addr learned my addr 172.21.15.155:0/2315721323 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.135+0000 7fdc93d55700 1 -- 172.21.15.155:0/2315721323 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903400249 0 0) 0x55c571ed4000 con 0x55c571106c00 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.135+0000 7fdc93d55700 1 -- 172.21.15.155:0/2315721323 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55c571431680 con 0x55c571106c00 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.135+0000 7fdc94d57700 1 -- 172.21.15.155:0/2315721323 >> v1:172.21.15.76:6789/0 conn(0x55c571106c00 legacy=0x55c5711f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.135+0000 7fdc94d57700 1 -- 172.21.15.155:0/2315721323 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c57112fd40 con 0x55c571106800 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.135+0000 7fdc94d57700 1 --2- 172.21.15.155:0/2315721323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55c5713e99e0 tx=0x55c5711f7980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7726d0414dcb79e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.136+0000 7fdc93d55700 1 -- 172.21.15.155:0/2315721323 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c5711bf4a0 con 0x55c571106800 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.136+0000 7fdc93d55700 1 -- 172.21.15.155:0/2315721323 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c571431500 con 0x55c571106800 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.136+0000 7fdc93d55700 1 -- 172.21.15.155:0/2315721323 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c5711bf600 con 0x55c571106800 2024-04-19T23:46:35.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.136+0000 7fdc96dada80 1 -- 172.21.15.155:0/2315721323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 msgr2=0x55c5713ee580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.136+0000 7fdc96dada80 1 --2- 172.21.15.155:0/2315721323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55c5713e99e0 tx=0x55c5711f7980 comp rx=0 tx=0).stop 2024-04-19T23:46:35.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.136+0000 7fdc96dada80 1 -- 172.21.15.155:0/2315721323 shutdown_connections 2024-04-19T23:46:35.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.136+0000 7fdc96dada80 1 --2- 172.21.15.155:0/2315721323 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.136+0000 7fdc96dada80 1 -- 172.21.15.155:0/2315721323 >> 172.21.15.155:0/2315721323 conn(0x55c571106400 msgr2=0x55c5711f2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.136+0000 7fdc96dada80 1 -- 172.21.15.155:0/2315721323 shutdown_connections 2024-04-19T23:46:35.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.136+0000 7fdc96dada80 1 -- 172.21.15.155:0/2315721323 wait complete. 2024-04-19T23:46:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.137+0000 7fdc96dada80 1 Processor -- start 2024-04-19T23:46:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.137+0000 7fdc96dada80 1 -- start start 2024-04-19T23:46:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.137+0000 7fdc96dada80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.137+0000 7fdc96dada80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5711a8500 con 0x55c571106800 2024-04-19T23:46:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.137+0000 7fdc94d57700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.137+0000 7fdc94d57700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40676/0 (socket says 172.21.15.155:40676) 2024-04-19T23:46:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.137+0000 7fdc94d57700 1 -- 172.21.15.155:0/193458974 learned_addr learned my addr 172.21.15.155:0/193458974 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.137+0000 7fdc94d57700 1 -- 172.21.15.155:0/193458974 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c57112fba0 con 0x55c571106800 2024-04-19T23:46:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc94d57700 1 --2- 172.21.15.155:0/193458974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x55c571ed7800 tx=0x55c5711f7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5b7c22c0faeea8 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc93554700 1 -- 172.21.15.155:0/193458974 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c5711bf760 con 0x55c571106800 2024-04-19T23:46:35.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc93554700 1 -- 172.21.15.155:0/193458974 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c571431980 con 0x55c571106800 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc93554700 1 -- 172.21.15.155:0/193458974 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c5711bf4a0 con 0x55c571106800 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc96dada80 1 -- 172.21.15.155:0/193458974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 msgr2=0x55c5713ee580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc96dada80 1 --2- 172.21.15.155:0/193458974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x55c571ed7800 tx=0x55c5711f7800 comp rx=0 tx=0).stop 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc96dada80 1 -- 172.21.15.155:0/193458974 shutdown_connections 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc96dada80 1 --2- 172.21.15.155:0/193458974 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc96dada80 1 -- 172.21.15.155:0/193458974 >> 172.21.15.155:0/193458974 conn(0x55c571106400 msgr2=0x55c5711f3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc96dada80 1 -- 172.21.15.155:0/193458974 shutdown_connections 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc96dada80 1 -- 172.21.15.155:0/193458974 wait complete. 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.138+0000 7fdc96dada80 1 Processor -- start 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.139+0000 7fdc96dada80 1 -- start start 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.139+0000 7fdc96dada80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.139+0000 7fdc96dada80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5711a83c0 con 0x55c571106800 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.139+0000 7fdc94d57700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.139+0000 7fdc94d57700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40692/0 (socket says 172.21.15.155:40692) 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.139+0000 7fdc94d57700 1 -- 172.21.15.155:0/244758569 learned_addr learned my addr 172.21.15.155:0/244758569 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.139+0000 7fdc94d57700 1 -- 172.21.15.155:0/244758569 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c57112fa00 con 0x55c571106800 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.139+0000 7fdc94d57700 1 --2- 172.21.15.155:0/244758569 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x55c571ed7ec0 tx=0x55c5711f7980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.139+0000 7fdc91d51700 1 -- 172.21.15.155:0/244758569 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c5711bf600 con 0x55c571106800 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc91d51700 1 -- 172.21.15.155:0/244758569 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c571431b00 con 0x55c571106800 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc96dada80 1 -- 172.21.15.155:0/244758569 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c57112f860 con 0x55c571106800 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc91d51700 1 -- 172.21.15.155:0/244758569 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c5711bf8c0 con 0x55c571106800 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc96dada80 1 -- 172.21.15.155:0/244758569 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c57112f6c0 con 0x55c571106800 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc96dada80 1 Processor -- start 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc96dada80 1 -- start start 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc96dada80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 0x55c5713eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc96dada80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5711a8000 con 0x55c571107400 2024-04-19T23:46:35.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc91d51700 1 -- 172.21.15.155:0/244758569 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c571ea8b00 con 0x55c571106800 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc95558700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 0x55c5713eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc95558700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 0x55c5713eeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40708/0 (socket says 172.21.15.155:40708) 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.140+0000 7fdc95558700 1 -- 172.21.15.155:0/1885554279 learned_addr learned my addr 172.21.15.155:0/1885554279 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc91d51700 1 --2- 172.21.15.155:0/244758569 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c571496000 0x55c5713ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc91d51700 1 -- 172.21.15.155:0/244758569 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55c571181180 con 0x55c571106800 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc94d57700 1 --2- 172.21.15.155:0/244758569 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c571496000 0x55c5713ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc95558700 1 -- 172.21.15.155:0/1885554279 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c57112e000 con 0x55c571107400 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc95558700 1 --2- 172.21.15.155:0/1885554279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 0x55c5713eeb00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55c5714902d0 tx=0x55c571456780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e83189a878f979 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc94d57700 1 --2- 172.21.15.155:0/244758569 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c571496000 0x55c5713ef080 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55c571f87080 tx=0x55c5714568a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc8f54c700 1 -- 172.21.15.155:0/1885554279 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c5711bf600 con 0x55c571107400 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc8f54c700 1 -- 172.21.15.155:0/1885554279 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c5711a7c80 con 0x55c571107400 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc8f54c700 1 -- 172.21.15.155:0/1885554279 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c5711bf8c0 con 0x55c571107400 2024-04-19T23:46:35.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc96dada80 1 -- 172.21.15.155:0/1885554279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 msgr2=0x55c5713eeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc96dada80 1 --2- 172.21.15.155:0/1885554279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 0x55c5713eeb00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55c5714902d0 tx=0x55c571456780 comp rx=0 tx=0).stop 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc96dada80 1 -- 172.21.15.155:0/1885554279 shutdown_connections 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc96dada80 1 --2- 172.21.15.155:0/1885554279 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 0x55c5713eeb00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc96dada80 1 -- 172.21.15.155:0/1885554279 >> 172.21.15.155:0/1885554279 conn(0x55c571106c00 msgr2=0x55c5711f3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.141+0000 7fdc96dada80 1 -- 172.21.15.155:0/1885554279 shutdown_connections 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.142+0000 7fdc96dada80 1 -- 172.21.15.155:0/1885554279 wait complete. 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.142+0000 7fdc96dada80 1 Processor -- start 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.142+0000 7fdc96dada80 1 -- start start 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.142+0000 7fdc96dada80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 0x55c5713eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.142+0000 7fdc96dada80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c571142640 con 0x55c571107400 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.142+0000 7fdc95558700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 0x55c5713eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.142+0000 7fdc95558700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 0x55c5713eeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40712/0 (socket says 172.21.15.155:40712) 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.142+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 learned_addr learned my addr 172.21.15.155:0/2764993599 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.142+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c57112eea0 con 0x55c571107400 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.143+0000 7fdc95558700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 0x55c5713eeb00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x55c571f862d0 tx=0x55c5714565a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.143+0000 7fdc8dd49700 1 -- 172.21.15.155:0/2764993599 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c5711bf760 con 0x55c571107400 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.143+0000 7fdc8dd49700 1 -- 172.21.15.155:0/2764993599 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c5711a7b00 con 0x55c571107400 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.143+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c57112e820 con 0x55c571107400 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.143+0000 7fdc8dd49700 1 -- 172.21.15.155:0/2764993599 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c5711bf600 con 0x55c571107400 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.143+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c57112e9c0 con 0x55c571107400 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.144+0000 7fdc8dd49700 1 -- 172.21.15.155:0/2764993599 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c571ea8dc0 con 0x55c571107400 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.144+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.144+0000 7fdc8dd49700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c571496c00 0x55c5713ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.144+0000 7fdc8dd49700 1 -- 172.21.15.155:0/2764993599 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55c571181340 con 0x55c571107400 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.144+0000 7fdc94556700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c571496c00 0x55c5713ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.144+0000 7fdc96dada80 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c571107800 0x55c5713efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.144+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571107c00 con 0x55c571107800 2024-04-19T23:46:35.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.144+0000 7fdc95558700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c571107800 0x55c5713efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.144+0000 7fdc94556700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c571496c00 0x55c5713ef600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55c571ed6030 tx=0x55c571457920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.144+0000 7fdc95558700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c571107800 0x55c5713efb80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 20 realm 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571497000 con 0x55c571107800 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571497400 con 0x55c571107800 2024-04-19T23:46:35.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571497800 con 0x55c571107800 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.145+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571497c00 con 0x55c571107800 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.146+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.146+0000 7fdc96dada80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.146+0000 7fdc96dada80 20 searching for the correct realm 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.146+0000 7fdc96dada80 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c571497000 0x55c5713f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.146+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571497400 con 0x55c571497000 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.146+0000 7fdc94d57700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c571497000 0x55c5713f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.146+0000 7fdc94d57700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c571497000 0x55c5713f0100 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.146+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.146+0000 7fdc94d57700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c571497400 0x55c5713f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.146+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c000 con 0x55c571497400 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.147+0000 7fdc94556700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c571497400 0x55c5713f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.147+0000 7fdc94556700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c571497400 0x55c5713f0c00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.147+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.147+0000 7fdc94556700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c571f9c000 0x55c5713f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.147+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571f9c000 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.147+0000 7fdc95558700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c571f9c000 0x55c5713f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.148+0000 7fdc95558700 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c571f9c000 0x55c5713f1180 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.148+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.148+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571107800 2024-04-19T23:46:35.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.148+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.148+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571107800 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.148+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.148+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571107800 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.149+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.149+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571f9c000 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.149+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.149+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497400 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.149+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.149+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497000 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.149+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.149+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571107800 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.150+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.150+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571f9c000 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.150+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.150+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571107800 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.150+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.150+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497400 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.150+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.150+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497000 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.151+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.151+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497000 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.151+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.151+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497400 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.151+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.151+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497000 2024-04-19T23:46:35.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.151+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.151+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497000 2024-04-19T23:46:35.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.151+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.151+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571107800 2024-04-19T23:46:35.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.152+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.152+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571107800 2024-04-19T23:46:35.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.152+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.152+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571f9c000 2024-04-19T23:46:35.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.152+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.152+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497000 2024-04-19T23:46:35.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.152+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.152+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497400 2024-04-19T23:46:35.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.153+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.153+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571107800 2024-04-19T23:46:35.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.153+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.153+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571f9c000 2024-04-19T23:46:35.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.153+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.153+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497000 2024-04-19T23:46:35.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.153+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.153+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571f9c000 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.154+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.154+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497400 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.154+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.154+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497000 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.154+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.154+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571f9c000 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571107800 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497400 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc96dada80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:35.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc96dada80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc96dada80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc96dada80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571107c00 con 0x55c571107800 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc96dada80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.155+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9cc00 con 0x55c571107800 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9d000 con 0x55c571497400 2024-04-19T23:46:35.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 20 zone default found 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 4 Realm: () 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 20 zonegroup default 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9d400 con 0x55c571f9c000 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9d800 con 0x55c571497000 2024-04-19T23:46:35.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.156+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.157+0000 7fdc96dada80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.157+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.157+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9dc00 con 0x55c571497000 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.157+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.157+0000 7fdc96dada80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.157+0000 7fdc96dada80 20 started sync module instance, tier type = 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.157+0000 7fdc96dada80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.157+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9cc00 con 0x55c571497400 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.158+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.158+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94306496830208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571107c00 con 0x55c571497400 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.158+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571497800 con 0x55c571107800 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.159+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94306496830208] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.159+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.159+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94306496831360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571497c00 con 0x55c571107800 2024-04-19T23:46:35.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.159+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571497000 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.160+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94306496831360] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.161+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.161+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94306496832512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9d000 con 0x55c571497000 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.161+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9cc00 con 0x55c571497400 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.162+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.162+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94306496833664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c400 con 0x55c571497400 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.162+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9d800 con 0x55c571107800 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.162+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94306496832512] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.163+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94306496833664] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.163+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.163+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94306496834816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9dc00 con 0x55c571107800 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.163+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9c800 con 0x55c571f9c000 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.164+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.181 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.164+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94306496835968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9d400 con 0x55c571f9c000 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.164+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9d800 con 0x55c571f9c000 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.164+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94306496834816] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.165+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94306496835968] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.165+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.165+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94306496837120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9dc00 con 0x55c571f9c000 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.165+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571497800 con 0x55c571f9c000 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.166+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.166+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94306496838272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571497c00 con 0x55c571f9c000 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.166+0000 7fdc96dada80 20 add_watcher() i=0 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.166+0000 7fdc96dada80 20 add_watcher() i=1 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.166+0000 7fdc96dada80 20 add_watcher() i=2 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.166+0000 7fdc96dada80 20 add_watcher() i=3 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.166+0000 7fdc96dada80 20 add_watcher() i=4 2024-04-19T23:46:35.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.166+0000 7fdc96dada80 20 add_watcher() i=5 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.166+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94306496837120] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.166+0000 7fdc96dada80 20 add_watcher() i=6 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.167+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94306496838272] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.167+0000 7fdc96dada80 20 add_watcher() i=7 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.167+0000 7fdc96dada80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.167+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571497800 con 0x55c571107800 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.168+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.168+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94306498347008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571497c00 con 0x55c571107800 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.168+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94306498347008] v32'205 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.169+0000 7fdc7bd25700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.169+0000 7fdc96dada80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.169+0000 7fdc96dada80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.169+0000 7fdc96dada80 1 Processor -- start 2024-04-19T23:46:35.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.169+0000 7fdc96dada80 1 -- start start 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.169+0000 7fdc96dada80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.169+0000 7fdc96dada80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c571142780 con 0x55c571f9d400 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.169+0000 7fdc94556700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.169+0000 7fdc94556700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40718/0 (socket says 172.21.15.155:40718) 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.169+0000 7fdc94556700 1 -- 172.21.15.155:0/1992738048 learned_addr learned my addr 172.21.15.155:0/1992738048 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.169+0000 7fdc94556700 1 -- 172.21.15.155:0/1992738048 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c57112eb60 con 0x55c571f9d400 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.170+0000 7fdc94556700 1 --2- 172.21.15.155:0/1992738048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x55c5715600c0 tx=0x55c571457d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c2eb755cd5ecf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.170+0000 7fdc7b524700 1 -- 172.21.15.155:0/1992738048 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c57156e000 con 0x55c571f9d400 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.170+0000 7fdc7b524700 1 -- 172.21.15.155:0/1992738048 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c571566180 con 0x55c571f9d400 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.170+0000 7fdc7b524700 1 -- 172.21.15.155:0/1992738048 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c57156e160 con 0x55c571f9d400 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.170+0000 7fdc96dada80 1 -- 172.21.15.155:0/1992738048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 msgr2=0x55c5713f0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.170+0000 7fdc96dada80 1 --2- 172.21.15.155:0/1992738048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x55c5715600c0 tx=0x55c571457d40 comp rx=0 tx=0).stop 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.170+0000 7fdc96dada80 1 -- 172.21.15.155:0/1992738048 shutdown_connections 2024-04-19T23:46:35.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.170+0000 7fdc96dada80 1 --2- 172.21.15.155:0/1992738048 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.170+0000 7fdc96dada80 1 -- 172.21.15.155:0/1992738048 >> 172.21.15.155:0/1992738048 conn(0x55c571f9c800 msgr2=0x55c5711f4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.170+0000 7fdc96dada80 1 -- 172.21.15.155:0/1992738048 shutdown_connections 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.170+0000 7fdc96dada80 1 -- 172.21.15.155:0/1992738048 wait complete. 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.171+0000 7fdc96dada80 1 Processor -- start 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.171+0000 7fdc96dada80 1 -- start start 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.171+0000 7fdc96dada80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.171+0000 7fdc96dada80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5711a8000 con 0x55c571f9d400 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.171+0000 7fdc94556700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.171+0000 7fdc94556700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40726/0 (socket says 172.21.15.155:40726) 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.171+0000 7fdc94556700 1 -- 172.21.15.155:0/495783281 learned_addr learned my addr 172.21.15.155:0/495783281 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.172+0000 7fdc94556700 1 -- 172.21.15.155:0/495783281 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c57112ed00 con 0x55c571f9d400 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.172+0000 7fdc94556700 1 --2- 172.21.15.155:0/495783281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x55c5715602d0 tx=0x55c571457e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.172+0000 7fdc79d21700 1 -- 172.21.15.155:0/495783281 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c57156e2c0 con 0x55c571f9d400 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.172+0000 7fdc79d21700 1 -- 172.21.15.155:0/495783281 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c571566300 con 0x55c571f9d400 2024-04-19T23:46:35.185 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.172+0000 7fdc96dada80 1 -- 172.21.15.155:0/495783281 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c57112e340 con 0x55c571f9d400 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.172+0000 7fdc79d21700 1 -- 172.21.15.155:0/495783281 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c57156e000 con 0x55c571f9d400 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.172+0000 7fdc96dada80 1 -- 172.21.15.155:0/495783281 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c57112eb60 con 0x55c571f9d400 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.173+0000 7fdc79d21700 1 -- 172.21.15.155:0/495783281 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c571ea9b80 con 0x55c571f9d400 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.173+0000 7fdc79d21700 1 --2- 172.21.15.155:0/495783281 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c5715f0000 0x55c5713f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.173+0000 7fdc79d21700 1 -- 172.21.15.155:0/495783281 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55c571181500 con 0x55c571f9d400 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.173+0000 7fdc96dada80 5 note: GC not initialized 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.173+0000 7fdc95558700 1 --2- 172.21.15.155:0/495783281 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c5715f0000 0x55c5713f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.173+0000 7fdc95558700 1 --2- 172.21.15.155:0/495783281 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c5715f0000 0x55c5713f1700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55c5714e9ef0 tx=0x55c571457b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.174+0000 7fdc7751c700 20 reqs_thread_entry: start 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.174+0000 7fdc96dada80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.174+0000 7fdc96dada80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.174+0000 7fdc75518700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:05 2024 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:35.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.174+0000 7fdc74cf6700 20 reqs_thread_entry: start 2024-04-19T23:46:35.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.174+0000 7fdc96dada80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.174+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c571f9dc00 con 0x55c571107800 2024-04-19T23:46:35.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.175+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.175+0000 7fdc96dada80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:46:35.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.175+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5715f0400 con 0x55c571f9c000 2024-04-19T23:46:35.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.175+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.176+0000 7fdc7bd25700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.176+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94306498347008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5715f0800 con 0x55c571107800 2024-04-19T23:46:35.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.177+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94306498347008] v32'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.177+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94306496830208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5715f0c00 con 0x55c571497400 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.178+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94306496830208] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.178+0000 7fdc96dada80 20 remove_watcher() i=0 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.178+0000 7fdc96dada80 2 removed watcher, disabling cache 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.178+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94306496831360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5715f1000 con 0x55c571107800 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.180+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94306496831360] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.180+0000 7fdc96dada80 20 remove_watcher() i=1 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.180+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94306496832512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5715f1400 con 0x55c571497000 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.181+0000 7fdc94d57700 1 -- 172.21.15.155:0/2764993599 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94306496832512] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153f200 con 0x55c571497000 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.181+0000 7fdc96dada80 20 remove_watcher() i=2 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.181+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94306496833664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5715f1800 con 0x55c571497400 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.182+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94306496833664] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153f440 con 0x55c571497400 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.182+0000 7fdc96dada80 20 remove_watcher() i=3 2024-04-19T23:46:35.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.182+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94306496834816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5715f1c00 con 0x55c571107800 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.183+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94306496834816] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571107800 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.183+0000 7fdc96dada80 20 remove_watcher() i=4 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.183+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94306496835968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5715f0400 con 0x55c571f9c000 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.184+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94306496835968] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.184+0000 7fdc96dada80 20 remove_watcher() i=5 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.184+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94306496837120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5715f0800 con 0x55c571f9c000 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.185+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94306496837120] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.185+0000 7fdc96dada80 20 remove_watcher() i=6 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.185+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94306496838272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c5715f1000 con 0x55c571f9c000 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.186+0000 7fdc95558700 1 -- 172.21.15.155:0/2764993599 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94306496838272] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c57153eb40 con 0x55c571f9c000 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.186+0000 7fdc96dada80 20 remove_watcher() i=7 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.186+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c571f9c000 msgr2=0x55c5713f1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.186+0000 7fdc96dada80 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55c571f9c000 0x55c5713f1180 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.186+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c571107800 msgr2=0x55c5713efb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.186+0000 7fdc96dada80 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c571107800 0x55c5713efb80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.186+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c571497400 msgr2=0x55c5713f0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.186+0000 7fdc96dada80 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55c571497400 0x55c5713f0c00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c571497000 msgr2=0x55c5713f0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55c571497000 0x55c5713f0100 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c571496c00 msgr2=0x55c5713ef600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c571496c00 0x55c5713ef600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55c571ed6030 tx=0x55c571457920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 msgr2=0x55c5713eeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 --2- 172.21.15.155:0/2764993599 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571107400 0x55c5713eeb00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x55c571f862d0 tx=0x55c5714565a0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 reap_dead start 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 shutdown_connections 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 >> 172.21.15.155:0/2764993599 conn(0x55c571106c00 msgr2=0x55c5711f3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc94556700 1 -- 172.21.15.155:0/2764993599 reap_dead start 2024-04-19T23:46:35.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 shutdown_connections 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/2764993599 wait complete. 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/495783281 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c5715f0000 msgr2=0x55c5713f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 --2- 172.21.15.155:0/495783281 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c5715f0000 0x55c5713f1700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55c5714e9ef0 tx=0x55c571457b60 comp rx=0 tx=0).stop 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/495783281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 msgr2=0x55c5713f0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 --2- 172.21.15.155:0/495783281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x55c5715602d0 tx=0x55c571457e60 comp rx=0 tx=0).stop 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/495783281 shutdown_connections 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 --2- 172.21.15.155:0/495783281 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c5715f0000 0x55c5713f1700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 --2- 172.21.15.155:0/495783281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571f9d400 0x55c5713f0680 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/495783281 >> 172.21.15.155:0/495783281 conn(0x55c571f9c800 msgr2=0x55c5711f4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/495783281 shutdown_connections 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/495783281 wait complete. 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 -- 172.21.15.155:0/244758569 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c571496000 msgr2=0x55c5713ef080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.187+0000 7fdc96dada80 1 --2- 172.21.15.155:0/244758569 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c571496000 0x55c5713ef080 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55c571f87080 tx=0x55c5714568a0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.188+0000 7fdc96dada80 1 -- 172.21.15.155:0/244758569 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 msgr2=0x55c5713ee580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.188+0000 7fdc96dada80 1 --2- 172.21.15.155:0/244758569 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x55c571ed7ec0 tx=0x55c5711f7980 comp rx=0 tx=0).stop 2024-04-19T23:46:35.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.188+0000 7fdc96dada80 1 -- 172.21.15.155:0/244758569 shutdown_connections 2024-04-19T23:46:35.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.188+0000 7fdc96dada80 1 --2- 172.21.15.155:0/244758569 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c571496000 0x55c5713ef080 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.188+0000 7fdc96dada80 1 --2- 172.21.15.155:0/244758569 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c571106800 0x55c5713ee580 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.188+0000 7fdc96dada80 1 -- 172.21.15.155:0/244758569 >> 172.21.15.155:0/244758569 conn(0x55c571106400 msgr2=0x55c5711f3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.188+0000 7fdc96dada80 1 -- 172.21.15.155:0/244758569 shutdown_connections 2024-04-19T23:46:35.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.188+0000 7fdc96dada80 1 -- 172.21.15.155:0/244758569 wait complete. 2024-04-19T23:46:35.198 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:46:35.198 INFO:teuthology.orchestra.run.smithi155.stdout: "entries": [ 2024-04-19T23:46:35.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.198 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:35.198 INFO:teuthology.orchestra.run.smithi155.stdout: "buckets": [ 2024-04-19T23:46:35.198 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.198 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "", 2024-04-19T23:46:35.198 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo", 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "put_obj", 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 30000042, 2024-04-19T23:46:35.199 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 11, 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 11 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo2", 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo3", 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.200 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo4", 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: "summary": [ 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.201 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "put_obj", 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 30000042, 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 11, 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 11 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: "total": { 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 30000042, 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 11, 2024-04-19T23:46:35.202 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 11 2024-04-19T23:46:35.203 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.203 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.203 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.203 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:46:35.203 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-04-19T23:46:35.203 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-19T23:46:35.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-19T23:46:35.203 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-04-19T23:46:35.250 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:35.250 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:35.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.251+0000 7f0e32a5fa80 1 Processor -- start 2024-04-19T23:46:35.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.251+0000 7f0e32a5fa80 1 -- start start 2024-04-19T23:46:35.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.251+0000 7f0e32a5fa80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x561da86bc800 0x561da89a4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.251+0000 7f0e32a5fa80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561da89e7500 con 0x561da86bcc00 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.251+0000 7f0e32a5fa80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x561da875ea00 con 0x561da86bc800 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.251+0000 7f0e30a09700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x561da86bc800 0x561da89a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.251+0000 7f0e30208700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x561da86bcc00 0x561da87a8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55698/0 (socket says 172.21.15.155:55698) 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.251+0000 7f0e30208700 1 -- 172.21.15.155:0/2391011374 learned_addr learned my addr 172.21.15.155:0/2391011374 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.251+0000 7f0e30a09700 1 -- 172.21.15.155:0/2391011374 >> v1:172.21.15.76:6789/0 conn(0x561da86bcc00 legacy=0x561da87a8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.251+0000 7f0e30a09700 1 -- 172.21.15.155:0/2391011374 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561da86e5d40 con 0x561da86bc800 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.251+0000 7f0e2fa07700 1 -- 172.21.15.155:0/2391011374 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405454284 0 0) 0x561da948a000 con 0x561da86bcc00 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.252+0000 7f0e30a09700 1 --2- 172.21.15.155:0/2391011374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x561da899f9e0 tx=0x561da87ad920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9d8357e9bec1f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.252+0000 7f0e2fa07700 1 -- 172.21.15.155:0/2391011374 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da87754a0 con 0x561da86bc800 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.252+0000 7f0e2fa07700 1 -- 172.21.15.155:0/2391011374 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561da89e7800 con 0x561da86bc800 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.252+0000 7f0e2fa07700 1 -- 172.21.15.155:0/2391011374 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da8775600 con 0x561da86bc800 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.252+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/2391011374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 msgr2=0x561da89a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.252+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/2391011374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x561da899f9e0 tx=0x561da87ad920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.252+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/2391011374 shutdown_connections 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.252+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/2391011374 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.252+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/2391011374 >> 172.21.15.155:0/2391011374 conn(0x561da86bc400 msgr2=0x561da87a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.252+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/2391011374 shutdown_connections 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.252+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/2391011374 wait complete. 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.253+0000 7f0e32a5fa80 1 Processor -- start 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.253+0000 7f0e32a5fa80 1 -- start start 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.253+0000 7f0e32a5fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.253+0000 7f0e32a5fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da875e500 con 0x561da86bc800 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.253+0000 7f0e30a09700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.253+0000 7f0e30a09700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40748/0 (socket says 172.21.15.155:40748) 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.253+0000 7f0e30a09700 1 -- 172.21.15.155:0/717306446 learned_addr learned my addr 172.21.15.155:0/717306446 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.253+0000 7f0e30a09700 1 -- 172.21.15.155:0/717306446 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561da86e5ba0 con 0x561da86bc800 2024-04-19T23:46:35.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.254+0000 7f0e30a09700 1 --2- 172.21.15.155:0/717306446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x561da948d800 tx=0x561da87ad800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227c28f500d9dc7e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.254+0000 7f0e2f206700 1 -- 172.21.15.155:0/717306446 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da8775760 con 0x561da86bc800 2024-04-19T23:46:35.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.254+0000 7f0e2f206700 1 -- 172.21.15.155:0/717306446 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561da89e7b00 con 0x561da86bc800 2024-04-19T23:46:35.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.254+0000 7f0e2f206700 1 -- 172.21.15.155:0/717306446 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da87751e0 con 0x561da86bc800 2024-04-19T23:46:35.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.254+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/717306446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 msgr2=0x561da89a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.254+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/717306446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x561da948d800 tx=0x561da87ad800 comp rx=0 tx=0).stop 2024-04-19T23:46:35.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.254+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/717306446 shutdown_connections 2024-04-19T23:46:35.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.254+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/717306446 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.254+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/717306446 >> 172.21.15.155:0/717306446 conn(0x561da86bc400 msgr2=0x561da87a9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.254+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/717306446 shutdown_connections 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.254+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/717306446 wait complete. 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.255+0000 7f0e32a5fa80 1 Processor -- start 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.255+0000 7f0e32a5fa80 1 -- start start 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.255+0000 7f0e32a5fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.255+0000 7f0e32a5fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da875e3c0 con 0x561da86bc800 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.255+0000 7f0e30a09700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.255+0000 7f0e30a09700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40762/0 (socket says 172.21.15.155:40762) 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.255+0000 7f0e30a09700 1 -- 172.21.15.155:0/900944598 learned_addr learned my addr 172.21.15.155:0/900944598 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.255+0000 7f0e30a09700 1 -- 172.21.15.155:0/900944598 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561da86e5a00 con 0x561da86bc800 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.256+0000 7f0e30a09700 1 --2- 172.21.15.155:0/900944598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x561da948dec0 tx=0x561da87ad920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.256+0000 7f0e2da03700 1 -- 172.21.15.155:0/900944598 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da87754a0 con 0x561da86bc800 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.256+0000 7f0e2da03700 1 -- 172.21.15.155:0/900944598 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561da89e7c80 con 0x561da86bc800 2024-04-19T23:46:35.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.256+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/900944598 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561da86e5860 con 0x561da86bc800 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.256+0000 7f0e2da03700 1 -- 172.21.15.155:0/900944598 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da8775600 con 0x561da86bc800 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.256+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/900944598 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561da86e56c0 con 0x561da86bc800 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.256+0000 7f0e32a5fa80 1 Processor -- start 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.256+0000 7f0e32a5fa80 1 -- start start 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e32a5fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 0x561da89a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e2da03700 1 -- 172.21.15.155:0/900944598 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561da945eb00 con 0x561da86bc800 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e32a5fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da875e000 con 0x561da86bd400 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e3120a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 0x561da89a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e3120a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 0x561da89a4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40764/0 (socket says 172.21.15.155:40764) 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e3120a700 1 -- 172.21.15.155:0/2340467967 learned_addr learned my addr 172.21.15.155:0/2340467967 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e2da03700 1 --2- 172.21.15.155:0/900944598 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8a48000 0x561da89a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e2da03700 1 -- 172.21.15.155:0/900944598 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x561da8737180 con 0x561da86bc800 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e30a09700 1 --2- 172.21.15.155:0/900944598 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8a48000 0x561da89a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e3120a700 1 -- 172.21.15.155:0/2340467967 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561da86e4000 con 0x561da86bd400 2024-04-19T23:46:35.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e3120a700 1 --2- 172.21.15.155:0/2340467967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 0x561da89a4b00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x561da8a4a060 tx=0x561da8a04780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161cdc8ca9344018 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e30a09700 1 --2- 172.21.15.155:0/900944598 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8a48000 0x561da89a5080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x561da954ef90 tx=0x561da8a048a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e2b1fe700 1 -- 172.21.15.155:0/2340467967 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da87754a0 con 0x561da86bd400 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e2b1fe700 1 -- 172.21.15.155:0/2340467967 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561da875dc80 con 0x561da86bd400 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.257+0000 7f0e2b1fe700 1 -- 172.21.15.155:0/2340467967 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da8775600 con 0x561da86bd400 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/2340467967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 msgr2=0x561da89a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/2340467967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 0x561da89a4b00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x561da8a4a060 tx=0x561da8a04780 comp rx=0 tx=0).stop 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/2340467967 shutdown_connections 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/2340467967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 0x561da89a4b00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/2340467967 >> 172.21.15.155:0/2340467967 conn(0x561da86bcc00 msgr2=0x561da87a9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/2340467967 shutdown_connections 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/2340467967 wait complete. 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e32a5fa80 1 Processor -- start 2024-04-19T23:46:35.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e32a5fa80 1 -- start start 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e32a5fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 0x561da89a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e32a5fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da86f8640 con 0x561da86bd400 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e3120a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 0x561da89a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e3120a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 0x561da89a4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40772/0 (socket says 172.21.15.155:40772) 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.258+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 learned_addr learned my addr 172.21.15.155:0/1580840403 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.259+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561da86e4ea0 con 0x561da86bd400 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.259+0000 7f0e3120a700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 0x561da89a4b00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x561da954e240 tx=0x561da8a045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.259+0000 7f0e299fb700 1 -- 172.21.15.155:0/1580840403 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da8775760 con 0x561da86bd400 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.259+0000 7f0e299fb700 1 -- 172.21.15.155:0/1580840403 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561da875db00 con 0x561da86bd400 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.259+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561da86e4820 con 0x561da86bd400 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.259+0000 7f0e299fb700 1 -- 172.21.15.155:0/1580840403 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da87754a0 con 0x561da86bd400 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.259+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561da86e49c0 con 0x561da86bd400 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.260+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.260+0000 7f0e299fb700 1 -- 172.21.15.155:0/1580840403 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561da945edc0 con 0x561da86bd400 2024-04-19T23:46:35.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.260+0000 7f0e299fb700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8a48c00 0x561da89a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.260+0000 7f0e299fb700 1 -- 172.21.15.155:0/1580840403 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x561da8737340 con 0x561da86bd400 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.260+0000 7f0e30208700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8a48c00 0x561da89a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.260+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561da86bd800 0x561da89a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.260+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da86bdc00 con 0x561da86bd800 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.260+0000 7f0e3120a700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561da86bd800 0x561da89a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.260+0000 7f0e30208700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8a48c00 0x561da89a5600 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x561da948c030 tx=0x561da8a05920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e3120a700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561da86bd800 0x561da89a5b80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e32a5fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e32a5fa80 20 realm 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8a49000 con 0x561da86bd800 2024-04-19T23:46:35.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e32a5fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e32a5fa80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8a49400 con 0x561da86bd800 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e32a5fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.261+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8a49800 con 0x561da86bd800 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.262+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.262+0000 7f0e32a5fa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.262+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.262+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8a49c00 con 0x561da86bd800 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.262+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.262+0000 7f0e32a5fa80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.262+0000 7f0e32a5fa80 20 searching for the correct realm 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.262+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561da8a49000 0x561da89a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.262+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8a49400 con 0x561da8a49000 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.262+0000 7f0e30a09700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561da8a49000 0x561da89a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.262+0000 7f0e30a09700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561da8a49000 0x561da89a6100 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.263+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.263+0000 7f0e30a09700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561da8a49400 0x561da89a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.263+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04000 con 0x561da8a49400 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.263+0000 7f0e30208700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561da8a49400 0x561da89a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.263+0000 7f0e30208700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561da8a49400 0x561da89a6c00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.263+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.263+0000 7f0e30208700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561da8b04000 0x561da89a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.263+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8b04000 2024-04-19T23:46:35.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.264+0000 7f0e3120a700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561da8b04000 0x561da89a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.264+0000 7f0e3120a700 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561da8b04000 0x561da89a7180 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.264+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.264+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da86bd800 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.264+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.264+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da86bd800 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.265+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.265+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da86bd800 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.265+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.265+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8b04000 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.265+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.265+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49400 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.265+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.265+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49000 2024-04-19T23:46:35.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.266+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.266+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da86bd800 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.266+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.266+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8b04000 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.266+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.266+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da86bd800 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.266+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.266+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49400 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.266+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.266+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49000 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.267+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.267+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49000 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.267+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.267+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49400 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.267+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.267+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49000 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.267+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.267+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49000 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.268+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.268+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da86bd800 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.268+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.268+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da86bd800 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.268+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.268+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8b04000 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.268+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.268+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49000 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.268+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.268+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49400 2024-04-19T23:46:35.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.269+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.269+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da86bd800 2024-04-19T23:46:35.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.269+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.269+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8b04000 2024-04-19T23:46:35.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.269+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.269+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49000 2024-04-19T23:46:35.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.270+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.270+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8b04000 2024-04-19T23:46:35.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.270+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.270+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49400 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.270+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.270+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49000 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.270+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.270+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8b04000 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da86bd800 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49400 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e32a5fa80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e32a5fa80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e32a5fa80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e32a5fa80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:35.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da86bdc00 con 0x561da86bd800 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.271+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04c00 con 0x561da86bd800 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b05000 con 0x561da8a49400 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 20 zone default found 2024-04-19T23:46:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 4 Realm: () 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 20 zonegroup default 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b05400 con 0x561da8b04000 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.272+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b05800 con 0x561da8a49000 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.273+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.273+0000 7f0e32a5fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.273+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.273+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b05c00 con 0x561da8a49000 2024-04-19T23:46:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.273+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.273+0000 7f0e32a5fa80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.273+0000 7f0e32a5fa80 20 started sync module instance, tier type = 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.273+0000 7f0e32a5fa80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.273+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04c00 con 0x561da8a49400 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.274+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.274+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94685382687488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da86bdc00 con 0x561da8a49400 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.274+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8a49800 con 0x561da86bd800 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.275+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94685382687488] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.275+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.275+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94685382688640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8a49c00 con 0x561da86bd800 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.275+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8a49000 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.276+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94685382688640] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.276+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.276+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94685382689792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b05000 con 0x561da8a49000 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.276+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04c00 con 0x561da8a49400 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.277+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.277+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94685382690944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04400 con 0x561da8a49400 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.277+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b05800 con 0x561da86bd800 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.277+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94685382689792] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.278+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94685382690944] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.278+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.279+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94685382692096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b05c00 con 0x561da86bd800 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.279+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b04800 con 0x561da8b04000 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.280+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.280+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94685382693248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b05400 con 0x561da8b04000 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.280+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94685382692096] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.280+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b05800 con 0x561da8b04000 2024-04-19T23:46:35.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.281+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.281+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94685382694400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b05c00 con 0x561da8b04000 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.281+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8a49800 con 0x561da8b04000 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.281+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94685382693248] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.282+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94685382694400] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.282+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.282+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94685382695552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8a49c00 con 0x561da8b04000 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.282+0000 7f0e32a5fa80 20 add_watcher() i=0 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.282+0000 7f0e32a5fa80 20 add_watcher() i=1 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.282+0000 7f0e32a5fa80 20 add_watcher() i=2 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.282+0000 7f0e32a5fa80 20 add_watcher() i=3 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.282+0000 7f0e32a5fa80 20 add_watcher() i=4 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.282+0000 7f0e32a5fa80 20 add_watcher() i=5 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.282+0000 7f0e32a5fa80 20 add_watcher() i=6 2024-04-19T23:46:35.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.283+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94685382695552] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.283+0000 7f0e32a5fa80 20 add_watcher() i=7 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.283+0000 7f0e32a5fa80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.283+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8a49800 con 0x561da86bd800 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.283+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.283+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94685384220672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8a49c00 con 0x561da86bd800 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.284+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94685384220672] v32'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.284+0000 7f0e179d7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.284+0000 7f0e32a5fa80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.284+0000 7f0e32a5fa80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.284+0000 7f0e32a5fa80 1 Processor -- start 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.284+0000 7f0e32a5fa80 1 -- start start 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.284+0000 7f0e32a5fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.284+0000 7f0e32a5fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da86f8780 con 0x561da8b05400 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.285+0000 7f0e30208700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.285+0000 7f0e30208700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40782/0 (socket says 172.21.15.155:40782) 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.285+0000 7f0e30208700 1 -- 172.21.15.155:0/1055891834 learned_addr learned my addr 172.21.15.155:0/1055891834 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.285+0000 7f0e30208700 1 -- 172.21.15.155:0/1055891834 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561da86e4b60 con 0x561da8b05400 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.285+0000 7f0e30208700 1 --2- 172.21.15.155:0/1055891834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x561da8b1a0c0 tx=0x561da8a05d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a291f6492f3b400c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.285+0000 7f0e171d6700 1 -- 172.21.15.155:0/1055891834 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da8b2a000 con 0x561da8b05400 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.285+0000 7f0e171d6700 1 -- 172.21.15.155:0/1055891834 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561da8b2c000 con 0x561da8b05400 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.285+0000 7f0e171d6700 1 -- 172.21.15.155:0/1055891834 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da8b2a160 con 0x561da8b05400 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.286+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1055891834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 msgr2=0x561da89a6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.286+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/1055891834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x561da8b1a0c0 tx=0x561da8a05d40 comp rx=0 tx=0).stop 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.286+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1055891834 shutdown_connections 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.286+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/1055891834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.286+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1055891834 >> 172.21.15.155:0/1055891834 conn(0x561da8b04800 msgr2=0x561da87aa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.286+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1055891834 shutdown_connections 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.286+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1055891834 wait complete. 2024-04-19T23:46:35.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.286+0000 7f0e32a5fa80 1 Processor -- start 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.286+0000 7f0e32a5fa80 1 -- start start 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.286+0000 7f0e32a5fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.286+0000 7f0e32a5fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da875e000 con 0x561da8b05400 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.287+0000 7f0e30208700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.287+0000 7f0e30208700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40784/0 (socket says 172.21.15.155:40784) 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.287+0000 7f0e30208700 1 -- 172.21.15.155:0/356178575 learned_addr learned my addr 172.21.15.155:0/356178575 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.287+0000 7f0e30208700 1 -- 172.21.15.155:0/356178575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561da86e4d00 con 0x561da8b05400 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.287+0000 7f0e30208700 1 --2- 172.21.15.155:0/356178575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x561da8b1a300 tx=0x561da8a05e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.287+0000 7f0e159d3700 1 -- 172.21.15.155:0/356178575 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da8b2a2c0 con 0x561da8b05400 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.287+0000 7f0e159d3700 1 -- 172.21.15.155:0/356178575 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561da8b2c180 con 0x561da8b05400 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.287+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/356178575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561da86e4340 con 0x561da8b05400 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.287+0000 7f0e159d3700 1 -- 172.21.15.155:0/356178575 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561da8b2a000 con 0x561da8b05400 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.287+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/356178575 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561da86e4b60 con 0x561da8b05400 2024-04-19T23:46:35.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.288+0000 7f0e159d3700 1 -- 172.21.15.155:0/356178575 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561da945fb80 con 0x561da8b05400 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.288+0000 7f0e159d3700 1 --2- 172.21.15.155:0/356178575 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8ba4000 0x561da89a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.288+0000 7f0e159d3700 1 -- 172.21.15.155:0/356178575 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x561da8737500 con 0x561da8b05400 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.288+0000 7f0e3120a700 1 --2- 172.21.15.155:0/356178575 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8ba4000 0x561da89a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.288+0000 7f0e32a5fa80 5 note: GC not initialized 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.289+0000 7f0e3120a700 1 --2- 172.21.15.155:0/356178575 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8ba4000 0x561da89a7700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x561da8a4bdd0 tx=0x561da8a05b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.289+0000 7f0e131ce700 20 reqs_thread_entry: start 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.289+0000 7f0e32a5fa80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.289+0000 7f0e32a5fa80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.289+0000 7f0e111ca700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:05 2024 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.289+0000 7f0e109a8700 20 reqs_thread_entry: start 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.289+0000 7f0e32a5fa80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.290+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8b05c00 con 0x561da86bd800 2024-04-19T23:46:35.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.290+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.290+0000 7f0e32a5fa80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:46:35.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.290+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8ba4400 con 0x561da8b04000 2024-04-19T23:46:35.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.290+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.291+0000 7f0e179d7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.291+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94685384220672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8ba4800 con 0x561da86bd800 2024-04-19T23:46:35.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.292+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94685384220672] v32'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.292+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94685382687488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8ba4c00 con 0x561da8a49400 2024-04-19T23:46:35.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.293+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94685382687488] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.293+0000 7f0e32a5fa80 20 remove_watcher() i=0 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.293+0000 7f0e32a5fa80 2 removed watcher, disabling cache 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.293+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94685382688640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8ba5000 con 0x561da86bd800 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.294+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94685382688640] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.294+0000 7f0e32a5fa80 20 remove_watcher() i=1 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.294+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94685382689792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8ba5400 con 0x561da8a49000 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.295+0000 7f0e30a09700 1 -- 172.21.15.155:0/1580840403 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94685382689792] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab7200 con 0x561da8a49000 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.295+0000 7f0e32a5fa80 20 remove_watcher() i=2 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.295+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94685382690944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8ba5800 con 0x561da8a49400 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.296+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94685382690944] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab7440 con 0x561da8a49400 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.296+0000 7f0e32a5fa80 20 remove_watcher() i=3 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.296+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94685382692096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8ba5c00 con 0x561da86bd800 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.297+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94685382692096] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da86bd800 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.297+0000 7f0e32a5fa80 20 remove_watcher() i=4 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.297+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94685382693248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8ba4400 con 0x561da8b04000 2024-04-19T23:46:35.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.298+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94685382693248] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.298+0000 7f0e32a5fa80 20 remove_watcher() i=5 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.298+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94685382694400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8ba4800 con 0x561da8b04000 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.300+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94685382694400] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.300+0000 7f0e32a5fa80 20 remove_watcher() i=6 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.300+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94685382695552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561da8ba5000 con 0x561da8b04000 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e3120a700 1 -- 172.21.15.155:0/1580840403 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94685382695552] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561da8ab6b40 con 0x561da8b04000 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 20 remove_watcher() i=7 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561da8b04000 msgr2=0x561da89a7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561da8b04000 0x561da89a7180 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561da86bd800 msgr2=0x561da89a5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x561da86bd800 0x561da89a5b80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561da8a49400 msgr2=0x561da89a6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561da8a49400 0x561da89a6c00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561da8a49000 msgr2=0x561da89a6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561da8a49000 0x561da89a6100 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8a48c00 msgr2=0x561da89a5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8a48c00 0x561da89a5600 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x561da948c030 tx=0x561da8a05920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 msgr2=0x561da89a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/1580840403 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bd400 0x561da89a4b00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x561da954e240 tx=0x561da8a045a0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 reap_dead start 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e30208700 1 -- 172.21.15.155:0/1580840403 reap_dead start 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 shutdown_connections 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 >> 172.21.15.155:0/1580840403 conn(0x561da86bcc00 msgr2=0x561da87a9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 shutdown_connections 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/1580840403 wait complete. 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/356178575 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8ba4000 msgr2=0x561da89a7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/356178575 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8ba4000 0x561da89a7700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x561da8a4bdd0 tx=0x561da8a05b60 comp rx=0 tx=0).stop 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/356178575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 msgr2=0x561da89a6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/356178575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x561da8b1a300 tx=0x561da8a05e60 comp rx=0 tx=0).stop 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/356178575 shutdown_connections 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/356178575 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8ba4000 0x561da89a7700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/356178575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da8b05400 0x561da89a6680 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.301+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/356178575 >> 172.21.15.155:0/356178575 conn(0x561da8b04800 msgr2=0x561da87aa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/356178575 shutdown_connections 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/356178575 wait complete. 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/900944598 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8a48000 msgr2=0x561da89a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/900944598 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8a48000 0x561da89a5080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x561da954ef90 tx=0x561da8a048a0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/900944598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 msgr2=0x561da89a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/900944598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x561da948dec0 tx=0x561da87ad920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/900944598 shutdown_connections 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/900944598 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561da8a48000 0x561da89a5080 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 --2- 172.21.15.155:0/900944598 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561da86bc800 0x561da89a4580 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/900944598 >> 172.21.15.155:0/900944598 conn(0x561da86bc400 msgr2=0x561da87a9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/900944598 shutdown_connections 2024-04-19T23:46:35.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.302+0000 7f0e32a5fa80 1 -- 172.21.15.155:0/900944598 wait complete. 2024-04-19T23:46:35.312 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: "entries": [ 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: "buckets": [ 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "", 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo", 2024-04-19T23:46:35.313 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_obj", 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 4, 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.314 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo2", 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo3", 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo4", 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.315 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: "summary": [ 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_obj", 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 4, 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:35.316 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.317 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:35.317 INFO:teuthology.orchestra.run.smithi155.stdout: "total": { 2024-04-19T23:46:35.317 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.317 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.317 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 4, 2024-04-19T23:46:35.317 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:35.317 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.317 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.317 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.317 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:46:35.317 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-19T23:46:35.317 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-19T23:46:35.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-19T23:46:35.318 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-04-19T23:46:35.365 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:35.365 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:35.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.366+0000 7fef79d68a80 1 Processor -- start 2024-04-19T23:46:35.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.366+0000 7fef79d68a80 1 -- start start 2024-04-19T23:46:35.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.366+0000 7fef79d68a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55828d798800 0x55828da80580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.366+0000 7fef79d68a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55828dac3500 con 0x55828d798c00 2024-04-19T23:46:35.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.366+0000 7fef79d68a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55828d83aa00 con 0x55828d798800 2024-04-19T23:46:35.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.366+0000 7fef77d12700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55828d798800 0x55828da80580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.366+0000 7fef77511700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55828d798c00 0x55828d884800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55704/0 (socket says 172.21.15.155:55704) 2024-04-19T23:46:35.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.366+0000 7fef77511700 1 -- 172.21.15.155:0/471372311 learned_addr learned my addr 172.21.15.155:0/471372311 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:35.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.366+0000 7fef77d12700 1 -- 172.21.15.155:0/471372311 >> v1:172.21.15.76:6789/0 conn(0x55828d798c00 legacy=0x55828d884800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.366+0000 7fef77d12700 1 -- 172.21.15.155:0/471372311 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55828d7c1d40 con 0x55828d798800 2024-04-19T23:46:35.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.367+0000 7fef77d12700 1 --2- 172.21.15.155:0/471372311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x55828da7b9e0 tx=0x55828d889920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29374ec2b74af94c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.367+0000 7fef76d10700 1 -- 172.21.15.155:0/471372311 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828d8514a0 con 0x55828d798800 2024-04-19T23:46:35.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.367+0000 7fef76d10700 1 -- 172.21.15.155:0/471372311 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55828dac3800 con 0x55828d798800 2024-04-19T23:46:35.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.367+0000 7fef76d10700 1 -- 172.21.15.155:0/471372311 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828d851600 con 0x55828d798800 2024-04-19T23:46:35.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.367+0000 7fef79d68a80 1 -- 172.21.15.155:0/471372311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 msgr2=0x55828da80580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.367+0000 7fef79d68a80 1 --2- 172.21.15.155:0/471372311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x55828da7b9e0 tx=0x55828d889920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.367+0000 7fef79d68a80 1 -- 172.21.15.155:0/471372311 shutdown_connections 2024-04-19T23:46:35.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.367+0000 7fef79d68a80 1 --2- 172.21.15.155:0/471372311 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.367+0000 7fef79d68a80 1 -- 172.21.15.155:0/471372311 >> 172.21.15.155:0/471372311 conn(0x55828d798400 msgr2=0x55828d884000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.367+0000 7fef79d68a80 1 -- 172.21.15.155:0/471372311 shutdown_connections 2024-04-19T23:46:35.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.367+0000 7fef79d68a80 1 -- 172.21.15.155:0/471372311 wait complete. 2024-04-19T23:46:35.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.368+0000 7fef79d68a80 1 Processor -- start 2024-04-19T23:46:35.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.368+0000 7fef79d68a80 1 -- start start 2024-04-19T23:46:35.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.368+0000 7fef79d68a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.368+0000 7fef79d68a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828d83a500 con 0x55828d798800 2024-04-19T23:46:35.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.369+0000 7fef77d12700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.369+0000 7fef77d12700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40802/0 (socket says 172.21.15.155:40802) 2024-04-19T23:46:35.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.369+0000 7fef77d12700 1 -- 172.21.15.155:0/748393531 learned_addr learned my addr 172.21.15.155:0/748393531 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.369+0000 7fef77d12700 1 -- 172.21.15.155:0/748393531 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55828d7c1ba0 con 0x55828d798800 2024-04-19T23:46:35.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.369+0000 7fef77d12700 1 --2- 172.21.15.155:0/748393531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x55828e571740 tx=0x55828d889800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe351fe6aac479c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.369+0000 7fef7650f700 1 -- 172.21.15.155:0/748393531 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828d851760 con 0x55828d798800 2024-04-19T23:46:35.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.369+0000 7fef7650f700 1 -- 172.21.15.155:0/748393531 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55828dac3b00 con 0x55828d798800 2024-04-19T23:46:35.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.369+0000 7fef7650f700 1 -- 172.21.15.155:0/748393531 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828d8511e0 con 0x55828d798800 2024-04-19T23:46:35.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.370+0000 7fef79d68a80 1 -- 172.21.15.155:0/748393531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 msgr2=0x55828da80580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.370+0000 7fef79d68a80 1 --2- 172.21.15.155:0/748393531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x55828e571740 tx=0x55828d889800 comp rx=0 tx=0).stop 2024-04-19T23:46:35.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.370+0000 7fef79d68a80 1 -- 172.21.15.155:0/748393531 shutdown_connections 2024-04-19T23:46:35.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.370+0000 7fef79d68a80 1 --2- 172.21.15.155:0/748393531 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.370+0000 7fef79d68a80 1 -- 172.21.15.155:0/748393531 >> 172.21.15.155:0/748393531 conn(0x55828d798400 msgr2=0x55828d885000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.370+0000 7fef79d68a80 1 -- 172.21.15.155:0/748393531 shutdown_connections 2024-04-19T23:46:35.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.370+0000 7fef79d68a80 1 -- 172.21.15.155:0/748393531 wait complete. 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.370+0000 7fef79d68a80 1 Processor -- start 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.370+0000 7fef79d68a80 1 -- start start 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.370+0000 7fef79d68a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.370+0000 7fef79d68a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828d83a3c0 con 0x55828d798800 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.371+0000 7fef77d12700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.371+0000 7fef77d12700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40810/0 (socket says 172.21.15.155:40810) 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.371+0000 7fef77d12700 1 -- 172.21.15.155:0/1307222581 learned_addr learned my addr 172.21.15.155:0/1307222581 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.371+0000 7fef77d12700 1 -- 172.21.15.155:0/1307222581 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55828d7c1a00 con 0x55828d798800 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.371+0000 7fef77d12700 1 --2- 172.21.15.155:0/1307222581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x55828e5715f0 tx=0x55828d889920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.371+0000 7fef74d0c700 1 -- 172.21.15.155:0/1307222581 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828d8514a0 con 0x55828d798800 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.371+0000 7fef74d0c700 1 -- 172.21.15.155:0/1307222581 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55828dac3c80 con 0x55828d798800 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.371+0000 7fef79d68a80 1 -- 172.21.15.155:0/1307222581 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55828d7c1860 con 0x55828d798800 2024-04-19T23:46:35.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.371+0000 7fef74d0c700 1 -- 172.21.15.155:0/1307222581 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828d851600 con 0x55828d798800 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.371+0000 7fef79d68a80 1 -- 172.21.15.155:0/1307222581 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55828d7c16c0 con 0x55828d798800 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.372+0000 7fef79d68a80 1 Processor -- start 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.372+0000 7fef79d68a80 1 -- start start 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.372+0000 7fef74d0c700 1 -- 172.21.15.155:0/1307222581 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55828e53ab00 con 0x55828d798800 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.372+0000 7fef79d68a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 0x55828da80b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.372+0000 7fef79d68a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828d83a000 con 0x55828d799400 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.372+0000 7fef74d0c700 1 --2- 172.21.15.155:0/1307222581 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828db1e000 0x55828da81080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.372+0000 7fef74d0c700 1 -- 172.21.15.155:0/1307222581 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55828d813180 con 0x55828d798800 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.372+0000 7fef78513700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 0x55828da80b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.372+0000 7fef78513700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 0x55828da80b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40816/0 (socket says 172.21.15.155:40816) 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.372+0000 7fef78513700 1 -- 172.21.15.155:0/366504704 learned_addr learned my addr 172.21.15.155:0/366504704 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.372+0000 7fef77d12700 1 --2- 172.21.15.155:0/1307222581 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828db1e000 0x55828da81080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef78513700 1 -- 172.21.15.155:0/366504704 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55828d7c0000 con 0x55828d799400 2024-04-19T23:46:35.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef77d12700 1 --2- 172.21.15.155:0/1307222581 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828db1e000 0x55828da81080 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55828e62eed0 tx=0x55828dae4780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef78513700 1 --2- 172.21.15.155:0/366504704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 0x55828da80b00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55828e62e750 tx=0x55828dae4a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dae8ea86776dce6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef72507700 1 -- 172.21.15.155:0/366504704 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828d8514a0 con 0x55828d799400 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef72507700 1 -- 172.21.15.155:0/366504704 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55828d839c80 con 0x55828d799400 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef72507700 1 -- 172.21.15.155:0/366504704 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828d851600 con 0x55828d799400 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef79d68a80 1 -- 172.21.15.155:0/366504704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 msgr2=0x55828da80b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef79d68a80 1 --2- 172.21.15.155:0/366504704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 0x55828da80b00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55828e62e750 tx=0x55828dae4a80 comp rx=0 tx=0).stop 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef79d68a80 1 -- 172.21.15.155:0/366504704 shutdown_connections 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef79d68a80 1 --2- 172.21.15.155:0/366504704 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 0x55828da80b00 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef79d68a80 1 -- 172.21.15.155:0/366504704 >> 172.21.15.155:0/366504704 conn(0x55828d798c00 msgr2=0x55828d885800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef79d68a80 1 -- 172.21.15.155:0/366504704 shutdown_connections 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.373+0000 7fef79d68a80 1 -- 172.21.15.155:0/366504704 wait complete. 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.374+0000 7fef79d68a80 1 Processor -- start 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.374+0000 7fef79d68a80 1 -- start start 2024-04-19T23:46:35.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.374+0000 7fef79d68a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 0x55828da80b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.374+0000 7fef79d68a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828d7d4640 con 0x55828d799400 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.374+0000 7fef78513700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 0x55828da80b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.374+0000 7fef78513700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 0x55828da80b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40826/0 (socket says 172.21.15.155:40826) 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.374+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 learned_addr learned my addr 172.21.15.155:0/1833391994 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.374+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55828d7c0ea0 con 0x55828d799400 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.375+0000 7fef78513700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 0x55828da80b00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x55828e62e7e0 tx=0x55828dae46c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.375+0000 7fef70d04700 1 -- 172.21.15.155:0/1833391994 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828d851760 con 0x55828d799400 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.375+0000 7fef70d04700 1 -- 172.21.15.155:0/1833391994 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55828d839b00 con 0x55828d799400 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.375+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55828d7c0820 con 0x55828d799400 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.375+0000 7fef70d04700 1 -- 172.21.15.155:0/1833391994 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828d8514a0 con 0x55828d799400 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.375+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55828d7c09c0 con 0x55828d799400 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.376+0000 7fef70d04700 1 -- 172.21.15.155:0/1833391994 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55828e53adc0 con 0x55828d799400 2024-04-19T23:46:35.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.376+0000 7fef70d04700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828db1ec00 0x55828da81600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.376+0000 7fef70d04700 1 -- 172.21.15.155:0/1833391994 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55828d813340 con 0x55828d799400 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.376+0000 7fef77511700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828db1ec00 0x55828da81600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.376+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.376+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55828d799800 0x55828da81b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.376+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828d799c00 con 0x55828d799800 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.376+0000 7fef78513700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55828d799800 0x55828da81b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.376+0000 7fef77511700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828db1ec00 0x55828da81600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55828db21a70 tx=0x55828dae5920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.376+0000 7fef78513700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55828d799800 0x55828da81b80 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 20 realm 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828db1f000 con 0x55828d799800 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828db1f400 con 0x55828d799800 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828db1f800 con 0x55828d799800 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.377+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828db1fc00 con 0x55828d799800 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.378+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.378+0000 7fef79d68a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.378+0000 7fef79d68a80 20 searching for the correct realm 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.378+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55828db1f000 0x55828da82100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.378+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828db1f400 con 0x55828db1f000 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.378+0000 7fef77d12700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55828db1f000 0x55828da82100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.378+0000 7fef77d12700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55828db1f000 0x55828da82100 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.379+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.379+0000 7fef77d12700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55828db1f400 0x55828da82c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.379+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a000 con 0x55828db1f400 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.379+0000 7fef77511700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55828db1f400 0x55828da82c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.379+0000 7fef77511700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55828db1f400 0x55828da82c00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.379+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.379+0000 7fef77511700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55828e62a000 0x55828da83180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.379+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828e62a000 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.379+0000 7fef78513700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55828e62a000 0x55828da83180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.380+0000 7fef78513700 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55828e62a000 0x55828da83180 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.380+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.380+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828d799800 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.380+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.380+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828d799800 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.380+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.380+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828d799800 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.381+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.381+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828e62a000 2024-04-19T23:46:35.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.381+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.381+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f400 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.381+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.381+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f000 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.381+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.381+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828d799800 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.382+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.382+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828e62a000 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.382+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.382+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828d799800 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.382+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.382+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f400 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.382+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.382+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f000 2024-04-19T23:46:35.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.383+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.383+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f000 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.383+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.383+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f400 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.383+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.383+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f000 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.383+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.383+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f000 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.384+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.384+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828d799800 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.384+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.384+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828d799800 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.384+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.384+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828e62a000 2024-04-19T23:46:35.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.384+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.384+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f000 2024-04-19T23:46:35.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.385+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.385+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f400 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.385+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.385+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828d799800 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.385+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.385+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828e62a000 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.385+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.385+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f000 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.386+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.386+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828e62a000 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.386+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.386+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f400 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.386+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.386+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f000 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.386+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.386+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828e62a000 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.387+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.387+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828d799800 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.387+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.387+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f400 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.387+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.387+0000 7fef79d68a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.387+0000 7fef79d68a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.387+0000 7fef79d68a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.387+0000 7fef79d68a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.387+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.387+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828d799c00 con 0x55828d799800 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62ac00 con 0x55828d799800 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62b000 con 0x55828db1f400 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 20 zone default found 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 4 Realm: () 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 20 zonegroup default 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.388+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62b400 con 0x55828e62a000 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef79d68a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62b800 con 0x55828db1f000 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef79d68a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62bc00 con 0x55828db1f000 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef79d68a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef79d68a80 20 started sync module instance, tier type = 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef79d68a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.389+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62ac00 con 0x55828db1f400 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.390+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.390+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94019210672896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828d799c00 con 0x55828db1f400 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.390+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828db1f800 con 0x55828d799800 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.391+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94019210672896] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.391+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.391+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94019210674048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828db1fc00 con 0x55828d799800 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.391+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828db1f000 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.392+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94019210674048] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.393+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.393+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94019210675200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62b000 con 0x55828db1f000 2024-04-19T23:46:35.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.393+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62ac00 con 0x55828db1f400 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.394+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.394+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94019210676352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a400 con 0x55828db1f400 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.394+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62b800 con 0x55828d799800 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.394+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94019210675200] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.395+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.395+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94019210677504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62bc00 con 0x55828d799800 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.395+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62a800 con 0x55828e62a000 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.395+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94019210676352] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.396+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.396+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94019210678656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62b400 con 0x55828e62a000 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.396+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94019210677504] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.396+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62b800 con 0x55828e62a000 2024-04-19T23:46:35.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.397+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94019210678656] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.397+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.397+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94019210679808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62bc00 con 0x55828e62a000 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.397+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828db1f800 con 0x55828e62a000 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.398+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.398+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94019210679808] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.398+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94019210680960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828db1fc00 con 0x55828e62a000 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.398+0000 7fef79d68a80 20 add_watcher() i=0 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.398+0000 7fef79d68a80 20 add_watcher() i=1 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.398+0000 7fef79d68a80 20 add_watcher() i=2 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.398+0000 7fef79d68a80 20 add_watcher() i=3 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.398+0000 7fef79d68a80 20 add_watcher() i=4 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.398+0000 7fef79d68a80 20 add_watcher() i=5 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.398+0000 7fef79d68a80 20 add_watcher() i=6 2024-04-19T23:46:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.399+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94019210680960] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.399+0000 7fef79d68a80 20 add_watcher() i=7 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.399+0000 7fef79d68a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.399+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828db1f800 con 0x55828d799800 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.399+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.399+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94019212189696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828db1fc00 con 0x55828d799800 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.400+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94019212189696] v32'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.400+0000 7fef5ece0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.401+0000 7fef79d68a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.401+0000 7fef79d68a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.401+0000 7fef79d68a80 1 Processor -- start 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.401+0000 7fef79d68a80 1 -- start start 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.401+0000 7fef79d68a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.401+0000 7fef79d68a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828d7d4780 con 0x55828e62b400 2024-04-19T23:46:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.401+0000 7fef77511700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.401+0000 7fef77511700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40834/0 (socket says 172.21.15.155:40834) 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.401+0000 7fef77511700 1 -- 172.21.15.155:0/4476633 learned_addr learned my addr 172.21.15.155:0/4476633 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.401+0000 7fef77511700 1 -- 172.21.15.155:0/4476633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55828d7c0b60 con 0x55828e62b400 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.402+0000 7fef77511700 1 --2- 172.21.15.155:0/4476633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x55828dbf20c0 tx=0x55828dae5d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab4ed4eedbcb4f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.402+0000 7fef5e4df700 1 -- 172.21.15.155:0/4476633 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828dc02000 con 0x55828e62b400 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.402+0000 7fef5e4df700 1 -- 172.21.15.155:0/4476633 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55828dc04000 con 0x55828e62b400 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.402+0000 7fef5e4df700 1 -- 172.21.15.155:0/4476633 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828dc02160 con 0x55828e62b400 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.402+0000 7fef79d68a80 1 -- 172.21.15.155:0/4476633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 msgr2=0x55828da82680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.402+0000 7fef79d68a80 1 --2- 172.21.15.155:0/4476633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x55828dbf20c0 tx=0x55828dae5d40 comp rx=0 tx=0).stop 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.402+0000 7fef79d68a80 1 -- 172.21.15.155:0/4476633 shutdown_connections 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.402+0000 7fef79d68a80 1 --2- 172.21.15.155:0/4476633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.402+0000 7fef79d68a80 1 -- 172.21.15.155:0/4476633 >> 172.21.15.155:0/4476633 conn(0x55828e62a800 msgr2=0x55828d886000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.403+0000 7fef79d68a80 1 -- 172.21.15.155:0/4476633 shutdown_connections 2024-04-19T23:46:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.403+0000 7fef79d68a80 1 -- 172.21.15.155:0/4476633 wait complete. 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.403+0000 7fef79d68a80 1 Processor -- start 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.403+0000 7fef79d68a80 1 -- start start 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.403+0000 7fef79d68a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.403+0000 7fef79d68a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828d83a000 con 0x55828e62b400 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.403+0000 7fef77511700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.403+0000 7fef77511700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40846/0 (socket says 172.21.15.155:40846) 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.403+0000 7fef77511700 1 -- 172.21.15.155:0/4171030246 learned_addr learned my addr 172.21.15.155:0/4171030246 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.404+0000 7fef77511700 1 -- 172.21.15.155:0/4171030246 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55828d7c0d00 con 0x55828e62b400 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.404+0000 7fef77511700 1 --2- 172.21.15.155:0/4171030246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x55828dbf2d80 tx=0x55828dae5e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.404+0000 7fef5ccdc700 1 -- 172.21.15.155:0/4171030246 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828dc022c0 con 0x55828e62b400 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.404+0000 7fef5ccdc700 1 -- 172.21.15.155:0/4171030246 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55828dc04180 con 0x55828e62b400 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.404+0000 7fef79d68a80 1 -- 172.21.15.155:0/4171030246 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55828d7c0340 con 0x55828e62b400 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.404+0000 7fef5ccdc700 1 -- 172.21.15.155:0/4171030246 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55828dc02000 con 0x55828e62b400 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.404+0000 7fef79d68a80 1 -- 172.21.15.155:0/4171030246 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55828d7c0b60 con 0x55828e62b400 2024-04-19T23:46:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.405+0000 7fef5ccdc700 1 -- 172.21.15.155:0/4171030246 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55828e53bb80 con 0x55828e62b400 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.405+0000 7fef5ccdc700 1 --2- 172.21.15.155:0/4171030246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828dc86000 0x55828da83700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.405+0000 7fef5ccdc700 1 -- 172.21.15.155:0/4171030246 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55828d813500 con 0x55828e62b400 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.405+0000 7fef79d68a80 5 note: GC not initialized 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.405+0000 7fef78513700 1 --2- 172.21.15.155:0/4171030246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828dc86000 0x55828da83700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.405+0000 7fef78513700 1 --2- 172.21.15.155:0/4171030246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828dc86000 0x55828da83700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55828db83cb0 tx=0x55828dae5b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.406+0000 7fef5a4d7700 20 reqs_thread_entry: start 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.406+0000 7fef79d68a80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.406+0000 7fef79d68a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.406+0000 7fef584d3700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:05 2024 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.406+0000 7fef57cb1700 20 reqs_thread_entry: start 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.406+0000 7fef79d68a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.406+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828e62bc00 con 0x55828d799800 2024-04-19T23:46:35.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.407+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.407+0000 7fef79d68a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:46:35.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.407+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828dc86400 con 0x55828e62a000 2024-04-19T23:46:35.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.407+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.408+0000 7fef5ece0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.408+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94019212189696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828dc86800 con 0x55828d799800 2024-04-19T23:46:35.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.409+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94019212189696] v32'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.409+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94019210672896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828dc86c00 con 0x55828db1f400 2024-04-19T23:46:35.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.410+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94019210672896] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.410+0000 7fef79d68a80 20 remove_watcher() i=0 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.410+0000 7fef79d68a80 2 removed watcher, disabling cache 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.410+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94019210674048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828dc87000 con 0x55828d799800 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.411+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94019210674048] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.411+0000 7fef79d68a80 20 remove_watcher() i=1 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.411+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94019210675200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828dc87400 con 0x55828db1f000 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.412+0000 7fef77d12700 1 -- 172.21.15.155:0/1833391994 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94019210675200] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdb200 con 0x55828db1f000 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.412+0000 7fef79d68a80 20 remove_watcher() i=2 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.412+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94019210676352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828dc87800 con 0x55828db1f400 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.413+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94019210676352] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdb440 con 0x55828db1f400 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.413+0000 7fef79d68a80 20 remove_watcher() i=3 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.413+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94019210677504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828dc87c00 con 0x55828d799800 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.414+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94019210677504] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828d799800 2024-04-19T23:46:35.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.414+0000 7fef79d68a80 20 remove_watcher() i=4 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.415+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94019210678656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828dc86400 con 0x55828e62a000 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.416+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94019210678656] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.416+0000 7fef79d68a80 20 remove_watcher() i=5 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.416+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94019210679808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828dc86800 con 0x55828e62a000 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.417+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94019210679808] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.417+0000 7fef79d68a80 20 remove_watcher() i=6 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.417+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94019210680960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55828dc87000 con 0x55828e62a000 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef78513700 1 -- 172.21.15.155:0/1833391994 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94019210680960] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55828dbdab40 con 0x55828e62a000 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 20 remove_watcher() i=7 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55828e62a000 msgr2=0x55828da83180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55828e62a000 0x55828da83180 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55828d799800 msgr2=0x55828da81b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55828d799800 0x55828da81b80 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55828db1f400 msgr2=0x55828da82c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55828db1f400 0x55828da82c00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55828db1f000 msgr2=0x55828da82100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55828db1f000 0x55828da82100 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828db1ec00 msgr2=0x55828da81600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828db1ec00 0x55828da81600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55828db21a70 tx=0x55828dae5920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 msgr2=0x55828da80b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1833391994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d799400 0x55828da80b00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x55828e62e7e0 tx=0x55828dae46c0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 reap_dead start 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef77511700 1 -- 172.21.15.155:0/1833391994 reap_dead start 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 shutdown_connections 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 >> 172.21.15.155:0/1833391994 conn(0x55828d798c00 msgr2=0x55828d885800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 shutdown_connections 2024-04-19T23:46:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.418+0000 7fef79d68a80 1 -- 172.21.15.155:0/1833391994 wait complete. 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/4171030246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828dc86000 msgr2=0x55828da83700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 --2- 172.21.15.155:0/4171030246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828dc86000 0x55828da83700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55828db83cb0 tx=0x55828dae5b60 comp rx=0 tx=0).stop 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/4171030246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 msgr2=0x55828da82680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 --2- 172.21.15.155:0/4171030246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x55828dbf2d80 tx=0x55828dae5e60 comp rx=0 tx=0).stop 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/4171030246 shutdown_connections 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 --2- 172.21.15.155:0/4171030246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828dc86000 0x55828da83700 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 --2- 172.21.15.155:0/4171030246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828e62b400 0x55828da82680 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/4171030246 >> 172.21.15.155:0/4171030246 conn(0x55828e62a800 msgr2=0x55828d886000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/4171030246 shutdown_connections 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/4171030246 wait complete. 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/1307222581 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828db1e000 msgr2=0x55828da81080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1307222581 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828db1e000 0x55828da81080 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55828e62eed0 tx=0x55828dae4780 comp rx=0 tx=0).stop 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/1307222581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 msgr2=0x55828da80580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1307222581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x55828e5715f0 tx=0x55828d889920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/1307222581 shutdown_connections 2024-04-19T23:46:35.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1307222581 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55828db1e000 0x55828da81080 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 --2- 172.21.15.155:0/1307222581 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55828d798800 0x55828da80580 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/1307222581 >> 172.21.15.155:0/1307222581 conn(0x55828d798400 msgr2=0x55828d885000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/1307222581 shutdown_connections 2024-04-19T23:46:35.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.419+0000 7fef79d68a80 1 -- 172.21.15.155:0/1307222581 wait complete. 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout: "entries": [ 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout: "buckets": [ 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "", 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [] 2024-04-19T23:46:35.430 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo", 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 236, 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 2, 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.431 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo2", 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.432 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo3", 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.433 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket": "myfoo4", 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: "time": "2024-04-19T23:00:00.000000Z", 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: "epoch": 1713567600, 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: "owner": "foo", 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 0, 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 1, 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 1 2024-04-19T23:46:35.434 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: "summary": [ 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "foo", 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: "categories": [ 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: "category": "delete_bucket", 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 236, 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.435 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 5, 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout: "total": { 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_sent": 236, 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout: "bytes_received": 0, 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout: "ops": 5, 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout: "successful_ops": 4 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:46:35.436 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:46:35.436 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-04-19T23:46:35.437 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-19T23:46:35.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-19T23:46:35.437 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-04-19T23:46:35.490 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:35.490 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:35.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.491+0000 7fb4aa2eca80 1 Processor -- start 2024-04-19T23:46:35.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.491+0000 7fb4aa2eca80 1 -- start start 2024-04-19T23:46:35.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.491+0000 7fb4aa2eca80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x559149870c00 0x559149b58580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.491+0000 7fb4aa2eca80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559149b9b500 con 0x559149870800 2024-04-19T23:46:35.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.491+0000 7fb4aa2eca80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x559149912a00 con 0x559149870c00 2024-04-19T23:46:35.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.491+0000 7fb4a7a95700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x559149870c00 0x559149b58580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.491+0000 7fb4a8296700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x559149870800 0x55914995c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55716/0 (socket says 172.21.15.155:55716) 2024-04-19T23:46:35.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.491+0000 7fb4a8296700 1 -- 172.21.15.155:0/2408615038 learned_addr learned my addr 172.21.15.155:0/2408615038 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:35.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.491+0000 7fb4a7294700 1 -- 172.21.15.155:0/2408615038 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938493253 0 0) 0x55914a63e000 con 0x559149870800 2024-04-19T23:46:35.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.491+0000 7fb4a7294700 1 -- 172.21.15.155:0/2408615038 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x559149b9b680 con 0x559149870800 2024-04-19T23:46:35.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.491+0000 7fb4a7a95700 1 -- 172.21.15.155:0/2408615038 >> v1:172.21.15.76:6789/0 conn(0x559149870800 legacy=0x55914995c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4a7a95700 1 -- 172.21.15.155:0/2408615038 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559149899d40 con 0x559149870c00 2024-04-19T23:46:35.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4a7a95700 1 --2- 172.21.15.155:0/2408615038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870c00 0x559149b58580 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x559149b53890 tx=0x559149961980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d908ba5e35a934 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4a7294700 1 -- 172.21.15.155:0/2408615038 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591499294a0 con 0x559149870c00 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4a7294700 1 -- 172.21.15.155:0/2408615038 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559149b9b500 con 0x559149870c00 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4a7294700 1 -- 172.21.15.155:0/2408615038 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559149929600 con 0x559149870c00 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2408615038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870c00 msgr2=0x559149b58580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/2408615038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870c00 0x559149b58580 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x559149b53890 tx=0x559149961980 comp rx=0 tx=0).stop 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2408615038 shutdown_connections 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/2408615038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870c00 0x559149b58580 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2408615038 >> 172.21.15.155:0/2408615038 conn(0x559149870400 msgr2=0x55914995c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2408615038 shutdown_connections 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.492+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2408615038 wait complete. 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.493+0000 7fb4aa2eca80 1 Processor -- start 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.493+0000 7fb4aa2eca80 1 -- start start 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.493+0000 7fb4aa2eca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.493+0000 7fb4aa2eca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149912500 con 0x559149870800 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.493+0000 7fb4a8296700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.493+0000 7fb4a8296700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40866/0 (socket says 172.21.15.155:40866) 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.493+0000 7fb4a8296700 1 -- 172.21.15.155:0/2835927310 learned_addr learned my addr 172.21.15.155:0/2835927310 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.494+0000 7fb4a8296700 1 -- 172.21.15.155:0/2835927310 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559149899ba0 con 0x559149870800 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.494+0000 7fb4a8296700 1 --2- 172.21.15.155:0/2835927310 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x55914a641d70 tx=0x559149961b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96ffe8829a2dc7c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.494+0000 7fb4a6a93700 1 -- 172.21.15.155:0/2835927310 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591499291e0 con 0x559149870800 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.494+0000 7fb4a6a93700 1 -- 172.21.15.155:0/2835927310 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559149b9bb00 con 0x559149870800 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.494+0000 7fb4a6a93700 1 -- 172.21.15.155:0/2835927310 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591499294a0 con 0x559149870800 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.494+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2835927310 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 msgr2=0x559149b58580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.494+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/2835927310 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x55914a641d70 tx=0x559149961b60 comp rx=0 tx=0).stop 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.494+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2835927310 shutdown_connections 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.494+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/2835927310 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.494+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2835927310 >> 172.21.15.155:0/2835927310 conn(0x559149870400 msgr2=0x55914995d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.495+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2835927310 shutdown_connections 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.495+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2835927310 wait complete. 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.495+0000 7fb4aa2eca80 1 Processor -- start 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.495+0000 7fb4aa2eca80 1 -- start start 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.495+0000 7fb4aa2eca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.495+0000 7fb4aa2eca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591499123c0 con 0x559149870800 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.495+0000 7fb4a8296700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.495+0000 7fb4a8296700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40880/0 (socket says 172.21.15.155:40880) 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.495+0000 7fb4a8296700 1 -- 172.21.15.155:0/988194771 learned_addr learned my addr 172.21.15.155:0/988194771 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.496+0000 7fb4a8296700 1 -- 172.21.15.155:0/988194771 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559149899a00 con 0x559149870800 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.496+0000 7fb4a8296700 1 --2- 172.21.15.155:0/988194771 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55914a641e00 tx=0x559149961920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.496+0000 7fb4a5290700 1 -- 172.21.15.155:0/988194771 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559149929600 con 0x559149870800 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.496+0000 7fb4a5290700 1 -- 172.21.15.155:0/988194771 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559149911c80 con 0x559149870800 2024-04-19T23:46:35.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.496+0000 7fb4a5290700 1 -- 172.21.15.155:0/988194771 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591499291e0 con 0x559149870800 2024-04-19T23:46:35.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.496+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/988194771 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559149899860 con 0x559149870800 2024-04-19T23:46:35.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.496+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/988194771 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591498996c0 con 0x559149870800 2024-04-19T23:46:35.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.496+0000 7fb4aa2eca80 1 Processor -- start 2024-04-19T23:46:35.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4aa2eca80 1 -- start start 2024-04-19T23:46:35.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4aa2eca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 0x559149b58b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4aa2eca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591498ac640 con 0x559149871400 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a8a97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 0x559149b58b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a5290700 1 -- 172.21.15.155:0/988194771 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55914a612b00 con 0x559149870800 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a8a97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 0x559149b58b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40884/0 (socket says 172.21.15.155:40884) 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a8a97700 1 -- 172.21.15.155:0/2144954451 learned_addr learned my addr 172.21.15.155:0/2144954451 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a5290700 1 --2- 172.21.15.155:0/988194771 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149bfc000 0x559149b59080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a5290700 1 -- 172.21.15.155:0/988194771 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5591498eb180 con 0x559149870800 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a8a97700 1 -- 172.21.15.155:0/2144954451 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559149898000 con 0x559149871400 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a8296700 1 --2- 172.21.15.155:0/988194771 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149bfc000 0x559149b59080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a8a97700 1 --2- 172.21.15.155:0/2144954451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 0x559149b58b00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x55914a707020 tx=0x559149961f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e3a3cbde9f0ff2 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a2a8b700 1 -- 172.21.15.155:0/2144954451 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559149929600 con 0x559149871400 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a2a8b700 1 -- 172.21.15.155:0/2144954451 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559149b9a480 con 0x559149871400 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.497+0000 7fb4a2a8b700 1 -- 172.21.15.155:0/2144954451 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591499291e0 con 0x559149871400 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2144954451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 msgr2=0x559149b58b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4a8296700 1 --2- 172.21.15.155:0/988194771 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149bfc000 0x559149b59080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55914a706f90 tx=0x559149bbe2a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/2144954451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 0x559149b58b00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x55914a707020 tx=0x559149961f20 comp rx=0 tx=0).stop 2024-04-19T23:46:35.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2144954451 shutdown_connections 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/2144954451 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 0x559149b58b00 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2144954451 >> 172.21.15.155:0/2144954451 conn(0x559149870c00 msgr2=0x55914995d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2144954451 shutdown_connections 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/2144954451 wait complete. 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4aa2eca80 1 Processor -- start 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4aa2eca80 1 -- start start 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4aa2eca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 0x559149b58b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.498+0000 7fb4aa2eca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591498ac8c0 con 0x559149871400 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.499+0000 7fb4a8a97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 0x559149b58b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.499+0000 7fb4a8a97700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 0x559149b58b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40892/0 (socket says 172.21.15.155:40892) 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.499+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 learned_addr learned my addr 172.21.15.155:0/513634167 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.499+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559149898ea0 con 0x559149871400 2024-04-19T23:46:35.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.499+0000 7fb4a8a97700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 0x559149b58b00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x55914a641e90 tx=0x559149bbe720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.499+0000 7fb4a1288700 1 -- 172.21.15.155:0/513634167 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559149929a20 con 0x559149871400 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.499+0000 7fb4a1288700 1 -- 172.21.15.155:0/513634167 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559149b9a180 con 0x559149871400 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.499+0000 7fb4a1288700 1 -- 172.21.15.155:0/513634167 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559149929600 con 0x559149871400 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.499+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559149898820 con 0x559149871400 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.499+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591498989c0 con 0x559149871400 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.500+0000 7fb4a1288700 1 -- 172.21.15.155:0/513634167 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55914a612dc0 con 0x559149871400 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.500+0000 7fb4a1288700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149bfcc00 0x559149b59600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.500+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.500+0000 7fb4a1288700 1 -- 172.21.15.155:0/513634167 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5591498eb340 con 0x559149871400 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.500+0000 7fb4a7a95700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149bfcc00 0x559149b59600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.500+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559149871800 0x559149b59b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.500+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149871c00 con 0x559149871800 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.500+0000 7fb4a8a97700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559149871800 0x559149b59b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4a7a95700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149bfcc00 0x559149b59600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x559149b53890 tx=0x559149961800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4a8a97700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559149871800 0x559149b59b80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4aa2eca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4aa2eca80 20 realm 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149bfd000 con 0x559149871800 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4aa2eca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4aa2eca80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149bfd400 con 0x559149871800 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4aa2eca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.501+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149bfd800 con 0x559149871800 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.502+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.502+0000 7fb4aa2eca80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.502+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.502+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149bfdc00 con 0x559149871800 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.502+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.502+0000 7fb4aa2eca80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.502+0000 7fb4aa2eca80 20 searching for the correct realm 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.502+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x559149bfd000 0x559149b5a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.502+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149bfd400 con 0x559149bfd000 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.502+0000 7fb4a8296700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x559149bfd000 0x559149b5a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.502+0000 7fb4a8296700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x559149bfd000 0x559149b5a100 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.503+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.503+0000 7fb4a8296700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x559149bfd400 0x559149b5ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.503+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8000 con 0x559149bfd400 2024-04-19T23:46:35.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.503+0000 7fb4a7a95700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x559149bfd400 0x559149b5ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.503+0000 7fb4a7a95700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x559149bfd400 0x559149b5ac00 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.503+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.503+0000 7fb4a7a95700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x559149cb8000 0x559149b5b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.503+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149cb8000 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.504+0000 7fb4a8a97700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x559149cb8000 0x559149b5b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.504+0000 7fb4a8a97700 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x559149cb8000 0x559149b5b180 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.504+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.504+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149871800 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.505+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.505+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149871800 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.505+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.505+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149871800 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.505+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.505+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149cb8000 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.505+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.505+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd400 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.505+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.505+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd000 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.506+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.506+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149871800 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.506+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.506+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149cb8000 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.506+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.506+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149871800 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.506+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.506+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd400 2024-04-19T23:46:35.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.507+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.507+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd000 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.507+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.507+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd000 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.507+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.507+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd400 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.507+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.507+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd000 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.507+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.507+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd000 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.508+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.508+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149871800 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.508+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.508+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149871800 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.508+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.508+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149cb8000 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.508+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.508+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd000 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.509+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.509+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd400 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.509+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.509+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149871800 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.509+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.509+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149cb8000 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.509+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.509+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd000 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.509+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.509+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149cb8000 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.510+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.510+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd400 2024-04-19T23:46:35.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.510+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.510+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd000 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.510+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.510+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149cb8000 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149871800 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd400 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4aa2eca80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4aa2eca80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4aa2eca80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4aa2eca80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149871c00 con 0x559149871800 2024-04-19T23:46:35.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4aa2eca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.511+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8c00 con 0x559149871800 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb9000 con 0x559149bfd400 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 20 zone default found 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 4 Realm: () 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:35.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 20 zonegroup default 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb9400 con 0x559149cb8000 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.512+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb9800 con 0x559149bfd000 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.513+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.513+0000 7fb4aa2eca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.513+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.513+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb9c00 con 0x559149bfd000 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.513+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.513+0000 7fb4aa2eca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.513+0000 7fb4aa2eca80 20 started sync module instance, tier type = 2024-04-19T23:46:35.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.513+0000 7fb4aa2eca80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.513+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8c00 con 0x559149bfd400 2024-04-19T23:46:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.514+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.514+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94082495216384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149871c00 con 0x559149bfd400 2024-04-19T23:46:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.514+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149bfd800 con 0x559149871800 2024-04-19T23:46:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.515+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94082495216384] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.515+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.515+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94082495217536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149bfdc00 con 0x559149871800 2024-04-19T23:46:35.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.515+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149bfd000 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.516+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94082495217536] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.516+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.516+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94082495218688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb9000 con 0x559149bfd000 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.516+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8c00 con 0x559149bfd400 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.517+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94082495218688] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.517+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.517+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94082495219840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8400 con 0x559149bfd400 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.518+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb9800 con 0x559149871800 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.519+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94082495219840] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.519+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.519+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94082495220992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb9c00 con 0x559149871800 2024-04-19T23:46:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.519+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb8800 con 0x559149cb8000 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.520+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.520+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94082495222144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb9400 con 0x559149cb8000 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.520+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb9800 con 0x559149cb8000 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.520+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94082495220992] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.521+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94082495222144] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.521+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.521+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94082495223296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb9c00 con 0x559149cb8000 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.521+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149bfd800 con 0x559149cb8000 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.522+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94082495223296] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.522+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.522+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94082495224448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149bfdc00 con 0x559149cb8000 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.522+0000 7fb4aa2eca80 20 add_watcher() i=0 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.522+0000 7fb4aa2eca80 20 add_watcher() i=1 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.522+0000 7fb4aa2eca80 20 add_watcher() i=2 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.522+0000 7fb4aa2eca80 20 add_watcher() i=3 2024-04-19T23:46:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.522+0000 7fb4aa2eca80 20 add_watcher() i=4 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.522+0000 7fb4aa2eca80 20 add_watcher() i=5 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.522+0000 7fb4aa2eca80 20 add_watcher() i=6 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.523+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94082495224448] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.523+0000 7fb4aa2eca80 20 add_watcher() i=7 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.523+0000 7fb4aa2eca80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.523+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149bfd800 con 0x559149871800 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.523+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.523+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94082496757760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149bfdc00 con 0x559149871800 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.524+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94082496757760] v32'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.524+0000 7fb48f264700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.524+0000 7fb4aa2eca80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.524+0000 7fb4aa2eca80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.525+0000 7fb4aa2eca80 1 Processor -- start 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.525+0000 7fb4aa2eca80 1 -- start start 2024-04-19T23:46:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.525+0000 7fb4aa2eca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.525+0000 7fb4aa2eca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591499123c0 con 0x559149cb9400 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.525+0000 7fb4a7a95700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.525+0000 7fb4a7a95700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40898/0 (socket says 172.21.15.155:40898) 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.525+0000 7fb4a7a95700 1 -- 172.21.15.155:0/3105185343 learned_addr learned my addr 172.21.15.155:0/3105185343 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.525+0000 7fb4a7a95700 1 -- 172.21.15.155:0/3105185343 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559149898b60 con 0x559149cb9400 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.525+0000 7fb4a7a95700 1 --2- 172.21.15.155:0/3105185343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x559149c0f470 tx=0x559149bbfda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837eb48e59072d78 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.526+0000 7fb48ea63700 1 -- 172.21.15.155:0/3105185343 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559149929760 con 0x559149cb9400 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.526+0000 7fb48ea63700 1 -- 172.21.15.155:0/3105185343 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559149ce0000 con 0x559149cb9400 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.526+0000 7fb48ea63700 1 -- 172.21.15.155:0/3105185343 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559149ce2000 con 0x559149cb9400 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.526+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/3105185343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 msgr2=0x559149b5a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.526+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/3105185343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x559149c0f470 tx=0x559149bbfda0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.526+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/3105185343 shutdown_connections 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.526+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/3105185343 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.526+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/3105185343 >> 172.21.15.155:0/3105185343 conn(0x559149cb8800 msgr2=0x55914995e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.526+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/3105185343 shutdown_connections 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.526+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/3105185343 wait complete. 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.527+0000 7fb4aa2eca80 1 Processor -- start 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.527+0000 7fb4aa2eca80 1 -- start start 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.527+0000 7fb4aa2eca80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.527+0000 7fb4aa2eca80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149912500 con 0x559149cb9400 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.527+0000 7fb4a7a95700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.527+0000 7fb4a7a95700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40900/0 (socket says 172.21.15.155:40900) 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.527+0000 7fb4a7a95700 1 -- 172.21.15.155:0/657116691 learned_addr learned my addr 172.21.15.155:0/657116691 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.527+0000 7fb4a7a95700 1 -- 172.21.15.155:0/657116691 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559149898d00 con 0x559149cb9400 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.527+0000 7fb4a7a95700 1 --2- 172.21.15.155:0/657116691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x559149ccd200 tx=0x5591499619e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.527+0000 7fb48d260700 1 -- 172.21.15.155:0/657116691 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559149ce2160 con 0x559149cb9400 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.528+0000 7fb48d260700 1 -- 172.21.15.155:0/657116691 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559149ce0180 con 0x559149cb9400 2024-04-19T23:46:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.528+0000 7fb48d260700 1 -- 172.21.15.155:0/657116691 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559149ce22c0 con 0x559149cb9400 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.528+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/657116691 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559149898340 con 0x559149cb9400 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.528+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/657116691 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559149899d40 con 0x559149cb9400 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.528+0000 7fb48d260700 1 -- 172.21.15.155:0/657116691 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55914a613b80 con 0x559149cb9400 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.528+0000 7fb48d260700 1 --2- 172.21.15.155:0/657116691 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149d5c000 0x559149b5b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.528+0000 7fb48d260700 1 -- 172.21.15.155:0/657116691 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5591498eb500 con 0x559149cb9400 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.529+0000 7fb4aa2eca80 5 note: GC not initialized 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.529+0000 7fb4a8a97700 1 --2- 172.21.15.155:0/657116691 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149d5c000 0x559149b5b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.529+0000 7fb4a8a97700 1 --2- 172.21.15.155:0/657116691 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149d5c000 0x559149b5b700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x559149c59f20 tx=0x559149bbfbc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.529+0000 7fb48aa5b700 20 reqs_thread_entry: start 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.529+0000 7fb4aa2eca80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:35.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb488a57700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:05 2024 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb488235700 20 reqs_thread_entry: start 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149cb9c00 con 0x559149cb8000 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149d5c400 con 0x559149871800 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.530+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149d5c800 con 0x559149cb8000 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~346] v32'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4aa2eca80 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4aa2eca80 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4aa2eca80 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94082496760064 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149d5cc00 con 0x559149cb8000 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== watch-notify(notify (1) cookie 94082495224448 notify 137438953495 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x559149c5bd40 con 0x559149cb8000 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4a2a8b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94082495224448 notifier 4789 bl.length()=522 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(65 notify.7 [notify cookie 94082496760064 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4a2a8b700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4a2a8b700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4a2a8b700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149dce000 con 0x559149cb8000 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== watch-notify(notify_complete (2) cookie 94082496760064 notify 137438953495 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559149d25ba0 con 0x559149cb8000 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.532+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149d5d000 con 0x559149871800 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.533+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'10 uv10 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.533+0000 7fb4aa2eca80 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.534+0000 7fb4aa2eca80 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.534+0000 7fb4aa2eca80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.534+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94082496760064 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149d5d400 con 0x559149cb8000 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.534+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== watch-notify(notify (1) cookie 94082495222144 notify 137438953496 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x559149d25ba0 con 0x559149cb8000 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.534+0000 7fb4a2a8b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94082495222144 notifier 4789 bl.length()=177 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.534+0000 7fb4a2a8b700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-19T23:46:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.534+0000 7fb4a2a8b700 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-19T23:46:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.534+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(68 notify.5 [notify cookie 94082496760064 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.534+0000 7fb4a2a8b700 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149dce400 con 0x559149cb8000 2024-04-19T23:46:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.534+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.534+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== watch-notify(notify_complete (2) cookie 94082496760064 notify 137438953496 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559149d25d40 con 0x559149cb8000 2024-04-19T23:46:35.547 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:46:35.547 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "bar", 2024-04-19T23:46:35.547 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Bar", 2024-04-19T23:46:35.547 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "", 2024-04-19T23:46:35.547 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "bar", 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "NX5QOQKC6BH2IDN8HC7A", 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn" 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:46:35.548 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:46:35.549 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:46:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:46:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:46:35.550 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:46:35.550 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:46:35.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.535+0000 7fb48f264700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.535+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94082496757760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149d5d800 con 0x559149871800 2024-04-19T23:46:35.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.536+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94082496757760] v32'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.536+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94082495216384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149d5dc00 con 0x559149bfd400 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.537+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94082495216384] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.537+0000 7fb4aa2eca80 20 remove_watcher() i=0 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.537+0000 7fb4aa2eca80 2 removed watcher, disabling cache 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.537+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94082495217536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149dce000 con 0x559149871800 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.538+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94082495217536] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.538+0000 7fb4aa2eca80 20 remove_watcher() i=1 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.538+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94082495218688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149dce800 con 0x559149bfd000 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.539+0000 7fb4a8296700 1 -- 172.21.15.155:0/513634167 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94082495218688] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cad200 con 0x559149bfd000 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.539+0000 7fb4aa2eca80 20 remove_watcher() i=2 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.539+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94082495219840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149dcec00 con 0x559149bfd400 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.540+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94082495219840] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cad440 con 0x559149bfd400 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.540+0000 7fb4aa2eca80 20 remove_watcher() i=3 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.540+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94082495220992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149dcf000 con 0x559149871800 2024-04-19T23:46:35.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.541+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94082495220992] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149871800 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.541+0000 7fb4aa2eca80 20 remove_watcher() i=4 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.541+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94082495222144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149dcf400 con 0x559149cb8000 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.542+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94082495222144] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.542+0000 7fb4aa2eca80 20 remove_watcher() i=5 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.542+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94082495223296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149dcf800 con 0x559149cb8000 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.544+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94082495223296] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.544+0000 7fb4aa2eca80 20 remove_watcher() i=6 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.544+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94082495224448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559149dcfc00 con 0x559149cb8000 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4a8a97700 1 -- 172.21.15.155:0/513634167 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94082495224448] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559149cacb40 con 0x559149cb8000 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 20 remove_watcher() i=7 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x559149cb8000 msgr2=0x559149b5b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x559149cb8000 0x559149b5b180 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559149871800 msgr2=0x559149b59b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559149871800 0x559149b59b80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x559149bfd400 msgr2=0x559149b5ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x559149bfd400 0x559149b5ac00 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x559149bfd000 msgr2=0x559149b5a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x559149bfd000 0x559149b5a100 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149bfcc00 msgr2=0x559149b59600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149bfcc00 0x559149b59600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x559149b53890 tx=0x559149961800 comp rx=0 tx=0).stop 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 msgr2=0x559149b58b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/513634167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149871400 0x559149b58b00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x55914a641e90 tx=0x559149bbe720 comp rx=0 tx=0).stop 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 reap_dead start 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4a7a95700 1 -- 172.21.15.155:0/513634167 reap_dead start 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 shutdown_connections 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 >> 172.21.15.155:0/513634167 conn(0x559149870c00 msgr2=0x55914995d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 shutdown_connections 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/513634167 wait complete. 2024-04-19T23:46:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/657116691 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149d5c000 msgr2=0x559149b5b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/657116691 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149d5c000 0x559149b5b700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x559149c59f20 tx=0x559149bbfbc0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/657116691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 msgr2=0x559149b5a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/657116691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x559149ccd200 tx=0x5591499619e0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/657116691 shutdown_connections 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/657116691 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149d5c000 0x559149b5b700 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/657116691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149cb9400 0x559149b5a680 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/657116691 >> 172.21.15.155:0/657116691 conn(0x559149cb8800 msgr2=0x55914995e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/657116691 shutdown_connections 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.545+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/657116691 wait complete. 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.546+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/988194771 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149bfc000 msgr2=0x559149b59080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.546+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/988194771 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149bfc000 0x559149b59080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55914a706f90 tx=0x559149bbe2a0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.546+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/988194771 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 msgr2=0x559149b58580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.546+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/988194771 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55914a641e00 tx=0x559149961920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.546+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/988194771 shutdown_connections 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.546+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/988194771 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559149bfc000 0x559149b59080 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.546+0000 7fb4aa2eca80 1 --2- 172.21.15.155:0/988194771 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559149870800 0x559149b58580 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.546+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/988194771 >> 172.21.15.155:0/988194771 conn(0x559149870400 msgr2=0x55914995d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.546+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/988194771 shutdown_connections 2024-04-19T23:46:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.546+0000 7fb4aa2eca80 1 -- 172.21.15.155:0/988194771 wait complete. 2024-04-19T23:46:35.560 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:46:35.598 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:46:35.603 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-04-19T23:46:35.603 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-19T23:46:35.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-19T23:46:35.603 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-04-19T23:46:35.650 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:35.650 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.650+0000 7f32fb13da80 1 Processor -- start 2024-04-19T23:46:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32fb13da80 1 -- start start 2024-04-19T23:46:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32fb13da80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x557f1ff28800 0x557f20210580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32fb13da80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557f20253500 con 0x557f1ff28c00 2024-04-19T23:46:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32fb13da80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x557f1ffcaa00 con 0x557f1ff28800 2024-04-19T23:46:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32f90e7700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x557f1ff28800 0x557f20210580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32f88e6700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x557f1ff28c00 0x557f20014800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55728/0 (socket says 172.21.15.155:55728) 2024-04-19T23:46:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32f88e6700 1 -- 172.21.15.155:0/2406923038 learned_addr learned my addr 172.21.15.155:0/2406923038 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:35.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32f80e5700 1 -- 172.21.15.155:0/2406923038 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438275963 0 0) 0x557f20cf6000 con 0x557f1ff28c00 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32f80e5700 1 -- 172.21.15.155:0/2406923038 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x557f20253680 con 0x557f1ff28c00 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32f90e7700 1 -- 172.21.15.155:0/2406923038 >> v1:172.21.15.76:6789/0 conn(0x557f1ff28c00 legacy=0x557f20014800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32f90e7700 1 -- 172.21.15.155:0/2406923038 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f1ff51d40 con 0x557f1ff28800 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.651+0000 7f32f90e7700 1 --2- 172.21.15.155:0/2406923038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x557f2020b9e0 tx=0x557f20019980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca91b6a91ea6f74 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.652+0000 7f32f80e5700 1 -- 172.21.15.155:0/2406923038 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f1ffe14a0 con 0x557f1ff28800 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.652+0000 7f32f80e5700 1 -- 172.21.15.155:0/2406923038 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f20253500 con 0x557f1ff28800 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.652+0000 7f32f80e5700 1 -- 172.21.15.155:0/2406923038 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f1ffe1600 con 0x557f1ff28800 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.652+0000 7f32fb13da80 1 -- 172.21.15.155:0/2406923038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 msgr2=0x557f20210580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.652+0000 7f32fb13da80 1 --2- 172.21.15.155:0/2406923038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x557f2020b9e0 tx=0x557f20019980 comp rx=0 tx=0).stop 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.652+0000 7f32fb13da80 1 -- 172.21.15.155:0/2406923038 shutdown_connections 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.652+0000 7f32fb13da80 1 --2- 172.21.15.155:0/2406923038 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.652+0000 7f32fb13da80 1 -- 172.21.15.155:0/2406923038 >> 172.21.15.155:0/2406923038 conn(0x557f1ff28400 msgr2=0x557f20014000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.652+0000 7f32fb13da80 1 -- 172.21.15.155:0/2406923038 shutdown_connections 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.652+0000 7f32fb13da80 1 -- 172.21.15.155:0/2406923038 wait complete. 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.653+0000 7f32fb13da80 1 Processor -- start 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.653+0000 7f32fb13da80 1 -- start start 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.653+0000 7f32fb13da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.653+0000 7f32fb13da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f1ffca500 con 0x557f1ff28800 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.653+0000 7f32f90e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.653+0000 7f32f90e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40918/0 (socket says 172.21.15.155:40918) 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.653+0000 7f32f90e7700 1 -- 172.21.15.155:0/3494937386 learned_addr learned my addr 172.21.15.155:0/3494937386 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32f90e7700 1 -- 172.21.15.155:0/3494937386 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f1ff51ba0 con 0x557f1ff28800 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32f90e7700 1 --2- 172.21.15.155:0/3494937386 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x557f20cf9800 tx=0x557f20019800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2747a1fa8298ad80 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32f78e4700 1 -- 172.21.15.155:0/3494937386 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f1ffe1760 con 0x557f1ff28800 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32f78e4700 1 -- 172.21.15.155:0/3494937386 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f20253980 con 0x557f1ff28800 2024-04-19T23:46:35.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32f78e4700 1 -- 172.21.15.155:0/3494937386 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f1ffe14a0 con 0x557f1ff28800 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32fb13da80 1 -- 172.21.15.155:0/3494937386 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 msgr2=0x557f20210580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3494937386 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x557f20cf9800 tx=0x557f20019800 comp rx=0 tx=0).stop 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32fb13da80 1 -- 172.21.15.155:0/3494937386 shutdown_connections 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3494937386 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32fb13da80 1 -- 172.21.15.155:0/3494937386 >> 172.21.15.155:0/3494937386 conn(0x557f1ff28400 msgr2=0x557f20015000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32fb13da80 1 -- 172.21.15.155:0/3494937386 shutdown_connections 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.654+0000 7f32fb13da80 1 -- 172.21.15.155:0/3494937386 wait complete. 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.655+0000 7f32fb13da80 1 Processor -- start 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.655+0000 7f32fb13da80 1 -- start start 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.655+0000 7f32fb13da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.655+0000 7f32fb13da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f1ffca3c0 con 0x557f1ff28800 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.655+0000 7f32f90e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.655+0000 7f32f90e7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40926/0 (socket says 172.21.15.155:40926) 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.655+0000 7f32f90e7700 1 -- 172.21.15.155:0/3291519801 learned_addr learned my addr 172.21.15.155:0/3291519801 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.655+0000 7f32f90e7700 1 -- 172.21.15.155:0/3291519801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f1ff51a00 con 0x557f1ff28800 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.655+0000 7f32f90e7700 1 --2- 172.21.15.155:0/3291519801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x557f20cf9ec0 tx=0x557f20019980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.656+0000 7f32f60e1700 1 -- 172.21.15.155:0/3291519801 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f1ffe1600 con 0x557f1ff28800 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.656+0000 7f32f60e1700 1 -- 172.21.15.155:0/3291519801 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f20253b00 con 0x557f1ff28800 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.656+0000 7f32fb13da80 1 -- 172.21.15.155:0/3291519801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f1ff51860 con 0x557f1ff28800 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.656+0000 7f32f60e1700 1 -- 172.21.15.155:0/3291519801 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f1ffe18c0 con 0x557f1ff28800 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.656+0000 7f32fb13da80 1 -- 172.21.15.155:0/3291519801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f1ff516c0 con 0x557f1ff28800 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.656+0000 7f32fb13da80 1 Processor -- start 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.656+0000 7f32fb13da80 1 -- start start 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.656+0000 7f32f60e1700 1 -- 172.21.15.155:0/3291519801 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557f20ccab00 con 0x557f1ff28800 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.656+0000 7f32fb13da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 0x557f20210b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.656+0000 7f32fb13da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f1ff64640 con 0x557f1ff29400 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f60e1700 1 --2- 172.21.15.155:0/3291519801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f202b2000 0x557f20211080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f98e8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 0x557f20210b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f60e1700 1 -- 172.21.15.155:0/3291519801 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x557f1ffa3180 con 0x557f1ff28800 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f98e8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 0x557f20210b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40930/0 (socket says 172.21.15.155:40930) 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f98e8700 1 -- 172.21.15.155:0/1457438720 learned_addr learned my addr 172.21.15.155:0/1457438720 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f90e7700 1 --2- 172.21.15.155:0/3291519801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f202b2000 0x557f20211080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f98e8700 1 -- 172.21.15.155:0/1457438720 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f1ff50000 con 0x557f1ff29400 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f90e7700 1 --2- 172.21.15.155:0/3291519801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f202b2000 0x557f20211080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x557f20da9050 tx=0x557f202768a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f98e8700 1 --2- 172.21.15.155:0/1457438720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 0x557f20210b00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x557f20cf99b0 tx=0x557f20276780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35366eb1bc61cf56 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f38dc700 1 -- 172.21.15.155:0/1457438720 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f1ffe1600 con 0x557f1ff29400 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f38dc700 1 -- 172.21.15.155:0/1457438720 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f1ffc9c80 con 0x557f1ff29400 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32f38dc700 1 -- 172.21.15.155:0/1457438720 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f1ffe18c0 con 0x557f1ff29400 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32fb13da80 1 -- 172.21.15.155:0/1457438720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 msgr2=0x557f20210b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.657+0000 7f32fb13da80 1 --2- 172.21.15.155:0/1457438720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 0x557f20210b00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x557f20cf99b0 tx=0x557f20276780 comp rx=0 tx=0).stop 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32fb13da80 1 -- 172.21.15.155:0/1457438720 shutdown_connections 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32fb13da80 1 --2- 172.21.15.155:0/1457438720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 0x557f20210b00 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32fb13da80 1 -- 172.21.15.155:0/1457438720 >> 172.21.15.155:0/1457438720 conn(0x557f1ff28c00 msgr2=0x557f20015800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32fb13da80 1 -- 172.21.15.155:0/1457438720 shutdown_connections 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32fb13da80 1 -- 172.21.15.155:0/1457438720 wait complete. 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32fb13da80 1 Processor -- start 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32fb13da80 1 -- start start 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32fb13da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 0x557f20210b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32fb13da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f1ff648c0 con 0x557f1ff29400 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32f98e8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 0x557f20210b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32f98e8700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 0x557f20210b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40942/0 (socket says 172.21.15.155:40942) 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 learned_addr learned my addr 172.21.15.155:0/3827347644 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.658+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f1ff50ea0 con 0x557f1ff29400 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.659+0000 7f32f98e8700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 0x557f20210b00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x557f20da8930 tx=0x557f20019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.659+0000 7f32f20d9700 1 -- 172.21.15.155:0/3827347644 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f1ffe1760 con 0x557f1ff29400 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.659+0000 7f32f20d9700 1 -- 172.21.15.155:0/3827347644 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f1ffc9b00 con 0x557f1ff29400 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.659+0000 7f32f20d9700 1 -- 172.21.15.155:0/3827347644 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f1ffe1600 con 0x557f1ff29400 2024-04-19T23:46:35.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.659+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f1ff50820 con 0x557f1ff29400 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.659+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f1ff509c0 con 0x557f1ff29400 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.659+0000 7f32f20d9700 1 -- 172.21.15.155:0/3827347644 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557f20ccadc0 con 0x557f1ff29400 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.660+0000 7f32f20d9700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f202b2c00 0x557f20211600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.660+0000 7f32f20d9700 1 -- 172.21.15.155:0/3827347644 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x557f1ffa3340 con 0x557f1ff29400 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.660+0000 7f32f88e6700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f202b2c00 0x557f20211600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.660+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.660+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557f1ff29800 0x557f20211b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.660+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f1ff29c00 con 0x557f1ff29800 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.660+0000 7f32f88e6700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f202b2c00 0x557f20211600 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x557f20cf8030 tx=0x557f20277920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.660+0000 7f32f98e8700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557f1ff29800 0x557f20211b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.660+0000 7f32f98e8700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557f1ff29800 0x557f20211b80 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 20 realm 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3000 con 0x557f1ff29800 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3400 con 0x557f1ff29800 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3800 con 0x557f1ff29800 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.661+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3c00 con 0x557f1ff29800 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.662+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.662+0000 7f32fb13da80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.662+0000 7f32fb13da80 20 searching for the correct realm 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.662+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557f202b3000 0x557f20212100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.662+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3400 con 0x557f202b3000 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.662+0000 7f32f90e7700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557f202b3000 0x557f20212100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.662+0000 7f32f90e7700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557f202b3000 0x557f20212100 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.662+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.663+0000 7f32f90e7700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557f202b3400 0x557f20212c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.663+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a000 con 0x557f202b3400 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.663+0000 7f32f88e6700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557f202b3400 0x557f20212c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.663+0000 7f32f88e6700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557f202b3400 0x557f20212c00 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.663+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.663+0000 7f32f88e6700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557f2036a000 0x557f20213180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.663+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f2036a000 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.663+0000 7f32f98e8700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557f2036a000 0x557f20213180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.664+0000 7f32f98e8700 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557f2036a000 0x557f20213180 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.664+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.664+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f1ff29800 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.664+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.664+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f1ff29800 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.664+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.664+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f1ff29800 2024-04-19T23:46:35.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.664+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.664+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f2036a000 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.665+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.665+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3400 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.665+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.665+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3000 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.665+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.665+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f1ff29800 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.665+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.665+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f2036a000 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.666+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.666+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f1ff29800 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.666+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.666+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3400 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.666+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.666+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3000 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.666+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.666+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3000 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.667+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.667+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3400 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.667+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.667+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3000 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.667+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.667+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3000 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.667+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.667+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f1ff29800 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.667+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.667+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f1ff29800 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.668+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.668+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f2036a000 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.668+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.668+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3000 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.668+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.668+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3400 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.668+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.668+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f1ff29800 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.669+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.669+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f2036a000 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.669+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.669+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3000 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.669+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.669+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f2036a000 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.669+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.669+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3400 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.670+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.670+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3000 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.670+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.670+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f2036a000 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.670+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.670+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f1ff29800 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.670+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.670+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3400 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:35.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f1ff29c00 con 0x557f1ff29800 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036ac00 con 0x557f1ff29800 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036b000 con 0x557f202b3400 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 zone default found 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 4 Realm: () 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 zonegroup default 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.671+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036b400 con 0x557f2036a000 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32fb13da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036b800 con 0x557f202b3000 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32fb13da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036bc00 con 0x557f202b3000 2024-04-19T23:46:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32fb13da80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32fb13da80 20 started sync module instance, tier type = 2024-04-19T23:46:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32fb13da80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.672+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036ac00 con 0x557f202b3400 2024-04-19T23:46:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.673+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.673+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94004488207104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f1ff29c00 con 0x557f202b3400 2024-04-19T23:46:35.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.673+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3800 con 0x557f1ff29800 2024-04-19T23:46:35.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.674+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94004488207104] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.675+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.675+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94004488208256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3c00 con 0x557f1ff29800 2024-04-19T23:46:35.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.675+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f202b3000 2024-04-19T23:46:35.705 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.676+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94004488208256] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.676+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.676+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94004488209408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036b000 con 0x557f202b3000 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.676+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036ac00 con 0x557f202b3400 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.677+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94004488209408] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.677+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.677+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94004488210560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a400 con 0x557f202b3400 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.677+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036b800 con 0x557f1ff29800 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.678+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94004488210560] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.678+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.678+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94004488211712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036bc00 con 0x557f1ff29800 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.678+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036a800 con 0x557f2036a000 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.679+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94004488211712] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.679+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.679+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94004488212864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036b400 con 0x557f2036a000 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.679+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036b800 con 0x557f2036a000 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.680+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94004488212864] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.680+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.680+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94004488214016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036bc00 con 0x557f2036a000 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.680+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3800 con 0x557f2036a000 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.681+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.681+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94004488214016] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.681+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94004488215168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3c00 con 0x557f2036a000 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.681+0000 7f32fb13da80 20 add_watcher() i=0 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.681+0000 7f32fb13da80 20 add_watcher() i=1 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.681+0000 7f32fb13da80 20 add_watcher() i=2 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.681+0000 7f32fb13da80 20 add_watcher() i=3 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.681+0000 7f32fb13da80 20 add_watcher() i=4 2024-04-19T23:46:35.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.681+0000 7f32fb13da80 20 add_watcher() i=5 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.681+0000 7f32fb13da80 20 add_watcher() i=6 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.682+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94004488215168] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.682+0000 7f32fb13da80 20 add_watcher() i=7 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.682+0000 7f32fb13da80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.682+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3800 con 0x557f1ff29800 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.682+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.682+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94004489723904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3c00 con 0x557f1ff29800 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.683+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94004489723904] v32'213 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.683+0000 7f32e00b5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.684+0000 7f32fb13da80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.684+0000 7f32fb13da80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.684+0000 7f32fb13da80 1 Processor -- start 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.684+0000 7f32fb13da80 1 -- start start 2024-04-19T23:46:35.708 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.684+0000 7f32fb13da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.684+0000 7f32fb13da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f1ffca3c0 con 0x557f2036b400 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.684+0000 7f32f88e6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.684+0000 7f32f88e6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40954/0 (socket says 172.21.15.155:40954) 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.684+0000 7f32f88e6700 1 -- 172.21.15.155:0/2535069799 learned_addr learned my addr 172.21.15.155:0/2535069799 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.684+0000 7f32f88e6700 1 -- 172.21.15.155:0/2535069799 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f1ff50b60 con 0x557f2036b400 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.684+0000 7f32f88e6700 1 --2- 172.21.15.155:0/2535069799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x557f203820c0 tx=0x557f20277d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a26185ced87c06 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.685+0000 7f32df8b4700 1 -- 172.21.15.155:0/2535069799 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f20390000 con 0x557f2036b400 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.685+0000 7f32df8b4700 1 -- 172.21.15.155:0/2535069799 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f20388180 con 0x557f2036b400 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.685+0000 7f32df8b4700 1 -- 172.21.15.155:0/2535069799 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f20390160 con 0x557f2036b400 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.685+0000 7f32fb13da80 1 -- 172.21.15.155:0/2535069799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 msgr2=0x557f20212680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.685+0000 7f32fb13da80 1 --2- 172.21.15.155:0/2535069799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x557f203820c0 tx=0x557f20277d40 comp rx=0 tx=0).stop 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.685+0000 7f32fb13da80 1 -- 172.21.15.155:0/2535069799 shutdown_connections 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.685+0000 7f32fb13da80 1 --2- 172.21.15.155:0/2535069799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.685+0000 7f32fb13da80 1 -- 172.21.15.155:0/2535069799 >> 172.21.15.155:0/2535069799 conn(0x557f2036a800 msgr2=0x557f20016000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.685+0000 7f32fb13da80 1 -- 172.21.15.155:0/2535069799 shutdown_connections 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.685+0000 7f32fb13da80 1 -- 172.21.15.155:0/2535069799 wait complete. 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32fb13da80 1 Processor -- start 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32fb13da80 1 -- start start 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32fb13da80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32fb13da80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f1ffca500 con 0x557f2036b400 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32f88e6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32f88e6700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40968/0 (socket says 172.21.15.155:40968) 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32f88e6700 1 -- 172.21.15.155:0/3292913608 learned_addr learned my addr 172.21.15.155:0/3292913608 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32f88e6700 1 -- 172.21.15.155:0/3292913608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f1ff50d00 con 0x557f2036b400 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32f88e6700 1 --2- 172.21.15.155:0/3292913608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x557f203822d0 tx=0x557f20277e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32de0b1700 1 -- 172.21.15.155:0/3292913608 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f203902c0 con 0x557f2036b400 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32de0b1700 1 -- 172.21.15.155:0/3292913608 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f20388300 con 0x557f2036b400 2024-04-19T23:46:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.686+0000 7f32de0b1700 1 -- 172.21.15.155:0/3292913608 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557f20390000 con 0x557f2036b400 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.687+0000 7f32fb13da80 1 -- 172.21.15.155:0/3292913608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f1ff50340 con 0x557f2036b400 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.687+0000 7f32fb13da80 1 -- 172.21.15.155:0/3292913608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f1ff50b60 con 0x557f2036b400 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.687+0000 7f32de0b1700 1 -- 172.21.15.155:0/3292913608 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x557f20ccbb80 con 0x557f2036b400 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.687+0000 7f32de0b1700 1 --2- 172.21.15.155:0/3292913608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f20412000 0x557f20213700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.687+0000 7f32de0b1700 1 -- 172.21.15.155:0/3292913608 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x557f1ffa3500 con 0x557f2036b400 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.687+0000 7f32fb13da80 5 note: GC not initialized 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.687+0000 7f32f98e8700 1 --2- 172.21.15.155:0/3292913608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f20412000 0x557f20213700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.688+0000 7f32f98e8700 1 --2- 172.21.15.155:0/3292913608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f20412000 0x557f20213700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x557f20309f20 tx=0x557f20277b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.688+0000 7f32db8ac700 20 reqs_thread_entry: start 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.688+0000 7f32fb13da80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32fb13da80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32d98a8700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:06 2024 2024-04-19T23:46:35.711 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32d9086700 20 reqs_thread_entry: start 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32fb13da80 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036bc00 con 0x557f2036a000 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(62 bar [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32fb13da80 20 rados_obj.operate() r=0 bl.length=346 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32fb13da80 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32fb13da80 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32fb13da80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.689+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20412400 con 0x557f202b3400 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.690+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(63 bud [create,call,writefull 0~181] v32'1 uv1 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.690+0000 7f32fb13da80 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.690+0000 7f32fb13da80 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.690+0000 7f32fb13da80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-19T23:46:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.690+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94004489726208 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20412800 con 0x557f2036a000 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== watch-notify(notify (1) cookie 94004488212864 notify 137438953498 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x557f20315d40 con 0x557f2036a000 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32f38dc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94004488212864 notifier 4797 bl.length()=357 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32f38dc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32f38dc700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(64 notify.5 [notify cookie 94004489726208 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32f38dc700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047e000 con 0x557f2036a000 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== watch-notify(notify_complete (2) cookie 94004489726208 notify 137438953498 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557f20315a00 con 0x557f2036a000 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20412c00 con 0x557f1ff29800 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32fb13da80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 : miss 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.691+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.692+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 8.8 8:152d67b9:root::.bucket.meta.myfoo6%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20413000 con 0x557f1ff29800 2024-04-19T23:46:35.713 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.692+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(67 .bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.692+0000 7f32fb13da80 20 rados_obj.operate() r=0 bl.length=353 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.692+0000 7f32fb13da80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 info.flags=0x17 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.692+0000 7f32fb13da80 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 to cache LRU end 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.692+0000 7f32fb13da80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.692+0000 7f32fb13da80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.692+0000 7f32fb13da80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.692+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 8.8 8:152d67b9:root::.bucket.meta.myfoo6%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20413800 con 0x557f1ff29800 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.693+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(68 .bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 [delete,create,call,call,writefull 0~353,setxattr (117)] v32'4 uv4 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.693+0000 7f32fb13da80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 info.flags=0x17 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.693+0000 7f32fb13da80 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 to cache LRU end 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.693+0000 7f32fb13da80 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.693+0000 7f32fb13da80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7, ofs0, ns] 2024-04-19T23:46:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.693+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify cookie 94004489726208 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047e000 con 0x557f2036a000 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== watch-notify(notify (1) cookie 94004488212864 notify 137438953499 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x557f20315a00 con 0x557f2036a000 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(69 notify.5 [notify cookie 94004489726208 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32f38dc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94004488212864 notifier 4797 bl.length()=721 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32f38dc700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 info.flags=0x17 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32f38dc700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 to cache LRU end 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32f38dc700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32f38dc700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047e400 con 0x557f2036a000 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(70 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== watch-notify(notify_complete (2) cookie 94004489726208 notify 137438953499 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557f20315ba0 con 0x557f2036a000 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32fb13da80 20 handle_bi_update(): bucket=:myfoo6[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7]): orig_sources= new_sources= 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32fb13da80 20 handle_bi_update(): bucket=:myfoo6[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7]): potential sources added=[] removed=[] 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32fb13da80 20 handle_bi_update(): bucket=:myfoo6[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7]): orig_dests= new_dests= 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32fb13da80 20 handle_bi_update(): bucket=:myfoo6[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7]): potential dests added=[] removed=[] 2024-04-19T23:46:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.694+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:71 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047e800 con 0x557f1ff29800 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.695+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(71 bar.buckets [call] v32'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.695+0000 7f32fb13da80 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.695+0000 7f32fb13da80 20 rados->read ofs=0 len=0 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.695+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047ec00 con 0x557f1ff29800 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.696+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(72 myfoo6 [call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 234+0+289 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.696+0000 7f32fb13da80 20 rados_obj.operate() r=0 bl.length=166 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.696+0000 7f32fb13da80 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.696+0000 7f32fb13da80 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.696+0000 7f32fb13da80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.696+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047f400 con 0x557f1ff29800 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(73 myfoo6 [delete,create,call,call,writefull 0~166] v32'19 uv19 ondisk = 0) v8 ==== 318+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32fb13da80 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x17 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32fb13da80 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32fb13da80 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-19T23:46:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94004489726208 in=352b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047f800 con 0x557f202b3400 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== watch-notify(notify (1) cookie 94004488210560 notify 137438953487 ret 0) v3 ==== 382+0+0 (crc 0 0 0) 0x557f203141a0 con 0x557f202b3400 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32f38dc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94004488210560 notifier 4797 bl.length()=340 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32f38dc700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x17 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32f38dc700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(74 notify.3 [notify cookie 94004489726208 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32f38dc700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20412400 con 0x557f202b3400 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== watch-notify(notify_complete (2) cookie 94004489726208 notify 137438953487 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557f20314340 con 0x557f202b3400 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.697+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:76 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047fc00 con 0x557f1ff29800 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.698+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(76 bud.buckets [call] v32'3 uv3 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.698+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:77 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20412800 con 0x557f1ff29800 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(77 myfoo6 [delete,create,call,writefull 0~166] v32'20 uv20 ondisk = 0) v8 ==== 276+0+0 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32fb13da80 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-19T23:46:35.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32fb13da80 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32fb13da80 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify cookie 94004489726208 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20412c00 con 0x557f202b3400 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== watch-notify(notify (1) cookie 94004488210560 notify 137438953488 ret 0) v3 ==== 358+0+0 (crc 0 0 0) 0x557f20314340 con 0x557f202b3400 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32f30db700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94004488210560 notifier 4797 bl.length()=316 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(78 notify.3 [notify cookie 94004489726208 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32f30db700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32f30db700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32f30db700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:79 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20413c00 con 0x557f202b3400 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 20 ==== watch-notify(notify_complete (2) cookie 94004489726208 notify 137438953488 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557f203144e0 con 0x557f202b3400 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 21 ==== osd_op_reply(79 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.700+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:80 4.22 4:44dc655f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20413000 con 0x557f1ff29800 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.701+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(80 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.701+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:81 4.7 4:e2a1b195:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036bc00 con 0x557f2036a000 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.701+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(81 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x557f20362b40 con 0x557f2036a000 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.701+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:82 4.0 4:02c2d88f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3800 con 0x557f202b3000 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.701+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(82 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.701+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:83 4.27 4:e6aa74b9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3c00 con 0x557f1ff29800 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.702+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(83 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x557f20362b40 con 0x557f1ff29800 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.702+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:84 4.32 4:4ef98a53:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047f800 con 0x557f1ff29800 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.702+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 33 ==== osd_op_reply(84 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x557f20362d80 con 0x557f1ff29800 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.702+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:85 4.36 4:6de450db:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047e000 con 0x557f1ff29800 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.702+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 34 ==== osd_op_reply(85 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x557f20362d80 con 0x557f1ff29800 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.702+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:86 4.19 4:9b5f424f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047e400 con 0x557f202b3000 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.702+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(86 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.6 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.702+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:87 4.34 4:2f503fb1:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047e800 con 0x557f202b3400 2024-04-19T23:46:35.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.703+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 22 ==== osd_op_reply(87 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.703+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:88 4.1f 4:fb7400a3:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047ec00 con 0x557f202b3000 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.703+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(88 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.703+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:89 4.39 4:9c616a46:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047f400 con 0x557f202b3000 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.703+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(89 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9 [call out=377b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+377 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.703+0000 7f32fb13da80 10 cls_bucket_list_unordered: got thirteen 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.703+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:90 4.f 4:f3cf2b99:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20413400 con 0x557f1ff29800 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 35 ==== osd_op_reply(90 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x557f20362d80 con 0x557f1ff29800 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 get_obj_state: rctx=0x557f20356770 obj=myfoo6:thirteen state=0x557f204881e8 s->prefetch_data=0 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:91 3.35 3:ad09574f:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20413800 con 0x557f1ff29800 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 36 ==== osd_op_reply(91 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+870 (crc 0 0 0) 0x557f20362d80 con 0x557f1ff29800 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 10 manifest: total_size = 8 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 get_obj_state: setting s->obj_tag to 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4221.2691208560666204956 2024-04-19T23:46:35.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 Read xattr rgw_rados: user.rgw.acl 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 Read xattr rgw_rados: user.rgw.content_type 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 Read xattr rgw_rados: user.rgw.etag 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 Read xattr rgw_rados: user.rgw.idtag 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 Read xattr rgw_rados: user.rgw.manifest 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 Read xattr rgw_rados: user.rgw.source_zone 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 get_obj_state: rctx=0x557f20356770 obj=myfoo6:thirteen state=0x557f204881e8 s->prefetch_data=0 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 : hit (requested=0x17, cached=0x17) 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 20 bucket index object: default.rgw.buckets.index:.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.704+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:92 4.39 4:9c616a46:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047f000 con 0x557f202b3000 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.705+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(92 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9 [stat,call,call] v32'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.705+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:93 3.35 3:ad09574f:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047fc00 con 0x557f1ff29800 2024-04-19T23:46:35.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.706+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 37 ==== osd_op_reply(93 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v32'2 uv2 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f1ff29800 2024-04-19T23:46:35.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.706+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:94 4.39 4:9c616a46:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047e000 con 0x557f202b3000 2024-04-19T23:46:35.725 INFO:teuthology.orchestra.run.smithi155.stderr:1 objects processed in :myfoo6[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7]). Next marker thirteen 2024-04-19T23:46:35.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.706+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:95 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047e400 con 0x557f202b3400 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.707+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(94 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9 [stat,call,call] v32'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.707+0000 7f32f30db700 20 handle_completion(): completion ok for obj=thirteen 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.707+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 23 ==== osd_op_reply(95 bud [delete,create,call,writefull 0~346] v32'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.707+0000 7f32fb13da80 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.707+0000 7f32fb13da80 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.707+0000 7f32fb13da80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.707+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 94004489726208 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047ec00 con 0x557f2036a000 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.708+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== watch-notify(notify (1) cookie 94004488212864 notify 137438953500 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x557f20315ba0 con 0x557f2036a000 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.708+0000 7f32f38dc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94004488212864 notifier 4797 bl.length()=522 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.708+0000 7f32f38dc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.708+0000 7f32f38dc700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.708+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(96 notify.5 [notify cookie 94004489726208 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x557f20362d80 con 0x557f2036a000 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.708+0000 7f32f38dc700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036ac00 con 0x557f2036a000 2024-04-19T23:46:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.708+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f2036a000 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.708+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 28 ==== watch-notify(notify_complete (2) cookie 94004489726208 notify 137438953500 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557f203dc680 con 0x557f2036a000 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.708+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:98 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047f400 con 0x557f1ff29800 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.709+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 38 ==== osd_op_reply(98 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'11 uv11 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f1ff29800 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.709+0000 7f32fb13da80 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.709+0000 7f32fb13da80 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.709+0000 7f32fb13da80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.709+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify cookie 94004489726208 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3c00 con 0x557f2036a000 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.709+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 29 ==== watch-notify(notify (1) cookie 94004488212864 notify 137438953501 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x557f203dc680 con 0x557f2036a000 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.709+0000 7f32f30db700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94004488212864 notifier 4797 bl.length()=177 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.709+0000 7f32f30db700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.709+0000 7f32f30db700 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.709+0000 7f32f30db700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047f800 con 0x557f2036a000 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.709+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 30 ==== osd_op_reply(99 notify.5 [notify cookie 94004489726208 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x557f20362d80 con 0x557f2036a000 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.710+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 31 ==== osd_op_reply(100 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f2036a000 2024-04-19T23:46:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.710+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 32 ==== watch-notify(notify_complete (2) cookie 94004489726208 notify 137438953501 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557f203dc820 con 0x557f2036a000 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.710+0000 7f32fb13da80 10 removing user index: bar 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.710+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:101 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f202b3800 con 0x557f2036a000 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.711+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 33 ==== osd_op_reply(101 bar [delete] v32'4 uv4 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f2036a000 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.711+0000 7f32fb13da80 10 removing default.rgw.meta+users.uid+bar from cache 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.711+0000 7f32fb13da80 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.711+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify cookie 94004489726208 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2036bc00 con 0x557f2036a000 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.711+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 34 ==== watch-notify(notify (1) cookie 94004488215168 notify 137438953502 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x557f203dc820 con 0x557f2036a000 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.711+0000 7f32f38dc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94004488215168 notifier 4797 bl.length()=152 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.711+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 35 ==== osd_op_reply(102 notify.7 [notify cookie 94004489726208 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x557f20362d80 con 0x557f2036a000 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.711+0000 7f32f38dc700 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f1ff29c00 con 0x557f2036a000 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.711+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 36 ==== osd_op_reply(103 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f2036a000 2024-04-19T23:46:35.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.711+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 37 ==== watch-notify(notify_complete (2) cookie 94004489726208 notify 137438953502 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557f203dc9c0 con 0x557f2036a000 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "bud", 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Bar", 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "", 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "bud", 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "NX5QOQKC6BH2IDN8HC7A", 2024-04-19T23:46:35.729 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn" 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:46:35.730 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:46:35.731 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:46:35.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.712+0000 7f32e00b5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:35.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.712+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:104 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94004489723904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20413000 con 0x557f1ff29800 2024-04-19T23:46:35.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.713+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 39 ==== osd_op_reply(104 data_loggenerations_metadata [watch unwatch cookie 94004489723904] v32'214 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f1ff29800 2024-04-19T23:46:35.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.713+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94004488207104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20413400 con 0x557f202b3400 2024-04-19T23:46:35.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.714+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 24 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94004488207104] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.714+0000 7f32fb13da80 20 remove_watcher() i=0 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.714+0000 7f32fb13da80 2 removed watcher, disabling cache 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.714+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94004488208256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047fc00 con 0x557f1ff29800 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.715+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 40 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94004488208256] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f1ff29800 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.715+0000 7f32fb13da80 20 remove_watcher() i=1 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.715+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94004488209408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047ec00 con 0x557f202b3000 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.716+0000 7f32f90e7700 1 -- 172.21.15.155:0/3827347644 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94004488209408] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20363200 con 0x557f202b3000 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.716+0000 7f32fb13da80 20 remove_watcher() i=2 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.716+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94004488210560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047f400 con 0x557f202b3400 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.717+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 <== osd.2 v2:172.21.15.155:6812/41834 25 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94004488210560] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20363440 con 0x557f202b3400 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.717+0000 7f32fb13da80 20 remove_watcher() i=3 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.717+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94004488211712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047f800 con 0x557f1ff29800 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.718+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.1 v2:172.21.15.155:6800/41833 41 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94004488211712] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f1ff29800 2024-04-19T23:46:35.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.718+0000 7f32fb13da80 20 remove_watcher() i=4 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.718+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94004488212864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f2047e800 con 0x557f2036a000 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.720+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 38 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94004488212864] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f2036a000 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.720+0000 7f32fb13da80 20 remove_watcher() i=5 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.720+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94004488214016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20412800 con 0x557f2036a000 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.721+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 39 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94004488214016] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f2036a000 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.721+0000 7f32fb13da80 20 remove_watcher() i=6 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.721+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94004488215168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557f20413800 con 0x557f2036a000 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32f98e8700 1 -- 172.21.15.155:0/3827347644 <== osd.0 v2:172.21.15.76:6800/39408 40 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94004488215168] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557f20362d80 con 0x557f2036a000 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 20 remove_watcher() i=7 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557f2036a000 msgr2=0x557f20213180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x557f2036a000 0x557f20213180 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557f1ff29800 msgr2=0x557f20211b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x557f1ff29800 0x557f20211b80 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557f202b3400 msgr2=0x557f20212c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x557f202b3400 0x557f20212c00 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557f202b3000 msgr2=0x557f20212100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x557f202b3000 0x557f20212100 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f202b2c00 msgr2=0x557f20211600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f202b2c00 0x557f20211600 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x557f20cf8030 tx=0x557f20277920 comp rx=0 tx=0).stop 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 msgr2=0x557f20210b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3827347644 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff29400 0x557f20210b00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x557f20da8930 tx=0x557f20019ce0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 reap_dead start 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32f88e6700 1 -- 172.21.15.155:0/3827347644 reap_dead start 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 shutdown_connections 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 >> 172.21.15.155:0/3827347644 conn(0x557f1ff28c00 msgr2=0x557f20015800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 shutdown_connections 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3827347644 wait complete. 2024-04-19T23:46:35.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3292913608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f20412000 msgr2=0x557f20213700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3292913608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f20412000 0x557f20213700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x557f20309f20 tx=0x557f20277b60 comp rx=0 tx=0).stop 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 -- 172.21.15.155:0/3292913608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 msgr2=0x557f20212680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.722+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3292913608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x557f203822d0 tx=0x557f20277e60 comp rx=0 tx=0).stop 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 -- 172.21.15.155:0/3292913608 shutdown_connections 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3292913608 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f20412000 0x557f20213700 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3292913608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f2036b400 0x557f20212680 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 -- 172.21.15.155:0/3292913608 >> 172.21.15.155:0/3292913608 conn(0x557f2036a800 msgr2=0x557f20016000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 -- 172.21.15.155:0/3292913608 shutdown_connections 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 -- 172.21.15.155:0/3292913608 wait complete. 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 -- 172.21.15.155:0/3291519801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f202b2000 msgr2=0x557f20211080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3291519801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f202b2000 0x557f20211080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x557f20da9050 tx=0x557f202768a0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 -- 172.21.15.155:0/3291519801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 msgr2=0x557f20210580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3291519801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x557f20cf9ec0 tx=0x557f20019980 comp rx=0 tx=0).stop 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 -- 172.21.15.155:0/3291519801 shutdown_connections 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3291519801 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x557f202b2000 0x557f20211080 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 --2- 172.21.15.155:0/3291519801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x557f1ff28800 0x557f20210580 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:35.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 -- 172.21.15.155:0/3291519801 >> 172.21.15.155:0/3291519801 conn(0x557f1ff28400 msgr2=0x557f20015000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:35.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 -- 172.21.15.155:0/3291519801 shutdown_connections 2024-04-19T23:46:35.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:35.723+0000 7f32fb13da80 1 -- 172.21.15.155:0/3291519801 wait complete. 2024-04-19T23:46:35.742 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:46:40.749 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:46:40.749 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-19T23:46:40.749 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-19T23:46:40.750 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-19T23:46:40.750 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-04-19T23:46:40.815 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:40.815 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:40.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.815+0000 7fcf51b86a80 1 Processor -- start 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.816+0000 7fcf51b86a80 1 -- start start 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.816+0000 7fcf51b86a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55d2e333c800 0x55d2e3624580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.816+0000 7fcf51b86a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d2e3667500 con 0x55d2e333cc00 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.816+0000 7fcf51b86a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d2e33dea00 con 0x55d2e333c800 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.816+0000 7fcf4f32f700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55d2e333cc00 0x55d2e3428800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55736/0 (socket says 172.21.15.155:55736) 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.816+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3573142112 learned_addr learned my addr 172.21.15.155:0/3573142112 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.816+0000 7fcf4fb30700 1 --2- 172.21.15.155:0/3573142112 >> v2:172.21.15.76:3300/0 conn(0x55d2e333c800 0x55d2e3624580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.816+0000 7fcf4eb2e700 1 -- 172.21.15.155:0/3573142112 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832202914 0 0) 0x55d2e4106000 con 0x55d2e333cc00 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.816+0000 7fcf4eb2e700 1 -- 172.21.15.155:0/3573142112 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55d2e3667680 con 0x55d2e333cc00 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.817+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3573142112 >> v1:172.21.15.76:6789/0 conn(0x55d2e333cc00 legacy=0x55d2e3428800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.817+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3573142112 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e3365d40 con 0x55d2e333c800 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.817+0000 7fcf4fb30700 1 --2- 172.21.15.155:0/3573142112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55d2e361f9e0 tx=0x55d2e342d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee44d89e1acbb4a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.817+0000 7fcf4eb2e700 1 -- 172.21.15.155:0/3573142112 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e33f54a0 con 0x55d2e333c800 2024-04-19T23:46:40.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.817+0000 7fcf4eb2e700 1 -- 172.21.15.155:0/3573142112 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2e3667680 con 0x55d2e333c800 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.817+0000 7fcf4eb2e700 1 -- 172.21.15.155:0/3573142112 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e33f5600 con 0x55d2e333c800 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.818+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3573142112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 msgr2=0x55d2e3624580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.818+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/3573142112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55d2e361f9e0 tx=0x55d2e342d980 comp rx=0 tx=0).stop 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.818+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3573142112 shutdown_connections 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.818+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/3573142112 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.818+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3573142112 >> 172.21.15.155:0/3573142112 conn(0x55d2e333c400 msgr2=0x55d2e3428000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.818+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3573142112 shutdown_connections 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.818+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3573142112 wait complete. 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.818+0000 7fcf51b86a80 1 Processor -- start 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.818+0000 7fcf51b86a80 1 -- start start 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.819+0000 7fcf51b86a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.819+0000 7fcf51b86a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e33de500 con 0x55d2e333c800 2024-04-19T23:46:40.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.819+0000 7fcf4fb30700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.819+0000 7fcf4fb30700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40980/0 (socket says 172.21.15.155:40980) 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.819+0000 7fcf4fb30700 1 -- 172.21.15.155:0/2690302171 learned_addr learned my addr 172.21.15.155:0/2690302171 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.819+0000 7fcf4fb30700 1 -- 172.21.15.155:0/2690302171 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e3365ba0 con 0x55d2e333c800 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.819+0000 7fcf4fb30700 1 --2- 172.21.15.155:0/2690302171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x55d2e4109e00 tx=0x55d2e342d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9beb66638772eebd server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.819+0000 7fcf4e32d700 1 -- 172.21.15.155:0/2690302171 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e33f5760 con 0x55d2e333c800 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.819+0000 7fcf4e32d700 1 -- 172.21.15.155:0/2690302171 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2e3667980 con 0x55d2e333c800 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.819+0000 7fcf4e32d700 1 -- 172.21.15.155:0/2690302171 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e33f54a0 con 0x55d2e333c800 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.820+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2690302171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 msgr2=0x55d2e3624580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.820+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/2690302171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x55d2e4109e00 tx=0x55d2e342d800 comp rx=0 tx=0).stop 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.820+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2690302171 shutdown_connections 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.820+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/2690302171 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.820+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2690302171 >> 172.21.15.155:0/2690302171 conn(0x55d2e333c400 msgr2=0x55d2e3429000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.820+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2690302171 shutdown_connections 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.820+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2690302171 wait complete. 2024-04-19T23:46:40.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.820+0000 7fcf51b86a80 1 Processor -- start 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.820+0000 7fcf51b86a80 1 -- start start 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf51b86a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf51b86a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e33de3c0 con 0x55d2e333c800 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf4fb30700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf4fb30700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:40992/0 (socket says 172.21.15.155:40992) 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf4fb30700 1 -- 172.21.15.155:0/2500528157 learned_addr learned my addr 172.21.15.155:0/2500528157 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf4fb30700 1 -- 172.21.15.155:0/2500528157 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e3365a00 con 0x55d2e333c800 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf4fb30700 1 --2- 172.21.15.155:0/2500528157 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55d2e361ff20 tx=0x55d2e342d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf4cb2a700 1 -- 172.21.15.155:0/2500528157 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e33f5600 con 0x55d2e333c800 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf4cb2a700 1 -- 172.21.15.155:0/2500528157 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2e3667b00 con 0x55d2e333c800 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf4cb2a700 1 -- 172.21.15.155:0/2500528157 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e33f58c0 con 0x55d2e333c800 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2500528157 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2e3365860 con 0x55d2e333c800 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.821+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2500528157 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2e33656c0 con 0x55d2e333c800 2024-04-19T23:46:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.822+0000 7fcf51b86a80 1 Processor -- start 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.822+0000 7fcf51b86a80 1 -- start start 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.822+0000 7fcf4cb2a700 1 -- 172.21.15.155:0/2500528157 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d2e40deb00 con 0x55d2e333c800 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.822+0000 7fcf51b86a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 0x55d2e3624b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.822+0000 7fcf4cb2a700 1 --2- 172.21.15.155:0/2500528157 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e36c2000 0x55d2e3625080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.822+0000 7fcf51b86a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e3378640 con 0x55d2e333d400 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.822+0000 7fcf4cb2a700 1 -- 172.21.15.155:0/2500528157 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d2e33b7180 con 0x55d2e333c800 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.822+0000 7fcf4fb30700 1 --2- 172.21.15.155:0/2500528157 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e36c2000 0x55d2e3625080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.823+0000 7fcf50331700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 0x55d2e3624b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.823+0000 7fcf50331700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 0x55d2e3624b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41000/0 (socket says 172.21.15.155:41000) 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.823+0000 7fcf50331700 1 -- 172.21.15.155:0/320540114 learned_addr learned my addr 172.21.15.155:0/320540114 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.823+0000 7fcf4fb30700 1 --2- 172.21.15.155:0/2500528157 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e36c2000 0x55d2e3625080 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55d2e41bca80 tx=0x55d2e3688780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.823+0000 7fcf50331700 1 -- 172.21.15.155:0/320540114 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e3364000 con 0x55d2e333d400 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.823+0000 7fcf50331700 1 --2- 172.21.15.155:0/320540114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 0x55d2e3624b00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x55d2e41bc600 tx=0x55d2e3688a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f447cf875c1a7d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.823+0000 7fcf4a325700 1 -- 172.21.15.155:0/320540114 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e33f5600 con 0x55d2e333d400 2024-04-19T23:46:40.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.823+0000 7fcf4a325700 1 -- 172.21.15.155:0/320540114 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2e33ddc80 con 0x55d2e333d400 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.823+0000 7fcf4a325700 1 -- 172.21.15.155:0/320540114 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e33f58c0 con 0x55d2e333d400 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.824+0000 7fcf51b86a80 1 -- 172.21.15.155:0/320540114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 msgr2=0x55d2e3624b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.824+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/320540114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 0x55d2e3624b00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x55d2e41bc600 tx=0x55d2e3688a80 comp rx=0 tx=0).stop 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.824+0000 7fcf51b86a80 1 -- 172.21.15.155:0/320540114 shutdown_connections 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.824+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/320540114 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 0x55d2e3624b00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.824+0000 7fcf51b86a80 1 -- 172.21.15.155:0/320540114 >> 172.21.15.155:0/320540114 conn(0x55d2e333cc00 msgr2=0x55d2e3429800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.824+0000 7fcf51b86a80 1 -- 172.21.15.155:0/320540114 shutdown_connections 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.824+0000 7fcf51b86a80 1 -- 172.21.15.155:0/320540114 wait complete. 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.824+0000 7fcf51b86a80 1 Processor -- start 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.824+0000 7fcf51b86a80 1 -- start start 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.824+0000 7fcf51b86a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 0x55d2e3624b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.824+0000 7fcf51b86a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e33788c0 con 0x55d2e333d400 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.825+0000 7fcf50331700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 0x55d2e3624b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.825+0000 7fcf50331700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 0x55d2e3624b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41004/0 (socket says 172.21.15.155:41004) 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.825+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 learned_addr learned my addr 172.21.15.155:0/3396826818 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.825+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e3364ea0 con 0x55d2e333d400 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.825+0000 7fcf50331700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 0x55d2e3624b00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x55d2e41bdec0 tx=0x55d2e3688660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.825+0000 7fcf48b22700 1 -- 172.21.15.155:0/3396826818 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e33f5760 con 0x55d2e333d400 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.825+0000 7fcf48b22700 1 -- 172.21.15.155:0/3396826818 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2e33ddb00 con 0x55d2e333d400 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.825+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2e3364820 con 0x55d2e333d400 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.825+0000 7fcf48b22700 1 -- 172.21.15.155:0/3396826818 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e33f5600 con 0x55d2e333d400 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.825+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2e33649c0 con 0x55d2e333d400 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.826+0000 7fcf48b22700 1 -- 172.21.15.155:0/3396826818 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d2e40dedc0 con 0x55d2e333d400 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.826+0000 7fcf48b22700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e36c2c00 0x55d2e3625600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.826+0000 7fcf48b22700 1 -- 172.21.15.155:0/3396826818 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d2e33b7340 con 0x55d2e333d400 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.826+0000 7fcf4f32f700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e36c2c00 0x55d2e3625600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.827+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.827+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d2e333d800 0x55d2e3625b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.827+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e333dc00 con 0x55d2e333d800 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.827+0000 7fcf4f32f700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e36c2c00 0x55d2e3625600 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55d2e4108030 tx=0x55d2e3689920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.827+0000 7fcf50331700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d2e333d800 0x55d2e3625b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.827+0000 7fcf50331700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d2e333d800 0x55d2e3625b80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.827+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.827+0000 7fcf51b86a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.827+0000 7fcf51b86a80 20 realm 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.827+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.827+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e36c3000 con 0x55d2e333d800 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf51b86a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf51b86a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e36c3400 con 0x55d2e333d800 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf51b86a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:40.856 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e36c3800 con 0x55d2e333d800 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf51b86a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.828+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e36c3c00 con 0x55d2e333d800 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.829+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.829+0000 7fcf51b86a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.829+0000 7fcf51b86a80 20 searching for the correct realm 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.829+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d2e36c3000 0x55d2e3626100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.829+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e36c3400 con 0x55d2e36c3000 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.829+0000 7fcf4fb30700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d2e36c3000 0x55d2e3626100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.829+0000 7fcf4fb30700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d2e36c3000 0x55d2e3626100 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.829+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.829+0000 7fcf4fb30700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d2e36c3400 0x55d2e3626c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.829+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e000 con 0x55d2e36c3400 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.830+0000 7fcf4f32f700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d2e36c3400 0x55d2e3626c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.830+0000 7fcf4f32f700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d2e36c3400 0x55d2e3626c00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.830+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.830+0000 7fcf4f32f700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d2e377e000 0x55d2e3627180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.830+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e377e000 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.830+0000 7fcf50331700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d2e377e000 0x55d2e3627180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.831+0000 7fcf50331700 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d2e377e000 0x55d2e3627180 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.831+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.831+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e333d800 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.831+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.831+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e333d800 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.831+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.832+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e333d800 2024-04-19T23:46:40.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.832+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.832+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e377e000 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.832+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.832+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3400 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.832+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.832+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3000 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.833+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.833+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e333d800 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.833+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.833+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e377e000 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.833+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.833+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e333d800 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.833+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.833+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3400 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.834+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.834+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3000 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.834+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.834+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3000 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.834+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.834+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3400 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.834+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.834+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3000 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.835+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.835+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3000 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.835+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.835+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e333d800 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.835+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.835+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e333d800 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.835+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.835+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e377e000 2024-04-19T23:46:40.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.836+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.836+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3000 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.836+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.836+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3400 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.836+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.836+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e333d800 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.836+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.836+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e377e000 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.837+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.837+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3000 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.837+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.837+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e377e000 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.837+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.837+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3400 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.837+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.837+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3000 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.838+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.838+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e377e000 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.838+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.838+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e333d800 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.838+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.838+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3400 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e333dc00 con 0x55d2e333d800 2024-04-19T23:46:40.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377ec00 con 0x55d2e333d800 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.839+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377f000 con 0x55d2e36c3400 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 20 zone default found 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 4 Realm: () 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:40.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 20 zonegroup default 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377f400 con 0x55d2e377e000 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377f800 con 0x55d2e36c3000 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377fc00 con 0x55d2e36c3000 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 20 started sync module instance, tier type = 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.840+0000 7fcf51b86a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.841+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377ec00 con 0x55d2e36c3400 2024-04-19T23:46:40.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.842+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.842+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94364246326016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e333dc00 con 0x55d2e36c3400 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.842+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e36c3800 con 0x55d2e333d800 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.843+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94364246326016] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.843+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.843+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94364246327168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e36c3c00 con 0x55d2e333d800 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.843+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e36c3000 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.844+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94364246327168] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.845+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.845+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94364246328320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377f000 con 0x55d2e36c3000 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.845+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377ec00 con 0x55d2e36c3400 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.846+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.846+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94364246329472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e400 con 0x55d2e36c3400 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.846+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94364246328320] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.846+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377f800 con 0x55d2e333d800 2024-04-19T23:46:40.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.847+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.847+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94364246330624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377fc00 con 0x55d2e333d800 2024-04-19T23:46:40.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.847+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377e800 con 0x55d2e377e000 2024-04-19T23:46:40.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.847+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94364246329472] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.848+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.848+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94364246331776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377f400 con 0x55d2e377e000 2024-04-19T23:46:40.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.848+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377f800 con 0x55d2e377e000 2024-04-19T23:46:40.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.848+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94364246330624] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.849+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94364246331776] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.849+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.849+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94364246332928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377fc00 con 0x55d2e377e000 2024-04-19T23:46:40.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.849+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e36c3800 con 0x55d2e377e000 2024-04-19T23:46:40.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.850+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94364246332928] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.851+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.851+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94364246334080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e36c3c00 con 0x55d2e377e000 2024-04-19T23:46:40.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.851+0000 7fcf51b86a80 20 add_watcher() i=0 2024-04-19T23:46:40.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.851+0000 7fcf51b86a80 20 add_watcher() i=1 2024-04-19T23:46:40.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.851+0000 7fcf51b86a80 20 add_watcher() i=2 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.851+0000 7fcf51b86a80 20 add_watcher() i=3 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.851+0000 7fcf51b86a80 20 add_watcher() i=4 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.851+0000 7fcf51b86a80 20 add_watcher() i=5 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.851+0000 7fcf51b86a80 20 add_watcher() i=6 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.852+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94364246334080] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.852+0000 7fcf51b86a80 20 add_watcher() i=7 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.852+0000 7fcf51b86a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.852+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e36c3800 con 0x55d2e333d800 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.852+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.852+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94364247842816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e36c3c00 con 0x55d2e333d800 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.853+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94364247842816] v32'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.853+0000 7fcf36afe700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.853+0000 7fcf51b86a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.853+0000 7fcf51b86a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:40.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.853+0000 7fcf51b86a80 1 Processor -- start 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.853+0000 7fcf51b86a80 1 -- start start 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.854+0000 7fcf51b86a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.854+0000 7fcf51b86a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e33de3c0 con 0x55d2e377f400 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.854+0000 7fcf4f32f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.854+0000 7fcf4f32f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41012/0 (socket says 172.21.15.155:41012) 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.854+0000 7fcf4f32f700 1 -- 172.21.15.155:0/500789335 learned_addr learned my addr 172.21.15.155:0/500789335 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.854+0000 7fcf4f32f700 1 -- 172.21.15.155:0/500789335 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e3364b60 con 0x55d2e377f400 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.854+0000 7fcf4f32f700 1 --2- 172.21.15.155:0/500789335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55d2e37926c0 tx=0x55d2e3689d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fda90d84d4e7379 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.854+0000 7fcf362fd700 1 -- 172.21.15.155:0/500789335 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e37a4000 con 0x55d2e377f400 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.854+0000 7fcf362fd700 1 -- 172.21.15.155:0/500789335 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2e379c180 con 0x55d2e377f400 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.854+0000 7fcf362fd700 1 -- 172.21.15.155:0/500789335 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e37a4160 con 0x55d2e377f400 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.855+0000 7fcf51b86a80 1 -- 172.21.15.155:0/500789335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 msgr2=0x55d2e3626680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.855+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/500789335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55d2e37926c0 tx=0x55d2e3689d40 comp rx=0 tx=0).stop 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.855+0000 7fcf51b86a80 1 -- 172.21.15.155:0/500789335 shutdown_connections 2024-04-19T23:46:40.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.855+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/500789335 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.855+0000 7fcf51b86a80 1 -- 172.21.15.155:0/500789335 >> 172.21.15.155:0/500789335 conn(0x55d2e377e800 msgr2=0x55d2e342a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.855+0000 7fcf51b86a80 1 -- 172.21.15.155:0/500789335 shutdown_connections 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.855+0000 7fcf51b86a80 1 -- 172.21.15.155:0/500789335 wait complete. 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.856+0000 7fcf51b86a80 1 Processor -- start 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.856+0000 7fcf51b86a80 1 -- start start 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.856+0000 7fcf51b86a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.856+0000 7fcf51b86a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e33de500 con 0x55d2e377f400 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.856+0000 7fcf4f32f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.856+0000 7fcf4f32f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41016/0 (socket says 172.21.15.155:41016) 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.856+0000 7fcf4f32f700 1 -- 172.21.15.155:0/2772142613 learned_addr learned my addr 172.21.15.155:0/2772142613 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.856+0000 7fcf4f32f700 1 -- 172.21.15.155:0/2772142613 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e3364d00 con 0x55d2e377f400 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.857+0000 7fcf4f32f700 1 --2- 172.21.15.155:0/2772142613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x55d2e37928d0 tx=0x55d2e3689e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.857+0000 7fcf34afa700 1 -- 172.21.15.155:0/2772142613 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e37a42c0 con 0x55d2e377f400 2024-04-19T23:46:40.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.857+0000 7fcf34afa700 1 -- 172.21.15.155:0/2772142613 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2e379c300 con 0x55d2e377f400 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.857+0000 7fcf34afa700 1 -- 172.21.15.155:0/2772142613 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d2e37a4000 con 0x55d2e377f400 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.857+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2772142613 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2e3364340 con 0x55d2e377f400 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.857+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2772142613 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2e3364b60 con 0x55d2e377f400 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.858+0000 7fcf34afa700 1 -- 172.21.15.155:0/2772142613 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d2e40dfb80 con 0x55d2e377f400 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.858+0000 7fcf34afa700 1 --2- 172.21.15.155:0/2772142613 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e3826000 0x55d2e3627700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.858+0000 7fcf34afa700 1 -- 172.21.15.155:0/2772142613 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d2e33b7500 con 0x55d2e377f400 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.858+0000 7fcf51b86a80 5 note: GC not initialized 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.858+0000 7fcf50331700 1 --2- 172.21.15.155:0/2772142613 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e3826000 0x55d2e3627700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.858+0000 7fcf50331700 1 --2- 172.21.15.155:0/2772142613 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e3826000 0x55d2e3627700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55d2e3727a40 tx=0x55d2e3689b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.859+0000 7fcf322f5700 20 reqs_thread_entry: start 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.859+0000 7fcf51b86a80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.859+0000 7fcf51b86a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.859+0000 7fcf302f1700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:11 2024 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:40.879 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.859+0000 7fcf2facf700 20 reqs_thread_entry: start 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.859+0000 7fcf51b86a80 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.859+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.859+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e377fc00 con 0x55d2e377e000 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3826400 con 0x55d2e377e000 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:46:40.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.860+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3826800 con 0x55d2e377e000 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.861+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v32'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.861+0000 7fcf51b86a80 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.861+0000 7fcf51b86a80 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.861+0000 7fcf51b86a80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.861+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94364247845120 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3826c00 con 0x55d2e377e000 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.862+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== watch-notify(notify (1) cookie 94364246331776 notify 137438953503 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x55d2e3729d40 con 0x55d2e377e000 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.862+0000 7fcf4a325700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94364246331776 notifier 4805 bl.length()=522 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.862+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(65 notify.5 [notify cookie 94364247845120 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.862+0000 7fcf4a325700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.862+0000 7fcf4a325700 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.862+0000 7fcf4a325700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3896000 con 0x55d2e377e000 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.862+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.862+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== watch-notify(notify_complete (2) cookie 94364247845120 notify 137438953503 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d2e3729a00 con 0x55d2e377e000 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.862+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3827000 con 0x55d2e377e000 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf51b86a80 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf51b86a80 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf51b86a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94364247845120 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3827400 con 0x55d2e36c3000 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 94364246328320 notify 137438953491 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55d2e3687ba0 con 0x55d2e36c3000 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf4a325700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94364246328320 notifier 4805 bl.length()=177 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(68 notify.2 [notify cookie 94364247845120 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf4a325700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf4a325700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf4a325700 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3896400 con 0x55d2e36c3000 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.864+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== watch-notify(notify_complete (2) cookie 94364247845120 notify 137438953491 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d2e3687d40 con 0x55d2e36c3000 2024-04-19T23:46:40.883 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:46:40.883 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "fud", 2024-04-19T23:46:40.883 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Fud", 2024-04-19T23:46:40.883 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "", 2024-04-19T23:46:40.883 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:46:40.883 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 4, 2024-04-19T23:46:40.883 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:46:40.883 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:46:40.883 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:46:40.883 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "fud", 2024-04-19T23:46:40.883 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [], 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:46:40.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:46:40.885 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.865+0000 7fcf36afe700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.865+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94364247842816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3827800 con 0x55d2e333d800 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.866+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94364247842816] v32'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.866+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94364246326016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3827c00 con 0x55d2e36c3400 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.867+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94364246326016] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.867+0000 7fcf51b86a80 20 remove_watcher() i=0 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.867+0000 7fcf51b86a80 2 removed watcher, disabling cache 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.867+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94364246327168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3896000 con 0x55d2e333d800 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.869+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94364246327168] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.869+0000 7fcf51b86a80 20 remove_watcher() i=1 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.869+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94364246328320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3896800 con 0x55d2e36c3000 2024-04-19T23:46:40.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.870+0000 7fcf4fb30700 1 -- 172.21.15.155:0/3396826818 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94364246328320] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3777200 con 0x55d2e36c3000 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.870+0000 7fcf51b86a80 20 remove_watcher() i=2 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.870+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94364246329472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3896c00 con 0x55d2e36c3400 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.871+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94364246329472] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3777440 con 0x55d2e36c3400 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.871+0000 7fcf51b86a80 20 remove_watcher() i=3 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.871+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94364246330624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3897000 con 0x55d2e333d800 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.872+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94364246330624] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e333d800 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.872+0000 7fcf51b86a80 20 remove_watcher() i=4 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.872+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94364246331776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3897400 con 0x55d2e377e000 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.873+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94364246331776] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.873+0000 7fcf51b86a80 20 remove_watcher() i=5 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.873+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94364246332928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3897800 con 0x55d2e377e000 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.874+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94364246332928] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.874+0000 7fcf51b86a80 20 remove_watcher() i=6 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.874+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94364246334080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d2e3897c00 con 0x55d2e377e000 2024-04-19T23:46:40.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf50331700 1 -- 172.21.15.155:0/3396826818 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94364246334080] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d2e3776b40 con 0x55d2e377e000 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 20 remove_watcher() i=7 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d2e377e000 msgr2=0x55d2e3627180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d2e377e000 0x55d2e3627180 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d2e333d800 msgr2=0x55d2e3625b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d2e333d800 0x55d2e3625b80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d2e36c3400 msgr2=0x55d2e3626c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d2e36c3400 0x55d2e3626c00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d2e36c3000 msgr2=0x55d2e3626100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d2e36c3000 0x55d2e3626100 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e36c2c00 msgr2=0x55d2e3625600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e36c2c00 0x55d2e3625600 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55d2e4108030 tx=0x55d2e3689920 comp rx=0 tx=0).stop 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 msgr2=0x55d2e3624b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/3396826818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333d400 0x55d2e3624b00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x55d2e41bdec0 tx=0x55d2e3688660 comp rx=0 tx=0).stop 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 reap_dead start 2024-04-19T23:46:40.893 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf4f32f700 1 -- 172.21.15.155:0/3396826818 reap_dead start 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 shutdown_connections 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 >> 172.21.15.155:0/3396826818 conn(0x55d2e333cc00 msgr2=0x55d2e3429800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 shutdown_connections 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.876+0000 7fcf51b86a80 1 -- 172.21.15.155:0/3396826818 wait complete. 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2772142613 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e3826000 msgr2=0x55d2e3627700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/2772142613 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e3826000 0x55d2e3627700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55d2e3727a40 tx=0x55d2e3689b60 comp rx=0 tx=0).stop 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2772142613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 msgr2=0x55d2e3626680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/2772142613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x55d2e37928d0 tx=0x55d2e3689e60 comp rx=0 tx=0).stop 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2772142613 shutdown_connections 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/2772142613 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e3826000 0x55d2e3627700 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/2772142613 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e377f400 0x55d2e3626680 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2772142613 >> 172.21.15.155:0/2772142613 conn(0x55d2e377e800 msgr2=0x55d2e342a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2772142613 shutdown_connections 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2772142613 wait complete. 2024-04-19T23:46:40.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2500528157 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e36c2000 msgr2=0x55d2e3625080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/2500528157 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e36c2000 0x55d2e3625080 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55d2e41bca80 tx=0x55d2e3688780 comp rx=0 tx=0).stop 2024-04-19T23:46:40.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2500528157 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 msgr2=0x55d2e3624580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/2500528157 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55d2e361ff20 tx=0x55d2e342d980 comp rx=0 tx=0).stop 2024-04-19T23:46:40.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2500528157 shutdown_connections 2024-04-19T23:46:40.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/2500528157 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d2e36c2000 0x55d2e3625080 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 --2- 172.21.15.155:0/2500528157 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d2e333c800 0x55d2e3624580 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:40.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2500528157 >> 172.21.15.155:0/2500528157 conn(0x55d2e333c400 msgr2=0x55d2e3429000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:40.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2500528157 shutdown_connections 2024-04-19T23:46:40.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.877+0000 7fcf51b86a80 1 -- 172.21.15.155:0/2500528157 wait complete. 2024-04-19T23:46:40.895 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:46:40.933 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:46:40.938 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-04-19T23:46:40.938 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-19T23:46:40.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-19T23:46:40.939 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-04-19T23:46:40.986 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:40.987 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.987+0000 7f6fe9a24a80 1 Processor -- start 2024-04-19T23:46:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.987+0000 7f6fe9a24a80 1 -- start start 2024-04-19T23:46:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.987+0000 7f6fe9a24a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:40.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.987+0000 7f6fe9a24a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5610ba1db500 con 0x5610b9eb0c00 2024-04-19T23:46:40.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.987+0000 7f6fe9a24a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5610b9f52a00 con 0x5610b9eb0800 2024-04-19T23:46:40.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.987+0000 7f6fe79ce700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:40.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.987+0000 7f6fe71cd700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5610b9eb0c00 0x5610b9f9c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55740/0 (socket says 172.21.15.155:55740) 2024-04-19T23:46:40.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.987+0000 7f6fe79ce700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41028/0 (socket says 172.21.15.155:41028) 2024-04-19T23:46:40.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.987+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3937130147 learned_addr learned my addr 172.21.15.155:0/3937130147 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:40.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.988+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3937130147 >> v1:172.21.15.76:6789/0 conn(0x5610b9eb0c00 legacy=0x5610b9f9c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:40.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.988+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3937130147 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610b9ed9d40 con 0x5610b9eb0800 2024-04-19T23:46:40.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.988+0000 7f6fe79ce700 1 --2- 172.21.15.155:0/3937130147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x5610ba1939e0 tx=0x5610b9fa1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc595073c5ffbdfc server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:40.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.988+0000 7f6fe69cc700 1 -- 172.21.15.155:0/3937130147 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610b9f694a0 con 0x5610b9eb0800 2024-04-19T23:46:40.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.988+0000 7f6fe69cc700 1 -- 172.21.15.155:0/3937130147 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610ba1db800 con 0x5610b9eb0800 2024-04-19T23:46:40.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.988+0000 7f6fe69cc700 1 -- 172.21.15.155:0/3937130147 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610b9f69600 con 0x5610b9eb0800 2024-04-19T23:46:41.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.989+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3937130147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 msgr2=0x5610ba198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.989+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3937130147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x5610ba1939e0 tx=0x5610b9fa1920 comp rx=0 tx=0).stop 2024-04-19T23:46:41.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.989+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3937130147 shutdown_connections 2024-04-19T23:46:41.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.989+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3937130147 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.989+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3937130147 >> 172.21.15.155:0/3937130147 conn(0x5610b9eb0400 msgr2=0x5610b9f9c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.989+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3937130147 shutdown_connections 2024-04-19T23:46:41.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.989+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3937130147 wait complete. 2024-04-19T23:46:41.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.989+0000 7f6fe9a24a80 1 Processor -- start 2024-04-19T23:46:41.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.989+0000 7f6fe9a24a80 1 -- start start 2024-04-19T23:46:41.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.990+0000 7f6fe9a24a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.990+0000 7f6fe9a24a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b9f52500 con 0x5610b9eb0800 2024-04-19T23:46:41.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.990+0000 7f6fe79ce700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.990+0000 7f6fe79ce700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41034/0 (socket says 172.21.15.155:41034) 2024-04-19T23:46:41.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.990+0000 7f6fe79ce700 1 -- 172.21.15.155:0/2058312146 learned_addr learned my addr 172.21.15.155:0/2058312146 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.990+0000 7f6fe79ce700 1 -- 172.21.15.155:0/2058312146 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610b9ed9ba0 con 0x5610b9eb0800 2024-04-19T23:46:41.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.990+0000 7f6fe79ce700 1 --2- 172.21.15.155:0/2058312146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x5610bac89740 tx=0x5610b9fa1800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f63dd97ad6e4cc server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.990+0000 7f6fe61cb700 1 -- 172.21.15.155:0/2058312146 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610b9f69760 con 0x5610b9eb0800 2024-04-19T23:46:41.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.990+0000 7f6fe61cb700 1 -- 172.21.15.155:0/2058312146 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610ba1dbb00 con 0x5610b9eb0800 2024-04-19T23:46:41.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.990+0000 7f6fe61cb700 1 -- 172.21.15.155:0/2058312146 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610b9f694a0 con 0x5610b9eb0800 2024-04-19T23:46:41.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.991+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/2058312146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 msgr2=0x5610ba198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.991+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/2058312146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x5610bac89740 tx=0x5610b9fa1800 comp rx=0 tx=0).stop 2024-04-19T23:46:41.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.991+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/2058312146 shutdown_connections 2024-04-19T23:46:41.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.991+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/2058312146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.991+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/2058312146 >> 172.21.15.155:0/2058312146 conn(0x5610b9eb0400 msgr2=0x5610b9f9d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.991+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/2058312146 shutdown_connections 2024-04-19T23:46:41.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.991+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/2058312146 wait complete. 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.991+0000 7f6fe9a24a80 1 Processor -- start 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.991+0000 7f6fe9a24a80 1 -- start start 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.991+0000 7f6fe9a24a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.991+0000 7f6fe9a24a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b9f523c0 con 0x5610b9eb0800 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.992+0000 7f6fe79ce700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.992+0000 7f6fe79ce700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41050/0 (socket says 172.21.15.155:41050) 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.992+0000 7f6fe79ce700 1 -- 172.21.15.155:0/1980410369 learned_addr learned my addr 172.21.15.155:0/1980410369 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.992+0000 7f6fe79ce700 1 -- 172.21.15.155:0/1980410369 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610b9ed9a00 con 0x5610b9eb0800 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.992+0000 7f6fe79ce700 1 --2- 172.21.15.155:0/1980410369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x5610bac895f0 tx=0x5610b9fa1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.992+0000 7f6fe49c8700 1 -- 172.21.15.155:0/1980410369 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610b9f69600 con 0x5610b9eb0800 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.992+0000 7f6fe49c8700 1 -- 172.21.15.155:0/1980410369 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610ba1dbc80 con 0x5610b9eb0800 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.992+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/1980410369 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610b9ed9860 con 0x5610b9eb0800 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.992+0000 7f6fe49c8700 1 -- 172.21.15.155:0/1980410369 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610b9f698c0 con 0x5610b9eb0800 2024-04-19T23:46:41.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.992+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/1980410369 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610b9ed96c0 con 0x5610b9eb0800 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe9a24a80 1 Processor -- start 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe9a24a80 1 -- start start 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe49c8700 1 -- 172.21.15.155:0/1980410369 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5610bac52b00 con 0x5610b9eb0800 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe9a24a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 0x5610ba198b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe9a24a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b9eec640 con 0x5610b9eb1400 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe49c8700 1 --2- 172.21.15.155:0/1980410369 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba22e000 0x5610ba199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe49c8700 1 -- 172.21.15.155:0/1980410369 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5610b9f2b180 con 0x5610b9eb0800 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe81cf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 0x5610ba198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe79ce700 1 --2- 172.21.15.155:0/1980410369 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba22e000 0x5610ba199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe81cf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 0x5610ba198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41054/0 (socket says 172.21.15.155:41054) 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe81cf700 1 -- 172.21.15.155:0/886905835 learned_addr learned my addr 172.21.15.155:0/886905835 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.993+0000 7f6fe81cf700 1 -- 172.21.15.155:0/886905835 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610b9ed8000 con 0x5610b9eb1400 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe79ce700 1 --2- 172.21.15.155:0/1980410369 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba22e000 0x5610ba199080 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5610bad3ced0 tx=0x5610ba1f6780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe81cf700 1 --2- 172.21.15.155:0/886905835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 0x5610ba198b00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x5610ba232810 tx=0x5610ba1f6a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cefdaf65a633727 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe21c3700 1 -- 172.21.15.155:0/886905835 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610b9f69600 con 0x5610b9eb1400 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe21c3700 1 -- 172.21.15.155:0/886905835 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610b9f51c80 con 0x5610b9eb1400 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe21c3700 1 -- 172.21.15.155:0/886905835 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610b9f698c0 con 0x5610b9eb1400 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/886905835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 msgr2=0x5610ba198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/886905835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 0x5610ba198b00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x5610ba232810 tx=0x5610ba1f6a80 comp rx=0 tx=0).stop 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/886905835 shutdown_connections 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/886905835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 0x5610ba198b00 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/886905835 >> 172.21.15.155:0/886905835 conn(0x5610b9eb0c00 msgr2=0x5610b9f9d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/886905835 shutdown_connections 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.994+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/886905835 wait complete. 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.995+0000 7f6fe9a24a80 1 Processor -- start 2024-04-19T23:46:41.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.995+0000 7f6fe9a24a80 1 -- start start 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.995+0000 7f6fe9a24a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 0x5610ba198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.995+0000 7f6fe9a24a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b9eec8c0 con 0x5610b9eb1400 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.995+0000 7f6fe81cf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 0x5610ba198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.995+0000 7f6fe81cf700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 0x5610ba198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41060/0 (socket says 172.21.15.155:41060) 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.995+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 learned_addr learned my addr 172.21.15.155:0/3603902871 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.996+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610b9ed8ea0 con 0x5610b9eb1400 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.996+0000 7f6fe81cf700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 0x5610ba198b00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x5610ba2329f0 tx=0x5610ba1f66c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.996+0000 7f6fe09c0700 1 -- 172.21.15.155:0/3603902871 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610b9f69760 con 0x5610b9eb1400 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.996+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610b9ed8820 con 0x5610b9eb1400 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.996+0000 7f6fe09c0700 1 -- 172.21.15.155:0/3603902871 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610b9f51b00 con 0x5610b9eb1400 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.996+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610b9ed89c0 con 0x5610b9eb1400 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.996+0000 7f6fe09c0700 1 -- 172.21.15.155:0/3603902871 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610b9f69600 con 0x5610b9eb1400 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.997+0000 7f6fe09c0700 1 -- 172.21.15.155:0/3603902871 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5610bac52dc0 con 0x5610b9eb1400 2024-04-19T23:46:41.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.997+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.997+0000 7f6fe09c0700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba22ec00 0x5610ba199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.997+0000 7f6fe09c0700 1 -- 172.21.15.155:0/3603902871 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5610b9f2b340 con 0x5610b9eb1400 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.997+0000 7f6fe71cd700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba22ec00 0x5610ba199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.997+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5610b9eb1800 0x5610ba199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.997+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610b9eb1c00 con 0x5610b9eb1800 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe81cf700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5610b9eb1800 0x5610ba199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe71cd700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba22ec00 0x5610ba199600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5610bac89e90 tx=0x5610ba1f7920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe81cf700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5610b9eb1800 0x5610ba199b80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe9a24a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe9a24a80 20 realm 2024-04-19T23:46:41.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba22f000 con 0x5610b9eb1800 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe9a24a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe9a24a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba22f400 con 0x5610b9eb1800 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.998+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe9a24a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba22f800 con 0x5610b9eb1800 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe9a24a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba22fc00 con 0x5610b9eb1800 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe9a24a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe9a24a80 20 searching for the correct realm 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5610ba22f000 0x5610ba19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba22f400 con 0x5610ba22f000 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:40.999+0000 7f6fe79ce700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5610ba22f000 0x5610ba19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.000+0000 7f6fe79ce700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5610ba22f000 0x5610ba19a100 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.000+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.000+0000 7f6fe79ce700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5610ba22f400 0x5610ba19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.000+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46000 con 0x5610ba22f400 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.000+0000 7f6fe71cd700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5610ba22f400 0x5610ba19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.000+0000 7f6fe71cd700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5610ba22f400 0x5610ba19ac00 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.000+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.000+0000 7f6fe71cd700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5610bad46000 0x5610ba19b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.000+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610bad46000 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.001+0000 7f6fe81cf700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5610bad46000 0x5610ba19b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.001+0000 7f6fe81cf700 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5610bad46000 0x5610ba19b180 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.001+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.001+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610b9eb1800 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.002+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.002+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610b9eb1800 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.002+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.002+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610b9eb1800 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.002+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.002+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610bad46000 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.002+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.002+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f400 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.003+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.003+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f000 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.003+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.003+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610b9eb1800 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.003+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.003+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610bad46000 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.003+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.003+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610b9eb1800 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.003+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.003+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f400 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.004+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.004+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f000 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.004+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.004+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f000 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.004+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.004+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f400 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.004+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.004+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f000 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.005+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.005+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f000 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.005+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.005+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610b9eb1800 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.005+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.005+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610b9eb1800 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.005+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.005+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610bad46000 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.006+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.006+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f000 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.006+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.006+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f400 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.006+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.006+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610b9eb1800 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.006+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.006+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610bad46000 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.007+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.007+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f000 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.007+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.007+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610bad46000 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.007+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.007+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f400 2024-04-19T23:46:41.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.007+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.007+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f000 2024-04-19T23:46:41.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.007+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.007+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610bad46000 2024-04-19T23:46:41.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.008+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.008+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610b9eb1800 2024-04-19T23:46:41.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.008+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.008+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f400 2024-04-19T23:46:41.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.008+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.008+0000 7f6fe9a24a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.008+0000 7f6fe9a24a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.008+0000 7f6fe9a24a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.008+0000 7f6fe9a24a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.008+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.008+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610b9eb1c00 con 0x5610b9eb1800 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46c00 con 0x5610b9eb1800 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47000 con 0x5610ba22f400 2024-04-19T23:46:41.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 20 zone default found 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 4 Realm: () 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 20 zonegroup default 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47400 con 0x5610bad46000 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.009+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47800 con 0x5610ba22f000 2024-04-19T23:46:41.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.010+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.010+0000 7f6fe9a24a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.010+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.010+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47c00 con 0x5610ba22f000 2024-04-19T23:46:41.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.010+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.010+0000 7f6fe9a24a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.010+0000 7f6fe9a24a80 20 started sync module instance, tier type = 2024-04-19T23:46:41.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.010+0000 7f6fe9a24a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:41.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.010+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46c00 con 0x5610ba22f400 2024-04-19T23:46:41.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.011+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.011+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94629841664768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610b9eb1c00 con 0x5610ba22f400 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.011+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba22f800 con 0x5610b9eb1800 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.012+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94629841664768] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.013+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.013+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94629841665920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba22fc00 con 0x5610b9eb1800 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.013+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610ba22f000 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.014+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94629841665920] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.014+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.014+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94629841667072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47000 con 0x5610ba22f000 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.014+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46c00 con 0x5610ba22f400 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.015+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.015+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94629841668224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46400 con 0x5610ba22f400 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.015+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94629841667072] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.015+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47800 con 0x5610b9eb1800 2024-04-19T23:46:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.016+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94629841668224] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.016+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.017+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94629841669376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47c00 con 0x5610b9eb1800 2024-04-19T23:46:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.017+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46800 con 0x5610bad46000 2024-04-19T23:46:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.018+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.018+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94629841670528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47400 con 0x5610bad46000 2024-04-19T23:46:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.018+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47800 con 0x5610bad46000 2024-04-19T23:46:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.018+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94629841669376] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.019+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94629841670528] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.019+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.019+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94629841671680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47c00 con 0x5610bad46000 2024-04-19T23:46:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.019+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba22f800 con 0x5610bad46000 2024-04-19T23:46:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.020+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.020+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94629841671680] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.020+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94629841672832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba22fc00 con 0x5610bad46000 2024-04-19T23:46:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.020+0000 7f6fe9a24a80 20 add_watcher() i=0 2024-04-19T23:46:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.020+0000 7f6fe9a24a80 20 add_watcher() i=1 2024-04-19T23:46:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.020+0000 7f6fe9a24a80 20 add_watcher() i=2 2024-04-19T23:46:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.020+0000 7f6fe9a24a80 20 add_watcher() i=3 2024-04-19T23:46:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.020+0000 7f6fe9a24a80 20 add_watcher() i=4 2024-04-19T23:46:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.020+0000 7f6fe9a24a80 20 add_watcher() i=5 2024-04-19T23:46:41.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.020+0000 7f6fe9a24a80 20 add_watcher() i=6 2024-04-19T23:46:41.052 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.021+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94629841672832] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.021+0000 7f6fe9a24a80 20 add_watcher() i=7 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.021+0000 7f6fe9a24a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.021+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba22f800 con 0x5610b9eb1800 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.021+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.021+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94629843197952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba22fc00 con 0x5610b9eb1800 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.022+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94629843197952] v32'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.023+0000 7f6fce99c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.023+0000 7f6fe9a24a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.023+0000 7f6fe9a24a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.023+0000 7f6fe9a24a80 1 Processor -- start 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.023+0000 7f6fe9a24a80 1 -- start start 2024-04-19T23:46:41.053 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.023+0000 7f6fe9a24a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.023+0000 7f6fe9a24a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b9f523c0 con 0x5610bad47400 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.023+0000 7f6fe71cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.023+0000 7f6fe71cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41064/0 (socket says 172.21.15.155:41064) 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.023+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3580886980 learned_addr learned my addr 172.21.15.155:0/3580886980 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.024+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3580886980 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610b9ed8b60 con 0x5610bad47400 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.024+0000 7f6fe71cd700 1 --2- 172.21.15.155:0/3580886980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x5610ba30e0c0 tx=0x5610ba1f7d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd67f7eab3ee5e87 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.024+0000 7f6fce19b700 1 -- 172.21.15.155:0/3580886980 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610ba31e000 con 0x5610bad47400 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.024+0000 7f6fce19b700 1 -- 172.21.15.155:0/3580886980 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610ba326000 con 0x5610bad47400 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.024+0000 7f6fce19b700 1 -- 172.21.15.155:0/3580886980 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610ba31e160 con 0x5610bad47400 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3580886980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 msgr2=0x5610ba19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3580886980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x5610ba30e0c0 tx=0x5610ba1f7d40 comp rx=0 tx=0).stop 2024-04-19T23:46:41.054 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3580886980 shutdown_connections 2024-04-19T23:46:41.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3580886980 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3580886980 >> 172.21.15.155:0/3580886980 conn(0x5610bad46800 msgr2=0x5610b9f9e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3580886980 shutdown_connections 2024-04-19T23:46:41.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3580886980 wait complete. 2024-04-19T23:46:41.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe9a24a80 1 Processor -- start 2024-04-19T23:46:41.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe9a24a80 1 -- start start 2024-04-19T23:46:41.055 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe9a24a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe9a24a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b9f52500 con 0x5610bad47400 2024-04-19T23:46:41.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe71cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe71cd700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41068/0 (socket says 172.21.15.155:41068) 2024-04-19T23:46:41.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.025+0000 7f6fe71cd700 1 -- 172.21.15.155:0/4198847994 learned_addr learned my addr 172.21.15.155:0/4198847994 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.026+0000 7f6fe71cd700 1 -- 172.21.15.155:0/4198847994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610b9ed8d00 con 0x5610bad47400 2024-04-19T23:46:41.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.026+0000 7f6fe71cd700 1 --2- 172.21.15.155:0/4198847994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x5610ba30ed80 tx=0x5610ba1f7e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.026+0000 7f6fcc998700 1 -- 172.21.15.155:0/4198847994 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610ba31e2c0 con 0x5610bad47400 2024-04-19T23:46:41.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.026+0000 7f6fcc998700 1 -- 172.21.15.155:0/4198847994 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610ba326180 con 0x5610bad47400 2024-04-19T23:46:41.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.026+0000 7f6fcc998700 1 -- 172.21.15.155:0/4198847994 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610ba31e000 con 0x5610bad47400 2024-04-19T23:46:41.056 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.026+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/4198847994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610b9ed8340 con 0x5610bad47400 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.026+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/4198847994 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610b9ed8b60 con 0x5610bad47400 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.027+0000 7f6fcc998700 1 -- 172.21.15.155:0/4198847994 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5610bac53b80 con 0x5610bad47400 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.027+0000 7f6fcc998700 1 --2- 172.21.15.155:0/4198847994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba3a0000 0x5610ba19b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.027+0000 7f6fcc998700 1 -- 172.21.15.155:0/4198847994 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5610b9f2b500 con 0x5610bad47400 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.027+0000 7f6fe81cf700 1 --2- 172.21.15.155:0/4198847994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba3a0000 0x5610ba19b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.027+0000 7f6fe9a24a80 5 note: GC not initialized 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.027+0000 7f6fe81cf700 1 --2- 172.21.15.155:0/4198847994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba3a0000 0x5610ba19b700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5610ba29bcb0 tx=0x5610ba1f7b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.028+0000 7f6fca193700 20 reqs_thread_entry: start 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.028+0000 7f6fe9a24a80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.028+0000 7f6fe9a24a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.028+0000 7f6fc818f700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:11 2024 2024-04-19T23:46:41.057 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.028+0000 7f6fc796d700 20 reqs_thread_entry: start 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.028+0000 7f6fe9a24a80 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.028+0000 7f6fe9a24a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.028+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47c00 con 0x5610ba22f400 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.029+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(62 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.029+0000 7f6fe9a24a80 20 rados_obj.operate() r=0 bl.length=346 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.029+0000 7f6fe9a24a80 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.029+0000 7f6fe9a24a80 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.029+0000 7f6fe9a24a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.029+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba3a0400 con 0x5610bad46000 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.030+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(63 fud [create,call,writefull 0~181] v32'6 uv5 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-04-19T23:46:41.058 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.031+0000 7f6fce99c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.031+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94629843197952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba3a0800 con 0x5610b9eb1800 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.032+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94629843197952] v32'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.032+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94629841664768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba3a0c00 con 0x5610ba22f400 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.033+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94629841664768] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.033+0000 7f6fe9a24a80 20 remove_watcher() i=0 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.033+0000 7f6fe9a24a80 2 removed watcher, disabling cache 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.033+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94629841665920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba3a1000 con 0x5610b9eb1800 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.034+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94629841665920] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.034+0000 7f6fe9a24a80 20 remove_watcher() i=1 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.034+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94629841667072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba3a1400 con 0x5610ba22f000 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.035+0000 7f6fe79ce700 1 -- 172.21.15.155:0/3603902871 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94629841667072] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d9200 con 0x5610ba22f000 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.035+0000 7f6fe9a24a80 20 remove_watcher() i=2 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.035+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94629841668224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba3a1800 con 0x5610ba22f400 2024-04-19T23:46:41.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.036+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94629841668224] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d9440 con 0x5610ba22f400 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.036+0000 7f6fe9a24a80 20 remove_watcher() i=3 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.036+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94629841669376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba3a1c00 con 0x5610b9eb1800 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.038+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94629841669376] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610b9eb1800 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.038+0000 7f6fe9a24a80 20 remove_watcher() i=4 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.038+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94629841670528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610ba3a0c00 con 0x5610bad46000 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.039+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94629841670528] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.039+0000 7f6fe9a24a80 20 remove_watcher() i=5 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.039+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94629841671680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad46c00 con 0x5610bad46000 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.040+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94629841671680] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.040+0000 7f6fe9a24a80 20 remove_watcher() i=6 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.040+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94629841672832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5610bad47c00 con 0x5610bad46000 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe81cf700 1 -- 172.21.15.155:0/3603902871 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94629841672832] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610ba2d8b40 con 0x5610bad46000 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 20 remove_watcher() i=7 2024-04-19T23:46:41.060 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5610bad46000 msgr2=0x5610ba19b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5610bad46000 0x5610ba19b180 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5610b9eb1800 msgr2=0x5610ba199b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5610b9eb1800 0x5610ba199b80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5610ba22f400 msgr2=0x5610ba19ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5610ba22f400 0x5610ba19ac00 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5610ba22f000 msgr2=0x5610ba19a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5610ba22f000 0x5610ba19a100 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba22ec00 msgr2=0x5610ba199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba22ec00 0x5610ba199600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5610bac89e90 tx=0x5610ba1f7920 comp rx=0 tx=0).stop 2024-04-19T23:46:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 msgr2=0x5610ba198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.061 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/3603902871 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb1400 0x5610ba198b00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x5610ba2329f0 tx=0x5610ba1f66c0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 reap_dead start 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe71cd700 1 -- 172.21.15.155:0/3603902871 reap_dead start 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 shutdown_connections 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 >> 172.21.15.155:0/3603902871 conn(0x5610b9eb0c00 msgr2=0x5610b9f9d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 shutdown_connections 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.041+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/3603902871 wait complete. 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/4198847994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba3a0000 msgr2=0x5610ba19b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/4198847994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba3a0000 0x5610ba19b700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5610ba29bcb0 tx=0x5610ba1f7b60 comp rx=0 tx=0).stop 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/4198847994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 msgr2=0x5610ba19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/4198847994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x5610ba30ed80 tx=0x5610ba1f7e60 comp rx=0 tx=0).stop 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/4198847994 shutdown_connections 2024-04-19T23:46:41.062 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/4198847994 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba3a0000 0x5610ba19b700 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/4198847994 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610bad47400 0x5610ba19a680 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/4198847994 >> 172.21.15.155:0/4198847994 conn(0x5610bad46800 msgr2=0x5610b9f9e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/4198847994 shutdown_connections 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/4198847994 wait complete. 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/1980410369 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba22e000 msgr2=0x5610ba199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/1980410369 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba22e000 0x5610ba199080 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5610bad3ced0 tx=0x5610ba1f6780 comp rx=0 tx=0).stop 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/1980410369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 msgr2=0x5610ba198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/1980410369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x5610bac895f0 tx=0x5610b9fa1920 comp rx=0 tx=0).stop 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/1980410369 shutdown_connections 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/1980410369 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5610ba22e000 0x5610ba199080 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 --2- 172.21.15.155:0/1980410369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5610b9eb0800 0x5610ba198580 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/1980410369 >> 172.21.15.155:0/1980410369 conn(0x5610b9eb0400 msgr2=0x5610b9f9d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/1980410369 shutdown_connections 2024-04-19T23:46:41.063 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.042+0000 7f6fe9a24a80 1 -- 172.21.15.155:0/1980410369 wait complete. 2024-04-19T23:46:41.068 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:46:41.068 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-19T23:46:41.072 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-19T23:46:41.072 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-04-19T23:46:41.072 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-19T23:46:41.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-19T23:46:41.072 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-04-19T23:46:41.118 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:41.119 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:41.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.119+0000 7f061ccbba80 1 Processor -- start 2024-04-19T23:46:41.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.119+0000 7f061ccbba80 1 -- start start 2024-04-19T23:46:41.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.119+0000 7f061ccbba80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55d185958800 0x55d185c40580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.119+0000 7f061ccbba80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d185c83500 con 0x55d185958c00 2024-04-19T23:46:41.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.119+0000 7f061ccbba80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d1859faa00 con 0x55d185958800 2024-04-19T23:46:41.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.119+0000 7f061a464700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55d185958c00 0x55d185a44800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55742/0 (socket says 172.21.15.155:55742) 2024-04-19T23:46:41.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.119+0000 7f061a464700 1 -- 172.21.15.155:0/992755877 learned_addr learned my addr 172.21.15.155:0/992755877 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:41.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.119+0000 7f061ac65700 1 --2- 172.21.15.155:0/992755877 >> v2:172.21.15.76:3300/0 conn(0x55d185958800 0x55d185c40580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.119+0000 7f061ac65700 1 -- 172.21.15.155:0/992755877 >> v1:172.21.15.76:6789/0 conn(0x55d185958c00 legacy=0x55d185a44800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f061ac65700 1 -- 172.21.15.155:0/992755877 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d185981d40 con 0x55d185958800 2024-04-19T23:46:41.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f061ac65700 1 --2- 172.21.15.155:0/992755877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x55d185c3b9e0 tx=0x55d185a49920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e78e4d88c0f4dc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f0619c63700 1 -- 172.21.15.155:0/992755877 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185a114a0 con 0x55d185958800 2024-04-19T23:46:41.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f0619c63700 1 -- 172.21.15.155:0/992755877 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d185c83800 con 0x55d185958800 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f0619c63700 1 -- 172.21.15.155:0/992755877 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185a11600 con 0x55d185958800 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f061ccbba80 1 -- 172.21.15.155:0/992755877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 msgr2=0x55d185c40580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f061ccbba80 1 --2- 172.21.15.155:0/992755877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x55d185c3b9e0 tx=0x55d185a49920 comp rx=0 tx=0).stop 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f061ccbba80 1 -- 172.21.15.155:0/992755877 shutdown_connections 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f061ccbba80 1 --2- 172.21.15.155:0/992755877 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f061ccbba80 1 -- 172.21.15.155:0/992755877 >> 172.21.15.155:0/992755877 conn(0x55d185958400 msgr2=0x55d185a44000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f061ccbba80 1 -- 172.21.15.155:0/992755877 shutdown_connections 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.120+0000 7f061ccbba80 1 -- 172.21.15.155:0/992755877 wait complete. 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.121+0000 7f061ccbba80 1 Processor -- start 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.121+0000 7f061ccbba80 1 -- start start 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.121+0000 7f061ccbba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.121+0000 7f061ccbba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1859fa500 con 0x55d185958800 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.121+0000 7f061ac65700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.122+0000 7f061ac65700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41094/0 (socket says 172.21.15.155:41094) 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.122+0000 7f061ac65700 1 -- 172.21.15.155:0/1552895402 learned_addr learned my addr 172.21.15.155:0/1552895402 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.122+0000 7f061ac65700 1 -- 172.21.15.155:0/1552895402 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d185981ba0 con 0x55d185958800 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.122+0000 7f061ac65700 1 --2- 172.21.15.155:0/1552895402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x55d186722120 tx=0x55d185a49800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db0371d21251bab server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.122+0000 7f0619462700 1 -- 172.21.15.155:0/1552895402 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185a11760 con 0x55d185958800 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.122+0000 7f0619462700 1 -- 172.21.15.155:0/1552895402 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d185c83b00 con 0x55d185958800 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.122+0000 7f0619462700 1 -- 172.21.15.155:0/1552895402 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185a114a0 con 0x55d185958800 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.122+0000 7f061ccbba80 1 -- 172.21.15.155:0/1552895402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 msgr2=0x55d185c40580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.122+0000 7f061ccbba80 1 --2- 172.21.15.155:0/1552895402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x55d186722120 tx=0x55d185a49800 comp rx=0 tx=0).stop 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.122+0000 7f061ccbba80 1 -- 172.21.15.155:0/1552895402 shutdown_connections 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.123+0000 7f061ccbba80 1 --2- 172.21.15.155:0/1552895402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.123+0000 7f061ccbba80 1 -- 172.21.15.155:0/1552895402 >> 172.21.15.155:0/1552895402 conn(0x55d185958400 msgr2=0x55d185a45000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.123+0000 7f061ccbba80 1 -- 172.21.15.155:0/1552895402 shutdown_connections 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.123+0000 7f061ccbba80 1 -- 172.21.15.155:0/1552895402 wait complete. 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.123+0000 7f061ccbba80 1 Processor -- start 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.123+0000 7f061ccbba80 1 -- start start 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.123+0000 7f061ccbba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.123+0000 7f061ccbba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1859fa3c0 con 0x55d185958800 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.123+0000 7f061ac65700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.123+0000 7f061ac65700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41098/0 (socket says 172.21.15.155:41098) 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.123+0000 7f061ac65700 1 -- 172.21.15.155:0/4262585685 learned_addr learned my addr 172.21.15.155:0/4262585685 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.124+0000 7f061ac65700 1 -- 172.21.15.155:0/4262585685 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d185981a00 con 0x55d185958800 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.124+0000 7f061ac65700 1 --2- 172.21.15.155:0/4262585685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55d186723920 tx=0x55d185a49920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.124+0000 7f0617c5f700 1 -- 172.21.15.155:0/4262585685 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185a11600 con 0x55d185958800 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.124+0000 7f0617c5f700 1 -- 172.21.15.155:0/4262585685 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d185c83c80 con 0x55d185958800 2024-04-19T23:46:41.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.124+0000 7f061ccbba80 1 -- 172.21.15.155:0/4262585685 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d185981860 con 0x55d185958800 2024-04-19T23:46:41.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.124+0000 7f0617c5f700 1 -- 172.21.15.155:0/4262585685 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185a118c0 con 0x55d185958800 2024-04-19T23:46:41.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.124+0000 7f061ccbba80 1 -- 172.21.15.155:0/4262585685 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1859816c0 con 0x55d185958800 2024-04-19T23:46:41.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.125+0000 7f061ccbba80 1 Processor -- start 2024-04-19T23:46:41.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.125+0000 7f061ccbba80 1 -- start start 2024-04-19T23:46:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.125+0000 7f0617c5f700 1 -- 172.21.15.155:0/4262585685 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d1866fab00 con 0x55d185958800 2024-04-19T23:46:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.125+0000 7f061ccbba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 0x55d185c40b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.125+0000 7f061ccbba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d185994640 con 0x55d185959400 2024-04-19T23:46:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.125+0000 7f0617c5f700 1 --2- 172.21.15.155:0/4262585685 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185cde000 0x55d185c41080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.125+0000 7f0617c5f700 1 -- 172.21.15.155:0/4262585685 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d1859d3180 con 0x55d185958800 2024-04-19T23:46:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.125+0000 7f061b466700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 0x55d185c40b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.125+0000 7f061b466700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 0x55d185c40b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41102/0 (socket says 172.21.15.155:41102) 2024-04-19T23:46:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.125+0000 7f061b466700 1 -- 172.21.15.155:0/1308084172 learned_addr learned my addr 172.21.15.155:0/1308084172 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.125+0000 7f061ac65700 1 --2- 172.21.15.155:0/4262585685 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185cde000 0x55d185c41080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061b466700 1 -- 172.21.15.155:0/1308084172 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d185980000 con 0x55d185959400 2024-04-19T23:46:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061ac65700 1 --2- 172.21.15.155:0/4262585685 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185cde000 0x55d185c41080 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55d1867d4f90 tx=0x55d185ca4780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061b466700 1 --2- 172.21.15.155:0/1308084172 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 0x55d185c40b00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x55d1867d43c0 tx=0x55d185ca4a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308ae88a1d268afb server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061545a700 1 -- 172.21.15.155:0/1308084172 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185a11600 con 0x55d185959400 2024-04-19T23:46:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061545a700 1 -- 172.21.15.155:0/1308084172 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1859f9c80 con 0x55d185959400 2024-04-19T23:46:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061545a700 1 -- 172.21.15.155:0/1308084172 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185a118c0 con 0x55d185959400 2024-04-19T23:46:41.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061ccbba80 1 -- 172.21.15.155:0/1308084172 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 msgr2=0x55d185c40b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061ccbba80 1 --2- 172.21.15.155:0/1308084172 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 0x55d185c40b00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x55d1867d43c0 tx=0x55d185ca4a80 comp rx=0 tx=0).stop 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061ccbba80 1 -- 172.21.15.155:0/1308084172 shutdown_connections 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061ccbba80 1 --2- 172.21.15.155:0/1308084172 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 0x55d185c40b00 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061ccbba80 1 -- 172.21.15.155:0/1308084172 >> 172.21.15.155:0/1308084172 conn(0x55d185958c00 msgr2=0x55d185a45800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061ccbba80 1 -- 172.21.15.155:0/1308084172 shutdown_connections 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.126+0000 7f061ccbba80 1 -- 172.21.15.155:0/1308084172 wait complete. 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.127+0000 7f061ccbba80 1 Processor -- start 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.127+0000 7f061ccbba80 1 -- start start 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.127+0000 7f061ccbba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 0x55d185c40b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.127+0000 7f061ccbba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1859948c0 con 0x55d185959400 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.127+0000 7f061b466700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 0x55d185c40b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.127+0000 7f061b466700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 0x55d185c40b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41112/0 (socket says 172.21.15.155:41112) 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.127+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 learned_addr learned my addr 172.21.15.155:0/3054626645 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.127+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d185980ea0 con 0x55d185959400 2024-04-19T23:46:41.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.127+0000 7f061b466700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 0x55d185c40b00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55d1867d5fb0 tx=0x55d185ca46c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.128+0000 7f0613c57700 1 -- 172.21.15.155:0/3054626645 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185a11760 con 0x55d185959400 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.128+0000 7f0613c57700 1 -- 172.21.15.155:0/3054626645 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1859f9b00 con 0x55d185959400 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.128+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d185980820 con 0x55d185959400 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.128+0000 7f0613c57700 1 -- 172.21.15.155:0/3054626645 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185a11600 con 0x55d185959400 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.128+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1859809c0 con 0x55d185959400 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.129+0000 7f0613c57700 1 -- 172.21.15.155:0/3054626645 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d1866fadc0 con 0x55d185959400 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.129+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.129+0000 7f0613c57700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185cdec00 0x55d185c41600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.129+0000 7f0613c57700 1 -- 172.21.15.155:0/3054626645 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d1859d3340 con 0x55d185959400 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.129+0000 7f061a464700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185cdec00 0x55d185c41600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.129+0000 7f061ccbba80 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d185959800 0x55d185c41b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.129+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185959c00 con 0x55d185959800 2024-04-19T23:46:41.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.129+0000 7f061b466700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d185959800 0x55d185c41b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.129+0000 7f061a464700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185cdec00 0x55d185c41600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55d185cedd70 tx=0x55d185ca5920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.129+0000 7f061b466700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d185959800 0x55d185c41b80 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 20 realm 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdf000 con 0x55d185959800 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdf400 con 0x55d185959800 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdf800 con 0x55d185959800 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.130+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdfc00 con 0x55d185959800 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.131+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.131+0000 7f061ccbba80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.131+0000 7f061ccbba80 20 searching for the correct realm 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.131+0000 7f061ccbba80 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d185cdf000 0x55d185c42100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.131+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdf400 con 0x55d185cdf000 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.131+0000 7f061ac65700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d185cdf000 0x55d185c42100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.131+0000 7f061ac65700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d185cdf000 0x55d185c42100 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.131+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.131+0000 7f061ac65700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d185cdf400 0x55d185c42c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.131+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4000 con 0x55d185cdf400 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.132+0000 7f061a464700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d185cdf400 0x55d185c42c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.132+0000 7f061a464700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d185cdf400 0x55d185c42c00 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.132+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.132+0000 7f061a464700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d185da4000 0x55d185c43180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.132+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185da4000 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.132+0000 7f061b466700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d185da4000 0x55d185c43180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.133+0000 7f061b466700 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d185da4000 0x55d185c43180 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.133+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.133+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185959800 2024-04-19T23:46:41.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.133+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.133+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185959800 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.133+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.133+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185959800 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.134+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.134+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185da4000 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.134+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.134+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf400 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.134+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.134+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf000 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.134+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.134+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185959800 2024-04-19T23:46:41.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.134+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.134+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185da4000 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.135+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.135+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185959800 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.135+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.135+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf400 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.135+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.135+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf000 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.136+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.136+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf000 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.136+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.136+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf400 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.136+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.136+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf000 2024-04-19T23:46:41.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.136+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.136+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf000 2024-04-19T23:46:41.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.136+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.136+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185959800 2024-04-19T23:46:41.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.137+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.137+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185959800 2024-04-19T23:46:41.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.137+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.137+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185da4000 2024-04-19T23:46:41.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.137+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.137+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf000 2024-04-19T23:46:41.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.137+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.137+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf400 2024-04-19T23:46:41.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.138+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.138+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185959800 2024-04-19T23:46:41.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.138+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.138+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185da4000 2024-04-19T23:46:41.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.138+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.138+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf000 2024-04-19T23:46:41.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.138+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.138+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185da4000 2024-04-19T23:46:41.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.139+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.139+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf400 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.139+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.139+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf000 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.139+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.139+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185da4000 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185959800 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf400 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185959c00 con 0x55d185959800 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4c00 con 0x55d185959800 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.140+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5000 con 0x55d185cdf400 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 20 zone default found 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 4 Realm: () 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:41.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 20 zonegroup default 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5400 con 0x55d185da4000 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5800 con 0x55d185cdf000 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.141+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5c00 con 0x55d185cdf000 2024-04-19T23:46:41.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.142+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.142+0000 7f061ccbba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.142+0000 7f061ccbba80 20 started sync module instance, tier type = 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.142+0000 7f061ccbba80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.142+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4c00 con 0x55d185cdf400 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.143+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.143+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94358380706560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185959c00 con 0x55d185cdf400 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.143+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdf800 con 0x55d185959800 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.144+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94358380706560] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.144+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.144+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94358380707712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdfc00 con 0x55d185959800 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.144+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185cdf000 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.145+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94358380707712] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.145+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.145+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94358380708864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5000 con 0x55d185cdf000 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.145+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4c00 con 0x55d185cdf400 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.146+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.146+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94358380710016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4400 con 0x55d185cdf400 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.146+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5800 con 0x55d185959800 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.147+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94358380708864] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.147+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.148+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94358380711168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5c00 con 0x55d185959800 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.148+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4800 con 0x55d185da4000 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.148+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94358380710016] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.149+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94358380711168] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.149+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.149+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94358380712320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5400 con 0x55d185da4000 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.149+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5800 con 0x55d185da4000 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.150+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.150+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94358380713472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5c00 con 0x55d185da4000 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.150+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdf800 con 0x55d185da4000 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.150+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94358380712320] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.151+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94358380713472] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.151+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.151+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94358380714624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdfc00 con 0x55d185da4000 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.151+0000 7f061ccbba80 20 add_watcher() i=0 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.151+0000 7f061ccbba80 20 add_watcher() i=1 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.151+0000 7f061ccbba80 20 add_watcher() i=2 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.151+0000 7f061ccbba80 20 add_watcher() i=3 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.151+0000 7f061ccbba80 20 add_watcher() i=4 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.151+0000 7f061ccbba80 20 add_watcher() i=5 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.151+0000 7f061ccbba80 20 add_watcher() i=6 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.152+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94358380714624] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.152+0000 7f061ccbba80 20 add_watcher() i=7 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.152+0000 7f061ccbba80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.152+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdf800 con 0x55d185959800 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.152+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.152+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94358382247936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdfc00 con 0x55d185959800 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.153+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94358382247936] v32'219 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.153+0000 7f0601c33700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.154+0000 7f061ccbba80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.154+0000 7f061ccbba80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.154+0000 7f061ccbba80 1 Processor -- start 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.154+0000 7f061ccbba80 1 -- start start 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.154+0000 7f061ccbba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.154+0000 7f061ccbba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1859fa3c0 con 0x55d185da5400 2024-04-19T23:46:41.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.154+0000 7f061a464700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.154+0000 7f061a464700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41120/0 (socket says 172.21.15.155:41120) 2024-04-19T23:46:41.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.154+0000 7f061a464700 1 -- 172.21.15.155:0/2129275412 learned_addr learned my addr 172.21.15.155:0/2129275412 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.154+0000 7f061a464700 1 -- 172.21.15.155:0/2129275412 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d185980b60 con 0x55d185da5400 2024-04-19T23:46:41.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.155+0000 7f061a464700 1 --2- 172.21.15.155:0/2129275412 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55d185d404b0 tx=0x55d185ca5d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e04c8573fe720a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.155+0000 7f0601432700 1 -- 172.21.15.155:0/2129275412 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185dc8000 con 0x55d185da5400 2024-04-19T23:46:41.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.155+0000 7f0601432700 1 -- 172.21.15.155:0/2129275412 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d185dd0000 con 0x55d185da5400 2024-04-19T23:46:41.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.155+0000 7f0601432700 1 -- 172.21.15.155:0/2129275412 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185dc8160 con 0x55d185da5400 2024-04-19T23:46:41.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.155+0000 7f061ccbba80 1 -- 172.21.15.155:0/2129275412 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 msgr2=0x55d185c42680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.155+0000 7f061ccbba80 1 --2- 172.21.15.155:0/2129275412 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55d185d404b0 tx=0x55d185ca5d40 comp rx=0 tx=0).stop 2024-04-19T23:46:41.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.155+0000 7f061ccbba80 1 -- 172.21.15.155:0/2129275412 shutdown_connections 2024-04-19T23:46:41.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.155+0000 7f061ccbba80 1 --2- 172.21.15.155:0/2129275412 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.155+0000 7f061ccbba80 1 -- 172.21.15.155:0/2129275412 >> 172.21.15.155:0/2129275412 conn(0x55d185da4800 msgr2=0x55d185a46000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.155+0000 7f061ccbba80 1 -- 172.21.15.155:0/2129275412 shutdown_connections 2024-04-19T23:46:41.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.155+0000 7f061ccbba80 1 -- 172.21.15.155:0/2129275412 wait complete. 2024-04-19T23:46:41.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.156+0000 7f061ccbba80 1 Processor -- start 2024-04-19T23:46:41.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.156+0000 7f061ccbba80 1 -- start start 2024-04-19T23:46:41.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.156+0000 7f061ccbba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.156+0000 7f061ccbba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1859fa500 con 0x55d185da5400 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.156+0000 7f061a464700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.156+0000 7f061a464700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41134/0 (socket says 172.21.15.155:41134) 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.156+0000 7f061a464700 1 -- 172.21.15.155:0/413584289 learned_addr learned my addr 172.21.15.155:0/413584289 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.156+0000 7f061a464700 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d185980d00 con 0x55d185da5400 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.157+0000 7f061a464700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x55d185d41770 tx=0x55d185ca5e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.157+0000 7f05ffc2f700 1 -- 172.21.15.155:0/413584289 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185dc82c0 con 0x55d185da5400 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.157+0000 7f05ffc2f700 1 -- 172.21.15.155:0/413584289 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d185dd0180 con 0x55d185da5400 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.157+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d185980340 con 0x55d185da5400 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.157+0000 7f05ffc2f700 1 -- 172.21.15.155:0/413584289 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d185dc8000 con 0x55d185da5400 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.157+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d185980b60 con 0x55d185da5400 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.158+0000 7f05ffc2f700 1 -- 172.21.15.155:0/413584289 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d1866fbb80 con 0x55d185da5400 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.158+0000 7f05ffc2f700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185e4a000 0x55d185c43700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.158+0000 7f05ffc2f700 1 -- 172.21.15.155:0/413584289 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d1859d3500 con 0x55d185da5400 2024-04-19T23:46:41.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.158+0000 7f061b466700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185e4a000 0x55d185c43700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.158+0000 7f061ccbba80 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d185da5800 0x55d185e5c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.158+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5c00 con 0x55d185da5800 2024-04-19T23:46:41.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.158+0000 7f061ac65700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d185da5800 0x55d185e5c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.158+0000 7f061b466700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185e4a000 0x55d185c43700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55d185d40030 tx=0x55d185ca5b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.158+0000 7f061ac65700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d185da5800 0x55d185e5c000 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.159+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185da5800 2024-04-19T23:46:41.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.159+0000 7f061ccbba80 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d185e4a400 0x55d185e5c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.159+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4a800 con 0x55d185e4a400 2024-04-19T23:46:41.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.160+0000 7f061a464700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d185e4a400 0x55d185e5c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.160+0000 7f061a464700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d185e4a400 0x55d185e5c580 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.161+0000 7f061a464700 1 -- 172.21.15.155:0/413584289 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185e4a400 2024-04-19T23:46:41.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.161+0000 7f061ccbba80 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d185e4ac00 0x55d185e5cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.161+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b000 con 0x55d185e4ac00 2024-04-19T23:46:41.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.161+0000 7f061b466700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d185e4ac00 0x55d185e5cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.161+0000 7f061b466700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d185e4ac00 0x55d185e5cb00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.162+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.162+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b400 con 0x55d185da5800 2024-04-19T23:46:41.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.163+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v32'220 uv163 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185da5800 2024-04-19T23:46:41.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.163+0000 7f061ccbba80 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d185e4b800 0x55d185e5d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.163+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4bc00 con 0x55d185e4b800 2024-04-19T23:46:41.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.163+0000 7f061ac65700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d185e4b800 0x55d185e5d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.164+0000 7f061ac65700 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d185e4b800 0x55d185e5d080 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.165+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v32'68 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185e4b800 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.165+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72000 con 0x55d185e4ac00 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.165+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v32'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.166+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72400 con 0x55d185da5800 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.167+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v32'29 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185da5800 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.167+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72800 con 0x55d185e4a400 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.168+0000 7f061a464700 1 -- 172.21.15.155:0/413584289 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v32'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185e4a400 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.168+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72c00 con 0x55d185e4b800 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.169+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185e4b800 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.169+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73000 con 0x55d185e4ac00 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.170+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.170+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73400 con 0x55d185e4b800 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.170+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v32'69 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185e4b800 2024-04-19T23:46:41.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.170+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73800 con 0x55d185e4a400 2024-04-19T23:46:41.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.172+0000 7f061a464700 1 -- 172.21.15.155:0/413584289 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185e4a400 2024-04-19T23:46:41.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.172+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73c00 con 0x55d185e4b800 2024-04-19T23:46:41.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.173+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185e4b800 2024-04-19T23:46:41.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.173+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72800 con 0x55d185e4a400 2024-04-19T23:46:41.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.174+0000 7f061a464700 1 -- 172.21.15.155:0/413584289 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v32'54 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185e4a400 2024-04-19T23:46:41.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.174+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72400 con 0x55d185da5800 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.175+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v32'221 uv165 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185da5800 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.175+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4a800 con 0x55d185e4ac00 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.176+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v32'67 uv50 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.176+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b400 con 0x55d185e4b800 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.177+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v32'70 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185e4b800 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.177+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4bc00 con 0x55d185e4ac00 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.178+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.178+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4c00 con 0x55d185da5800 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.179+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185da5800 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.179+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5000 con 0x55d185da5800 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.180+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'222 uv167 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185da5800 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.181+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5c00 con 0x55d185e4ac00 2024-04-19T23:46:41.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.182+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'68 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.182+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185959c00 con 0x55d185e4b800 2024-04-19T23:46:41.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.183+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'36 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185e4b800 2024-04-19T23:46:41.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.183+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b400 con 0x55d185e4ac00 2024-04-19T23:46:41.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.184+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.184+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b000 con 0x55d185e4ac00 2024-04-19T23:46:41.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.184+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.184+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4a800 con 0x55d185e4ac00 2024-04-19T23:46:41.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.185+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'22 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.185+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4bc00 con 0x55d185e4ac00 2024-04-19T23:46:41.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.186+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.186+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72c00 con 0x55d185e4a400 2024-04-19T23:46:41.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.187+0000 7f061a464700 1 -- 172.21.15.155:0/413584289 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185e4a400 2024-04-19T23:46:41.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.188+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73400 con 0x55d185e4ac00 2024-04-19T23:46:41.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.188+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.188+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73c00 con 0x55d185e4a400 2024-04-19T23:46:41.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.189+0000 7f061a464700 1 -- 172.21.15.155:0/413584289 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185e4a400 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.190+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72400 con 0x55d185e4ac00 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.191+0000 7f061b466700 1 -- 172.21.15.155:0/413584289 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'69 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185e4ac00 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.191+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72000 con 0x55d185e4a400 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.192+0000 7f061a464700 1 -- 172.21.15.155:0/413584289 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'55 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185e4a400 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.192+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73000 con 0x55d185e4b800 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.193+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185e4b800 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.194+0000 7f05fd42a700 20 reqs_thread_entry: start 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.194+0000 7f061ccbba80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.194+0000 7f061ccbba80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.194+0000 7f05fb426700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:11 2024 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.194+0000 7f05fac04700 20 reqs_thread_entry: start 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.194+0000 7f061ccbba80 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.194+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.194+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdfc00 con 0x55d185cdf400 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.195+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(62 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.195+0000 7f061ccbba80 20 rados_obj.operate() r=0 bl.length=346 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.195+0000 7f061ccbba80 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.195+0000 7f061ccbba80 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.195+0000 7f061ccbba80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.195+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4c00 con 0x55d185959800 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.195+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 bud.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.195+0000 7f061ccbba80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 : miss 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.195+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.195+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 8.8 8:152d67b9:root::.bucket.meta.myfoo6%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73400 con 0x55d185959800 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.196+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(64 .bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=212b] v0'0 uv4 ondisk = 0) v8 ==== 333+0+629 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.196+0000 7f061ccbba80 20 rados_obj.operate() r=0 bl.length=353 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.196+0000 7f061ccbba80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 info.flags=0x17 2024-04-19T23:46:41.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.196+0000 7f061ccbba80 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 to cache LRU end 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.196+0000 7f061ccbba80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.196+0000 7f061ccbba80 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.196+0000 7f061ccbba80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.196+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 4.22 4:44dc655f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72400 con 0x55d185959800 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.196+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(65 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.196+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:66 4.7 4:e2a1b195:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73800 con 0x55d185da4000 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.197+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(66 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.197+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 4.0 4:02c2d88f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72800 con 0x55d185cdf000 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.197+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.197+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 4.27 4:e6aa74b9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72c00 con 0x55d185959800 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.197+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(68 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.197+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 4.32 4:4ef98a53:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73c00 con 0x55d185959800 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.198+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(69 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.198+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 4.36 4:6de450db:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72000 con 0x55d185959800 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.198+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(70 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.198+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:71 4.19 4:9b5f424f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5c00 con 0x55d185cdf000 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.198+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(71 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.6 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.198+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:72 4.34 4:2f503fb1:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4c00 con 0x55d185cdf400 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.199+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(72 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.199+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 4.1f 4:fb7400a3:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b400 con 0x55d185cdf000 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.199+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(73 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.199+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:74 4.39 4:9c616a46:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b000 con 0x55d185cdf000 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.199+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(74 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9 [call out=289b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+289 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.199+0000 7f061ccbba80 10 cls_bucket_list_unordered: got thirteen 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.199+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 4.f 4:f3cf2b99:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4a800 con 0x55d185959800 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.199+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(75 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.199+0000 7f061ccbba80 20 get_obj_state: rctx=0x55d185d8acb0 obj=myfoo6:thirteen state=0x55d185f061e8 s->prefetch_data=0 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.199+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:76 3.35 3:ad09574f:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4bc00 con 0x55d185959800 2024-04-19T23:46:41.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.200+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(76 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 238+0+835 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.200+0000 7f061ccbba80 10 manifest: total_size = 8 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.200+0000 7f061ccbba80 20 get_obj_state: setting s->obj_tag to _eYvwNKw8-XnCICxlfVfNA_nF3cfxSqa 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.200+0000 7f061ccbba80 20 get_obj_state: rctx=0x55d185d8acb0 obj=myfoo6:thirteen state=0x55d185f061e8 s->prefetch_data=0 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.200+0000 7f061ccbba80 20 prepare_atomic_modification: state is not atomic. state=0x55d185f061e8 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.200+0000 7f061ccbba80 20 bucket index object: default.rgw.buckets.index:.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.200+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:77 4.39 4:9c616a46:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b400 con 0x55d185cdf000 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.201+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(77 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9 [stat,call,call] v32'10 uv10 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.201+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:78 3.35 3:ad09574f:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b000 con 0x55d185959800 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(78 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7_thirteen [call] v32'3 uv3 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:79 4.39 4:9c616a46:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5c00 con 0x55d185cdf000 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 20 list_objects_ordered: starting attempt 1 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:80 4.22 4:44dc655f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73000 con 0x55d185959800 2024-04-19T23:46:41.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:81 4.7 4:e2a1b195:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72800 con 0x55d185da4000 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:82 4.0 4:02c2d88f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185959c00 con 0x55d185cdf000 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:83 4.27 4:e6aa74b9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4a800 con 0x55d185959800 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:84 4.32 4:4ef98a53:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4bc00 con 0x55d185959800 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:85 4.36 4:6de450db:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b000 con 0x55d185959800 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:86 4.19 4:9b5f424f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73400 con 0x55d185cdf000 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:87 4.34 4:2f503fb1:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72400 con 0x55d185cdf400 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:88 4.1f 4:fb7400a3:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73800 con 0x55d185cdf000 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:89 4.39 4:9c616a46:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72c00 con 0x55d185cdf000 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:90 4.f 4:f3cf2b99:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73c00 con 0x55d185959800 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(82 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(83 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 33 ==== osd_op_reply(80 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 34 ==== osd_op_reply(85 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 35 ==== osd_op_reply(84 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.202+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(81 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.203+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 36 ==== osd_op_reply(90 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.203+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(88 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.203+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(86 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.6 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.203+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(87 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.203+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== osd_op_reply(79 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9 [stat,call,call] v32'11 uv11 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.203+0000 7f0614c59700 20 handle_completion(): completion ok for obj=thirteen 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(89 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9 [call out=124b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7])"; uploads.size()=0; is_truncated=0 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo6[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7]) 2024-04-19T23:46:41.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-04-19T23:46:41.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 20 lifecycle: rados->read ofs=0 len=0 2024-04-19T23:46:41.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:91 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72000 con 0x55d185959800 2024-04-19T23:46:41.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 37 ==== osd_op_reply(91 myfoo6 [call out=48b,stat out=16b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 276+0+305 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 20 lifecycle: rados_obj.operate() r=0 bl.length=166 2024-04-19T23:46:41.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x17 2024-04-19T23:46:41.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 10 lifecycle: adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-19T23:46:41.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:46:41.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.204+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:92 8.8 8:152d67b9:root::.bucket.meta.myfoo6%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0a400 con 0x55d185959800 2024-04-19T23:46:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.205+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 38 ==== osd_op_reply(92 .bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 [delete,create,call,call,writefull 0~353,setxattr (117)] v32'5 uv5 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.205+0000 7f061ccbba80 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 info.flags=0x17 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.205+0000 7f061ccbba80 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 to cache LRU end 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.205+0000 7f061ccbba80 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.205+0000 7f061ccbba80 10 lifecycle: distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7, ofs0, ns] 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.205+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify cookie 94358382251392 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0ac00 con 0x55d185da4000 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== watch-notify(notify (1) cookie 94358380712320 notify 137438953505 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x55d185e15d40 con 0x55d185da4000 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f0614c59700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94358380712320 notifier 4821 bl.length()=721 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f0614c59700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 info.flags=0x17 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f0614c59700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 to cache LRU end 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f0614c59700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(93 notify.5 [notify cookie 94358382251392 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f0614c59700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5000 con 0x55d185da4000 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(94 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== watch-notify(notify_complete (2) cookie 94358382251392 notify 137438953505 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d185d45a00 con 0x55d185da4000 2024-04-19T23:46:41.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f061ccbba80 20 lifecycle: handle_bi_update(): bucket=:myfoo6[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7]): orig_sources= new_sources= 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f061ccbba80 20 lifecycle: handle_bi_update(): bucket=:myfoo6[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7]): potential sources added=[] removed=[] 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f061ccbba80 20 lifecycle: handle_bi_update(): bucket=:myfoo6[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7]): orig_dests= new_dests= 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f061ccbba80 20 lifecycle: handle_bi_update(): bucket=:myfoo6[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7]): potential dests added=[] removed=[] 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.206+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:33 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0b000 con 0x55d185da5800 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.207+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(33 lc.9 [call] v32'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185da5800 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.207+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:34 6.19 6:994d36d1:lc::lc.9:head [call rgw.lc_rm_entry in=93b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0b400 con 0x55d185da5800 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.208+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(34 lc.9 [call] v32'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185da5800 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.208+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:35 6.19 6:994d36d1:lc::lc.9:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0b800 con 0x55d185da5800 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.209+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(35 lc.9 [call] v32'38 uv38 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185da5800 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:95 4.22 4:44dc655f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0bc00 con 0x55d185959800 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:96 4.7 4:e2a1b195:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0b000 con 0x55d185da4000 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:97 4.0 4:02c2d88f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0b400 con 0x55d185cdf000 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:98 4.27 4:e6aa74b9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0a800 con 0x55d185959800 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:99 4.32 4:4ef98a53:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0a000 con 0x55d185959800 2024-04-19T23:46:41.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:100 4.36 4:6de450db:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0a400 con 0x55d185959800 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:101 4.19 4:9b5f424f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73400 con 0x55d185cdf000 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:102 4.34 4:2f503fb1:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73800 con 0x55d185cdf400 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:103 4.1f 4:fb7400a3:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72c00 con 0x55d185cdf000 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:104 4.39 4:9c616a46:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73000 con 0x55d185cdf000 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:105 4.f 4:f3cf2b99:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72800 con 0x55d185959800 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(102 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.7 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(96 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 39 ==== osd_op_reply(95 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 40 ==== osd_op_reply(100 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 41 ==== osd_op_reply(98 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 42 ==== osd_op_reply(99 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 43 ==== osd_op_reply(105 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(97 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 25 ==== osd_op_reply(103 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 26 ==== osd_op_reply(101 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.6 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 27 ==== osd_op_reply(104 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9 [call out=124b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.210+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:106 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73c00 con 0x55d185959800 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.211+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 44 ==== osd_op_reply(106 bud.buckets [call] v32'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.211+0000 7f061ccbba80 10 cache get: name=default.rgw.meta+root+myfoo6 : hit (requested=0x11, cached=0x17) 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.211+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:107 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72000 con 0x55d185959800 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.212+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 45 ==== osd_op_reply(107 myfoo6 [call,call,delete] v32'21 uv21 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.212+0000 7f061ccbba80 10 removing default.rgw.meta+root+myfoo6 from cache 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.212+0000 7f061ccbba80 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.212+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [notify cookie 94358382251392 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b400 con 0x55d185cdf400 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.213+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== watch-notify(notify (1) cookie 94358380710016 notify 137438953490 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x55d185d45ba0 con 0x55d185cdf400 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.213+0000 7f0614c59700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94358380710016 notifier 4821 bl.length()=150 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.213+0000 7f0614c59700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f10000 con 0x55d185cdf400 2024-04-19T23:46:41.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.213+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(108 notify.3 [notify cookie 94358382251392 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.213+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== watch-notify(notify_complete (2) cookie 94358382251392 notify 137438953490 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d185d441a0 con 0x55d185cdf400 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.213+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 20 ==== osd_op_reply(109 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.213+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:110 8.8 8:152d67b9:root::.bucket.meta.myfoo6%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4a800 con 0x55d185959800 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.214+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 46 ==== osd_op_reply(110 .bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 [call,call,delete] v32'6 uv6 ondisk = 0) v8 ==== 291+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.214+0000 7f061ccbba80 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 from cache 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.214+0000 7f061ccbba80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7, ofs0, ns] 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.214+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [notify cookie 94358382251392 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4bc00 con 0x55d185da4000 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== watch-notify(notify (1) cookie 94358380712320 notify 137438953506 ret 0) v3 ==== 249+0+0 (crc 0 0 0) 0x55d185d45a00 con 0x55d185da4000 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061545a700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94358380712320 notifier 4821 bl.length()=207 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(111 notify.5 [notify cookie 94358382251392 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061545a700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0ac00 con 0x55d185da4000 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== watch-notify(notify_complete (2) cookie 94358382251392 notify 137438953506 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d185e144e0 con 0x55d185da4000 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(112 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:113 4.22 4:44dc655f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b000 con 0x55d185959800 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:114 4.7 4:e2a1b195:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185959c00 con 0x55d185da4000 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:115 4.0 4:02c2d88f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5c00 con 0x55d185cdf000 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:116 4.27 4:e6aa74b9:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4a800 con 0x55d185959800 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:117 4.32 4:4ef98a53:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b400 con 0x55d185959800 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:118 4.36 4:6de450db:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72800 con 0x55d185959800 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:119 4.19 4:9b5f424f:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73c00 con 0x55d185cdf000 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:120 4.34 4:2f503fb1:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72000 con 0x55d185cdf400 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:121 4.1f 4:fb7400a3:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72400 con 0x55d185cdf000 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:122 4.39 4:9c616a46:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73800 con 0x55d185cdf000 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.215+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:123 4.f 4:f3cf2b99:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da5000 con 0x55d185959800 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.217+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 47 ==== osd_op_reply(118 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.5 [delete] v32'3 uv3 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.217+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 28 ==== osd_op_reply(119 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.6 [delete] v32'3 uv3 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.217+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 29 ==== osd_op_reply(121 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.8 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.217+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 30 ==== osd_op_reply(122 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.9 [delete] v32'12 uv12 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.217+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 31 ==== osd_op_reply(115 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.2 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.217+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 48 ==== osd_op_reply(116 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.3 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(114 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.1 [delete] v32'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 49 ==== osd_op_reply(123 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.10 [delete] v32'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 50 ==== osd_op_reply(117 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.4 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 51 ==== osd_op_reply(113 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.0 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 21 ==== osd_op_reply(120 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7.7 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061ccbba80 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 : miss 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061ccbba80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:124 6.e 6:76670276:::pubsub..bucket.myfoo6%2f1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185da4c00 con 0x55d185959800 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 52 ==== osd_op_reply(124 pubsub..bucket.myfoo6/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061ccbba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061ccbba80 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 info.flags=0x0 2024-04-19T23:46:41.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061ccbba80 10 adding default.rgw.log++pubsub..bucket.myfoo6/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 to cache LRU end 2024-04-19T23:46:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.218+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:125 6.e 6:76670276:::pubsub..bucket.myfoo6%2f1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdfc00 con 0x55d185959800 2024-04-19T23:46:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.219+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 53 ==== osd_op_reply(125 pubsub..bucket.myfoo6/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.7 [delete] v32'30 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.219+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:126 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0b000 con 0x55d185959800 2024-04-19T23:46:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.220+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 54 ==== osd_op_reply(126 bud.buckets [call] v32'5 uv5 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.220+0000 7f061ccbba80 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-04-19T23:46:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.220+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:127 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0a800 con 0x55d185959800 2024-04-19T23:46:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.221+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 55 ==== osd_op_reply(127 NX5QOQKC6BH2IDN8HC7A [delete] v32'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.221+0000 7f061ccbba80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-19T23:46:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.221+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:128 7.3 7:c609908c:::notify.5:head [notify cookie 94358382251392 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0a000 con 0x55d185da4000 2024-04-19T23:46:41.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.222+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== watch-notify(notify (1) cookie 94358380712320 notify 137438953507 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55d185e144e0 con 0x55d185da4000 2024-04-19T23:46:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.222+0000 7f061545a700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94358380712320 notifier 4821 bl.length()=170 2024-04-19T23:46:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.222+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 28 ==== osd_op_reply(128 notify.5 [notify cookie 94358382251392 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.222+0000 7f061545a700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:129 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0bc00 con 0x55d185da4000 2024-04-19T23:46:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.222+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 29 ==== watch-notify(notify_complete (2) cookie 94358382251392 notify 137438953507 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d185e14680 con 0x55d185da4000 2024-04-19T23:46:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.222+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 30 ==== osd_op_reply(129 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.222+0000 7f061ccbba80 10 removing email index: 2024-04-19T23:46:41.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.222+0000 7f061ccbba80 10 removing user buckets index 2024-04-19T23:46:41.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.222+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:130 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0a400 con 0x55d185959800 2024-04-19T23:46:41.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.223+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 56 ==== osd_op_reply(130 bud.buckets [delete] v32'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.223+0000 7f061ccbba80 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-04-19T23:46:41.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.223+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:131 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94358382251392 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72800 con 0x55d185da4000 2024-04-19T23:46:41.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.223+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 31 ==== watch-notify(notify (1) cookie 94358380713472 notify 137438953508 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55d185e14680 con 0x55d185da4000 2024-04-19T23:46:41.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.223+0000 7f061545a700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 94358380713472 notifier 4821 bl.length()=160 2024-04-19T23:46:41.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.223+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 32 ==== osd_op_reply(131 notify.6 [notify cookie 94358382251392 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.223+0000 7f061545a700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:132 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f18000 con 0x55d185da4000 2024-04-19T23:46:41.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.224+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 33 ==== osd_op_reply(132 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.224+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 34 ==== watch-notify(notify_complete (2) cookie 94358382251392 notify 137438953508 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d185e14820 con 0x55d185da4000 2024-04-19T23:46:41.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.224+0000 7f061ccbba80 10 removing user index: bud 2024-04-19T23:46:41.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.224+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:133 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e73400 con 0x55d185cdf400 2024-04-19T23:46:41.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.225+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 22 ==== osd_op_reply(133 bud [call,call,delete] v32'3 uv3 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.225+0000 7f061ccbba80 10 removing default.rgw.meta+users.uid+bud from cache 2024-04-19T23:46:41.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.225+0000 7f061ccbba80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-19T23:46:41.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.225+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:134 7.3 7:c609908c:::notify.5:head [notify cookie 94358382251392 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e72c00 con 0x55d185da4000 2024-04-19T23:46:41.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.225+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 35 ==== watch-notify(notify (1) cookie 94358380712320 notify 137438953509 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55d185e14820 con 0x55d185da4000 2024-04-19T23:46:41.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.225+0000 7f061545a700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94358380712320 notifier 4821 bl.length()=152 2024-04-19T23:46:41.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.225+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 36 ==== osd_op_reply(134 notify.5 [notify cookie 94358382251392 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.225+0000 7f061545a700 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:135 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f18400 con 0x55d185da4000 2024-04-19T23:46:41.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.226+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 37 ==== osd_op_reply(135 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.226+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 38 ==== watch-notify(notify_complete (2) cookie 94358382251392 notify 137438953509 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d185e149c0 con 0x55d185da4000 2024-04-19T23:46:41.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.226+0000 7f0601c33700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:41.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.226+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:136 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94358382247936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0a800 con 0x55d185959800 2024-04-19T23:46:41.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.227+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 57 ==== osd_op_reply(136 data_loggenerations_metadata [watch unwatch cookie 94358382247936] v32'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.227+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:137 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94358380706560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0b800 con 0x55d185cdf400 2024-04-19T23:46:41.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.228+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 23 ==== osd_op_reply(137 notify.0 [watch unwatch cookie 94358380706560] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d87440 con 0x55d185cdf400 2024-04-19T23:46:41.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.228+0000 7f061ccbba80 20 remove_watcher() i=0 2024-04-19T23:46:41.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.228+0000 7f061ccbba80 2 removed watcher, disabling cache 2024-04-19T23:46:41.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.228+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:138 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94358380707712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185f0b400 con 0x55d185959800 2024-04-19T23:46:41.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.229+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 58 ==== osd_op_reply(138 notify.1 [watch unwatch cookie 94358380707712] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.230+0000 7f061ccbba80 20 remove_watcher() i=1 2024-04-19T23:46:41.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.230+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:139 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94358380708864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185cdfc00 con 0x55d185cdf000 2024-04-19T23:46:41.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.231+0000 7f061ac65700 1 -- 172.21.15.155:0/3054626645 <== osd.3 v2:172.21.15.155:6808/41835 32 ==== osd_op_reply(139 notify.2 [watch unwatch cookie 94358380708864] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d87200 con 0x55d185cdf000 2024-04-19T23:46:41.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.231+0000 7f061ccbba80 20 remove_watcher() i=2 2024-04-19T23:46:41.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.231+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94358380710016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4bc00 con 0x55d185cdf400 2024-04-19T23:46:41.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.232+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 <== osd.2 v2:172.21.15.155:6812/41834 24 ==== osd_op_reply(140 notify.3 [watch unwatch cookie 94358380710016] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185e56240 con 0x55d185cdf400 2024-04-19T23:46:41.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.232+0000 7f061ccbba80 20 remove_watcher() i=3 2024-04-19T23:46:41.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.232+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94358380711168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b000 con 0x55d185959800 2024-04-19T23:46:41.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.233+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.1 v2:172.21.15.155:6800/41833 59 ==== osd_op_reply(141 notify.4 [watch unwatch cookie 94358380711168] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185959800 2024-04-19T23:46:41.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.233+0000 7f061ccbba80 20 remove_watcher() i=4 2024-04-19T23:46:41.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.233+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:142 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94358380712320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4a800 con 0x55d185da4000 2024-04-19T23:46:41.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.234+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 39 ==== osd_op_reply(142 notify.5 [watch unwatch cookie 94358380712320] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.234+0000 7f061ccbba80 20 remove_watcher() i=5 2024-04-19T23:46:41.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.234+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:143 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94358380713472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185e4b400 con 0x55d185da4000 2024-04-19T23:46:41.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.235+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 40 ==== osd_op_reply(143 notify.6 [watch unwatch cookie 94358380713472] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.235+0000 7f061ccbba80 20 remove_watcher() i=6 2024-04-19T23:46:41.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.235+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:144 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94358380714624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d185959c00 con 0x55d185da4000 2024-04-19T23:46:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061b466700 1 -- 172.21.15.155:0/3054626645 <== osd.0 v2:172.21.15.76:6800/39408 41 ==== osd_op_reply(144 notify.7 [watch unwatch cookie 94358380714624] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d185d86b40 con 0x55d185da4000 2024-04-19T23:46:41.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 20 remove_watcher() i=7 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d185da4000 msgr2=0x55d185c43180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d185da4000 0x55d185c43180 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d185959800 msgr2=0x55d185c41b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d185959800 0x55d185c41b80 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d185cdf400 msgr2=0x55d185c42c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d185cdf400 0x55d185c42c00 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d185cdf000 msgr2=0x55d185c42100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d185cdf000 0x55d185c42100 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185cdec00 msgr2=0x55d185c41600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185cdec00 0x55d185c41600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55d185cedd70 tx=0x55d185ca5920 comp rx=0 tx=0).stop 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 msgr2=0x55d185c40b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 --2- 172.21.15.155:0/3054626645 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185959400 0x55d185c40b00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55d1867d5fb0 tx=0x55d185ca46c0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 reap_dead start 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061a464700 1 -- 172.21.15.155:0/3054626645 reap_dead start 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 shutdown_connections 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.236+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 >> 172.21.15.155:0/3054626645 conn(0x55d185958c00 msgr2=0x55d185a45800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 shutdown_connections 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/3054626645 wait complete. 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d185e4a400 msgr2=0x55d185e5c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55d185e4a400 0x55d185e5c580 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d185da5800 msgr2=0x55d185e5c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d185da5800 0x55d185e5c000 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d185e4b800 msgr2=0x55d185e5d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d185e4b800 0x55d185e5d080 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d185e4ac00 msgr2=0x55d185e5cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55d185e4ac00 0x55d185e5cb00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185e4a000 msgr2=0x55d185c43700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185e4a000 0x55d185c43700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55d185d40030 tx=0x55d185ca5b60 comp rx=0 tx=0).stop 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 msgr2=0x55d185c42680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x55d185d41770 tx=0x55d185ca5e60 comp rx=0 tx=0).stop 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ac65700 1 -- 172.21.15.155:0/413584289 reap_dead start 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 shutdown_connections 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 --2- 172.21.15.155:0/413584289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185da5400 0x55d185c42680 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 >> 172.21.15.155:0/413584289 conn(0x55d185da4800 msgr2=0x55d185a46000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 shutdown_connections 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/413584289 wait complete. 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/4262585685 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185cde000 msgr2=0x55d185c41080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 --2- 172.21.15.155:0/4262585685 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185cde000 0x55d185c41080 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55d1867d4f90 tx=0x55d185ca4780 comp rx=0 tx=0).stop 2024-04-19T23:46:41.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/4262585685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 msgr2=0x55d185c40580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 --2- 172.21.15.155:0/4262585685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55d186723920 tx=0x55d185a49920 comp rx=0 tx=0).stop 2024-04-19T23:46:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/4262585685 shutdown_connections 2024-04-19T23:46:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 --2- 172.21.15.155:0/4262585685 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d185cde000 0x55d185c41080 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 --2- 172.21.15.155:0/4262585685 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d185958800 0x55d185c40580 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.237+0000 7f061ccbba80 1 -- 172.21.15.155:0/4262585685 >> 172.21.15.155:0/4262585685 conn(0x55d185958400 msgr2=0x55d185a45000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.238+0000 7f061ccbba80 1 -- 172.21.15.155:0/4262585685 shutdown_connections 2024-04-19T23:46:41.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.238+0000 7f061ccbba80 1 -- 172.21.15.155:0/4262585685 wait complete. 2024-04-19T23:46:41.253 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-19T23:46:41.253 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-19T23:46:41.253 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-04-19T23:46:41.299 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:46:41.300 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:46:41.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.300+0000 7f0f586f6a80 1 Processor -- start 2024-04-19T23:46:41.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.300+0000 7f0f586f6a80 1 -- start start 2024-04-19T23:46:41.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.300+0000 7f0f586f6a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55fbdb230800 0x55fbdb518580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.300+0000 7f0f586f6a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fbdb55b500 con 0x55fbdb230c00 2024-04-19T23:46:41.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.300+0000 7f0f586f6a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fbdb2d2a00 con 0x55fbdb230800 2024-04-19T23:46:41.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.301+0000 7f0f566a0700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55fbdb230800 0x55fbdb518580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.301+0000 7f0f55e9f700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55fbdb230c00 0x55fbdb31c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:55746/0 (socket says 172.21.15.155:55746) 2024-04-19T23:46:41.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.301+0000 7f0f55e9f700 1 -- 172.21.15.155:0/2091115390 learned_addr learned my addr 172.21.15.155:0/2091115390 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:46:41.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.301+0000 7f0f566a0700 1 -- 172.21.15.155:0/2091115390 >> v1:172.21.15.76:6789/0 conn(0x55fbdb230c00 legacy=0x55fbdb31c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.301+0000 7f0f566a0700 1 -- 172.21.15.155:0/2091115390 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbdb259d40 con 0x55fbdb230800 2024-04-19T23:46:41.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.301+0000 7f0f566a0700 1 --2- 172.21.15.155:0/2091115390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x55fbdb5139e0 tx=0x55fbdb321920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20998ed600a80f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.301+0000 7f0f5569e700 1 -- 172.21.15.155:0/2091115390 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb2e94a0 con 0x55fbdb230800 2024-04-19T23:46:41.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.301+0000 7f0f5569e700 1 -- 172.21.15.155:0/2091115390 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fbdb55b800 con 0x55fbdb230800 2024-04-19T23:46:41.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.301+0000 7f0f5569e700 1 -- 172.21.15.155:0/2091115390 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb2e9600 con 0x55fbdb230800 2024-04-19T23:46:41.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.302+0000 7f0f586f6a80 1 -- 172.21.15.155:0/2091115390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 msgr2=0x55fbdb518580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.302+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/2091115390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x55fbdb5139e0 tx=0x55fbdb321920 comp rx=0 tx=0).stop 2024-04-19T23:46:41.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.302+0000 7f0f586f6a80 1 -- 172.21.15.155:0/2091115390 shutdown_connections 2024-04-19T23:46:41.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.302+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/2091115390 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.302+0000 7f0f586f6a80 1 -- 172.21.15.155:0/2091115390 >> 172.21.15.155:0/2091115390 conn(0x55fbdb230400 msgr2=0x55fbdb31c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.302+0000 7f0f586f6a80 1 -- 172.21.15.155:0/2091115390 shutdown_connections 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.302+0000 7f0f586f6a80 1 -- 172.21.15.155:0/2091115390 wait complete. 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.302+0000 7f0f586f6a80 1 Processor -- start 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.302+0000 7f0f586f6a80 1 -- start start 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.302+0000 7f0f586f6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.302+0000 7f0f586f6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb2d2500 con 0x55fbdb230800 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.303+0000 7f0f566a0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.303+0000 7f0f566a0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41154/0 (socket says 172.21.15.155:41154) 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.303+0000 7f0f566a0700 1 -- 172.21.15.155:0/2701604724 learned_addr learned my addr 172.21.15.155:0/2701604724 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.303+0000 7f0f566a0700 1 -- 172.21.15.155:0/2701604724 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbdb259ba0 con 0x55fbdb230800 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.303+0000 7f0f566a0700 1 --2- 172.21.15.155:0/2701604724 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x55fbdc009740 tx=0x55fbdb321800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a61c5dfc8864678 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.303+0000 7f0f54e9d700 1 -- 172.21.15.155:0/2701604724 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb2e9760 con 0x55fbdb230800 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.303+0000 7f0f54e9d700 1 -- 172.21.15.155:0/2701604724 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fbdb55bb00 con 0x55fbdb230800 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.303+0000 7f0f54e9d700 1 -- 172.21.15.155:0/2701604724 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb2e94a0 con 0x55fbdb230800 2024-04-19T23:46:41.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f586f6a80 1 -- 172.21.15.155:0/2701604724 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 msgr2=0x55fbdb518580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/2701604724 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x55fbdc009740 tx=0x55fbdb321800 comp rx=0 tx=0).stop 2024-04-19T23:46:41.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f586f6a80 1 -- 172.21.15.155:0/2701604724 shutdown_connections 2024-04-19T23:46:41.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/2701604724 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f586f6a80 1 -- 172.21.15.155:0/2701604724 >> 172.21.15.155:0/2701604724 conn(0x55fbdb230400 msgr2=0x55fbdb31d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f586f6a80 1 -- 172.21.15.155:0/2701604724 shutdown_connections 2024-04-19T23:46:41.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f586f6a80 1 -- 172.21.15.155:0/2701604724 wait complete. 2024-04-19T23:46:41.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f586f6a80 1 Processor -- start 2024-04-19T23:46:41.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f586f6a80 1 -- start start 2024-04-19T23:46:41.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f586f6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f586f6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb2d23c0 con 0x55fbdb230800 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f566a0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f566a0700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41156/0 (socket says 172.21.15.155:41156) 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.304+0000 7f0f566a0700 1 -- 172.21.15.155:0/881398534 learned_addr learned my addr 172.21.15.155:0/881398534 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.305+0000 7f0f566a0700 1 -- 172.21.15.155:0/881398534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbdb259a00 con 0x55fbdb230800 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.305+0000 7f0f566a0700 1 --2- 172.21.15.155:0/881398534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55fbdc0095f0 tx=0x55fbdb321920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.305+0000 7f0f5369a700 1 -- 172.21.15.155:0/881398534 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb2e9600 con 0x55fbdb230800 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.305+0000 7f0f5369a700 1 -- 172.21.15.155:0/881398534 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fbdb55bc80 con 0x55fbdb230800 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.305+0000 7f0f586f6a80 1 -- 172.21.15.155:0/881398534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbdb259860 con 0x55fbdb230800 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.305+0000 7f0f5369a700 1 -- 172.21.15.155:0/881398534 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb2e98c0 con 0x55fbdb230800 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.305+0000 7f0f586f6a80 1 -- 172.21.15.155:0/881398534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbdb2596c0 con 0x55fbdb230800 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f586f6a80 1 Processor -- start 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f586f6a80 1 -- start start 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f586f6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 0x55fbdb518b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f586f6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb26c640 con 0x55fbdb231400 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f56ea1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 0x55fbdb518b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f5369a700 1 -- 172.21.15.155:0/881398534 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55fbdbfd2b00 con 0x55fbdb230800 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f56ea1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 0x55fbdb518b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41170/0 (socket says 172.21.15.155:41170) 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3670579402 learned_addr learned my addr 172.21.15.155:0/3670579402 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f5369a700 1 --2- 172.21.15.155:0/881398534 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb5b8000 0x55fbdb519080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f5369a700 1 -- 172.21.15.155:0/881398534 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55fbdb2ab180 con 0x55fbdb230800 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3670579402 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbdb258000 con 0x55fbdb231400 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f566a0700 1 --2- 172.21.15.155:0/881398534 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb5b8000 0x55fbdb519080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.306+0000 7f0f56ea1700 1 --2- 172.21.15.155:0/3670579402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 0x55fbdb518b00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x55fbdc0c3140 tx=0x55fbdb321ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1ae612cf84a41c server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f50e95700 1 -- 172.21.15.155:0/3670579402 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb2e9600 con 0x55fbdb231400 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f566a0700 1 --2- 172.21.15.155:0/881398534 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb5b8000 0x55fbdb519080 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55fbdc0c2f60 tx=0x55fbdb57a8a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f50e95700 1 -- 172.21.15.155:0/3670579402 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fbdb2d1c80 con 0x55fbdb231400 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f50e95700 1 -- 172.21.15.155:0/3670579402 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb2e98c0 con 0x55fbdb231400 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3670579402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 msgr2=0x55fbdb518b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3670579402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 0x55fbdb518b00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x55fbdc0c3140 tx=0x55fbdb321ce0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3670579402 shutdown_connections 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3670579402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 0x55fbdb518b00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3670579402 >> 172.21.15.155:0/3670579402 conn(0x55fbdb230c00 msgr2=0x55fbdb31d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3670579402 shutdown_connections 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3670579402 wait complete. 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f586f6a80 1 Processor -- start 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f586f6a80 1 -- start start 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f586f6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 0x55fbdb518b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.307+0000 7f0f586f6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb26c8c0 con 0x55fbdb231400 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.308+0000 7f0f56ea1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 0x55fbdb518b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.308+0000 7f0f56ea1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 0x55fbdb518b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41172/0 (socket says 172.21.15.155:41172) 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.308+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 learned_addr learned my addr 172.21.15.155:0/1880188640 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.308+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbdb258ea0 con 0x55fbdb231400 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.308+0000 7f0f56ea1700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 0x55fbdb518b00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x55fbdc009ec0 tx=0x55fbdb57a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.308+0000 7f0f4f692700 1 -- 172.21.15.155:0/1880188640 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb2e9760 con 0x55fbdb231400 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.308+0000 7f0f4f692700 1 -- 172.21.15.155:0/1880188640 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fbdb2d1b00 con 0x55fbdb231400 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.308+0000 7f0f4f692700 1 -- 172.21.15.155:0/1880188640 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb2e9600 con 0x55fbdb231400 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.308+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbdb258820 con 0x55fbdb231400 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.308+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbdb2589c0 con 0x55fbdb231400 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.309+0000 7f0f4f692700 1 -- 172.21.15.155:0/1880188640 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55fbdbfd2dc0 con 0x55fbdb231400 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.309+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.309+0000 7f0f4f692700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb5b8c00 0x55fbdb519600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.309+0000 7f0f4f692700 1 -- 172.21.15.155:0/1880188640 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55fbdb2ab340 con 0x55fbdb231400 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.309+0000 7f0f55e9f700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb5b8c00 0x55fbdb519600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.309+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55fbdb231800 0x55fbdb519b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.309+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb231c00 con 0x55fbdb231800 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f56ea1700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55fbdb231800 0x55fbdb519b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f55e9f700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb5b8c00 0x55fbdb519600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55fbdb5cfd70 tx=0x55fbdb57b920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f56ea1700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55fbdb231800 0x55fbdb519b80 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f586f6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f586f6a80 20 realm 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9000 con 0x55fbdb231800 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f586f6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f586f6a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.310+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9400 con 0x55fbdb231800 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f586f6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9800 con 0x55fbdb231800 2024-04-19T23:46:41.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f586f6a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9c00 con 0x55fbdb231800 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f586f6a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f586f6a80 20 searching for the correct realm 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55fbdb5b9000 0x55fbdb51a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9400 con 0x55fbdb5b9000 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.311+0000 7f0f566a0700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55fbdb5b9000 0x55fbdb51a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.312+0000 7f0f566a0700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55fbdb5b9000 0x55fbdb51a100 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.312+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.312+0000 7f0f566a0700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55fbdb5b9400 0x55fbdb51ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.312+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678000 con 0x55fbdb5b9400 2024-04-19T23:46:41.320 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.312+0000 7f0f55e9f700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55fbdb5b9400 0x55fbdb51ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.312+0000 7f0f55e9f700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55fbdb5b9400 0x55fbdb51ac00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.313+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.313+0000 7f0f55e9f700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55fbdb678000 0x55fbdb51b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.313+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb678000 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.313+0000 7f0f56ea1700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55fbdb678000 0x55fbdb51b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.313+0000 7f0f56ea1700 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55fbdb678000 0x55fbdb51b180 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.314+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.314+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb231800 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.314+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.314+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb231800 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.314+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.314+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb231800 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.314+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.314+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb678000 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.315+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.315+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9400 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.315+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.315+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9000 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.315+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.315+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb231800 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.315+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.315+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb678000 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.316+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.316+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb231800 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.316+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.316+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9400 2024-04-19T23:46:41.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.316+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.316+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9000 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.316+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.316+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9000 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.317+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.317+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9400 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.317+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.317+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9000 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.317+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.317+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9000 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.317+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.317+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb231800 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.317+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.317+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb231800 2024-04-19T23:46:41.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.318+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.318+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb678000 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.318+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.318+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9000 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.318+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.318+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9400 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.318+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.319+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb231800 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.319+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.319+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb678000 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.319+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.319+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9000 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.319+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.319+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb678000 2024-04-19T23:46:41.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.320+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.320+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9400 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.320+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.320+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9000 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.320+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.320+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb678000 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb231800 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9400 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:46:41.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb231c00 con 0x55fbdb231800 2024-04-19T23:46:41.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678c00 con 0x55fbdb231800 2024-04-19T23:46:41.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:46:41.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.321+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679000 con 0x55fbdb5b9400 2024-04-19T23:46:41.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 20 zone default found 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 4 Realm: () 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 20 zonegroup default 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679400 con 0x55fbdb678000 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679800 con 0x55fbdb5b9000 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.322+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679c00 con 0x55fbdb5b9000 2024-04-19T23:46:41.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.323+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.323+0000 7f0f586f6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.323+0000 7f0f586f6a80 20 started sync module instance, tier type = 2024-04-19T23:46:41.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.323+0000 7f0f586f6a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:46:41.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.323+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678c00 con 0x55fbdb5b9400 2024-04-19T23:46:41.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.324+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.324+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94540204669696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb231c00 con 0x55fbdb5b9400 2024-04-19T23:46:41.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.324+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9800 con 0x55fbdb231800 2024-04-19T23:46:41.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.325+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94540204669696] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.325+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.325+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94540204670848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9c00 con 0x55fbdb231800 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.325+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb5b9000 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.327+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94540204670848] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.327+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.327+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94540204672000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679000 con 0x55fbdb5b9000 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.327+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678c00 con 0x55fbdb5b9400 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.328+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.328+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94540204672000] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.328+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540204673152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678400 con 0x55fbdb5b9400 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.328+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679800 con 0x55fbdb231800 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.329+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94540204673152] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.329+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.329+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94540204674304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679c00 con 0x55fbdb231800 2024-04-19T23:46:41.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.329+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678800 con 0x55fbdb678000 2024-04-19T23:46:41.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.330+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94540204674304] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.330+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.330+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94540204675456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679400 con 0x55fbdb678000 2024-04-19T23:46:41.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.330+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679800 con 0x55fbdb678000 2024-04-19T23:46:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.331+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.331+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94540204676608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679c00 con 0x55fbdb678000 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.331+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9800 con 0x55fbdb678000 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.331+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94540204675456] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.332+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94540204676608] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.332+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.332+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94540204677760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9c00 con 0x55fbdb678000 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.332+0000 7f0f586f6a80 20 add_watcher() i=0 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.332+0000 7f0f586f6a80 20 add_watcher() i=1 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.332+0000 7f0f586f6a80 20 add_watcher() i=2 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.332+0000 7f0f586f6a80 20 add_watcher() i=3 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.332+0000 7f0f586f6a80 20 add_watcher() i=4 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.332+0000 7f0f586f6a80 20 add_watcher() i=5 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.332+0000 7f0f586f6a80 20 add_watcher() i=6 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.333+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94540204677760] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.333+0000 7f0f586f6a80 20 add_watcher() i=7 2024-04-19T23:46:41.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.333+0000 7f0f586f6a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.333+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9800 con 0x55fbdb231800 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.334+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.334+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540206211072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9c00 con 0x55fbdb231800 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.335+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94540206211072] v32'224 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.335+0000 7f0f3d66e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.335+0000 7f0f586f6a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.335+0000 7f0f586f6a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.335+0000 7f0f586f6a80 1 Processor -- start 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.335+0000 7f0f586f6a80 1 -- start start 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.335+0000 7f0f586f6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 0x55fbdb51a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.335+0000 7f0f586f6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb2d23c0 con 0x55fbdb679400 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.336+0000 7f0f55e9f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 0x55fbdb51a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.336+0000 7f0f55e9f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 0x55fbdb51a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41174/0 (socket says 172.21.15.155:41174) 2024-04-19T23:46:41.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.336+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1199558855 learned_addr learned my addr 172.21.15.155:0/1199558855 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.336+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1199558855 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbdb258b60 con 0x55fbdb679400 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.336+0000 7f0f55e9f700 1 --2- 172.21.15.155:0/1199558855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 0x55fbdb51a680 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x55fbdb613e30 tx=0x55fbdb57bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f300f505bf764a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.336+0000 7f0f3ce6d700 1 -- 172.21.15.155:0/1199558855 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb696000 con 0x55fbdb679400 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.336+0000 7f0f3ce6d700 1 -- 172.21.15.155:0/1199558855 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fbdb69e000 con 0x55fbdb679400 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.336+0000 7f0f3ce6d700 1 -- 172.21.15.155:0/1199558855 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb696160 con 0x55fbdb679400 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.337+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1199558855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 msgr2=0x55fbdb51a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.337+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/1199558855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 0x55fbdb51a680 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x55fbdb613e30 tx=0x55fbdb57bd40 comp rx=0 tx=0).stop 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.337+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1199558855 shutdown_connections 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.337+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/1199558855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 0x55fbdb51a680 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.337+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1199558855 >> 172.21.15.155:0/1199558855 conn(0x55fbdb678800 msgr2=0x55fbdb31e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.337+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1199558855 shutdown_connections 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.337+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1199558855 wait complete. 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.337+0000 7f0f586f6a80 1 Processor -- start 2024-04-19T23:46:41.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.337+0000 7f0f586f6a80 1 -- start start 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.338+0000 7f0f586f6a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 0x55fbdb51a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.338+0000 7f0f586f6a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb2d2500 con 0x55fbdb679400 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.338+0000 7f0f55e9f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 0x55fbdb51a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.338+0000 7f0f55e9f700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 0x55fbdb51a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:41188/0 (socket says 172.21.15.155:41188) 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.338+0000 7f0f55e9f700 1 -- 172.21.15.155:0/3367526931 learned_addr learned my addr 172.21.15.155:0/3367526931 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.338+0000 7f0f55e9f700 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbdb258d00 con 0x55fbdb679400 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.338+0000 7f0f55e9f700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 0x55fbdb51a680 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x55fbdb69b290 tx=0x55fbdb57be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.338+0000 7f0f3b66a700 1 -- 172.21.15.155:0/3367526931 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb6962c0 con 0x55fbdb679400 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.338+0000 7f0f3b66a700 1 -- 172.21.15.155:0/3367526931 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fbdb69e180 con 0x55fbdb679400 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.338+0000 7f0f3b66a700 1 -- 172.21.15.155:0/3367526931 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fbdb696000 con 0x55fbdb679400 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.338+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbdb258340 con 0x55fbdb679400 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.339+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbdb258b60 con 0x55fbdb679400 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.339+0000 7f0f3b66a700 1 -- 172.21.15.155:0/3367526931 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55fbdbfd3b80 con 0x55fbdb679400 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.339+0000 7f0f3b66a700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb71e000 0x55fbdb51b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.339+0000 7f0f3b66a700 1 -- 172.21.15.155:0/3367526931 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55fbdb2ab500 con 0x55fbdb679400 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.339+0000 7f0f56ea1700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb71e000 0x55fbdb51b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.339+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55fbdb679800 0x55fbdb734000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.340+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679c00 con 0x55fbdb679800 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.340+0000 7f0f566a0700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55fbdb679800 0x55fbdb734000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.340+0000 7f0f56ea1700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb71e000 0x55fbdb51b700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55fbdb613ce0 tx=0x55fbdb57bb60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.340+0000 7f0f566a0700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55fbdb679800 0x55fbdb734000 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.341+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v32'39 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb679800 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.341+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55fbdb71e400 0x55fbdb734580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.341+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71e800 con 0x55fbdb71e400 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.341+0000 7f0f55e9f700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55fbdb71e400 0x55fbdb734580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.341+0000 7f0f55e9f700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55fbdb71e400 0x55fbdb734580 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.343+0000 7f0f55e9f700 1 -- 172.21.15.155:0/3367526931 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb71e400 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.343+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55fbdb71ec00 0x55fbdb734b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.343+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f000 con 0x55fbdb71ec00 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.343+0000 7f0f56ea1700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55fbdb71ec00 0x55fbdb734b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.343+0000 7f0f56ea1700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55fbdb71ec00 0x55fbdb734b00 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.344+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.344+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f400 con 0x55fbdb679800 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.345+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v32'225 uv163 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb679800 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.345+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55fbdb71f800 0x55fbdb735080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.345+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71fc00 con 0x55fbdb71f800 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.345+0000 7f0f566a0700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55fbdb71f800 0x55fbdb735080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.345+0000 7f0f566a0700 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55fbdb71f800 0x55fbdb735080 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.346+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v32'71 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb71f800 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.346+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746000 con 0x55fbdb71ec00 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.347+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v32'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.347+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746400 con 0x55fbdb679800 2024-04-19T23:46:41.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.348+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb679800 2024-04-19T23:46:41.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.349+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746800 con 0x55fbdb71e400 2024-04-19T23:46:41.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.350+0000 7f0f55e9f700 1 -- 172.21.15.155:0/3367526931 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v32'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb71e400 2024-04-19T23:46:41.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.350+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746c00 con 0x55fbdb71f800 2024-04-19T23:46:41.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.351+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb71f800 2024-04-19T23:46:41.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.351+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747000 con 0x55fbdb71ec00 2024-04-19T23:46:41.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.352+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.352+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747400 con 0x55fbdb71f800 2024-04-19T23:46:41.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.352+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v32'72 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb71f800 2024-04-19T23:46:41.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.352+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747800 con 0x55fbdb71e400 2024-04-19T23:46:41.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.354+0000 7f0f55e9f700 1 -- 172.21.15.155:0/3367526931 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb71e400 2024-04-19T23:46:41.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.354+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747c00 con 0x55fbdb71f800 2024-04-19T23:46:41.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.355+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb71f800 2024-04-19T23:46:41.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.355+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746800 con 0x55fbdb71e400 2024-04-19T23:46:41.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.356+0000 7f0f55e9f700 1 -- 172.21.15.155:0/3367526931 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v32'56 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb71e400 2024-04-19T23:46:41.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.356+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746400 con 0x55fbdb679800 2024-04-19T23:46:41.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.357+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v32'226 uv165 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb679800 2024-04-19T23:46:41.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.357+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71e800 con 0x55fbdb71ec00 2024-04-19T23:46:41.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.358+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v32'70 uv50 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.358+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f400 con 0x55fbdb71f800 2024-04-19T23:46:41.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.359+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v32'73 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb71f800 2024-04-19T23:46:41.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.359+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71fc00 con 0x55fbdb71ec00 2024-04-19T23:46:41.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.360+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.360+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678c00 con 0x55fbdb679800 2024-04-19T23:46:41.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.361+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb679800 2024-04-19T23:46:41.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.361+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679000 con 0x55fbdb679800 2024-04-19T23:46:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.362+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'227 uv167 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb679800 2024-04-19T23:46:41.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.362+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679c00 con 0x55fbdb71ec00 2024-04-19T23:46:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.363+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'71 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.364+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb231c00 con 0x55fbdb71f800 2024-04-19T23:46:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.364+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'37 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb71f800 2024-04-19T23:46:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.364+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f400 con 0x55fbdb71ec00 2024-04-19T23:46:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.365+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.365+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f000 con 0x55fbdb71ec00 2024-04-19T23:46:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.366+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.366+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71e800 con 0x55fbdb71ec00 2024-04-19T23:46:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.367+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'23 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.367+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71fc00 con 0x55fbdb71ec00 2024-04-19T23:46:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.368+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.368+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746c00 con 0x55fbdb71e400 2024-04-19T23:46:41.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.369+0000 7f0f55e9f700 1 -- 172.21.15.155:0/3367526931 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb71e400 2024-04-19T23:46:41.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.369+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747400 con 0x55fbdb71ec00 2024-04-19T23:46:41.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.370+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.370+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747c00 con 0x55fbdb71e400 2024-04-19T23:46:41.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.371+0000 7f0f55e9f700 1 -- 172.21.15.155:0/3367526931 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb71e400 2024-04-19T23:46:41.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.372+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746400 con 0x55fbdb71ec00 2024-04-19T23:46:41.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.373+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'72 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.373+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746000 con 0x55fbdb71e400 2024-04-19T23:46:41.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.374+0000 7f0f55e9f700 1 -- 172.21.15.155:0/3367526931 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'57 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb71e400 2024-04-19T23:46:41.375 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.374+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747000 con 0x55fbdb71f800 2024-04-19T23:46:41.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.375+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb71f800 2024-04-19T23:46:41.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.376+0000 7f0f38e65700 20 reqs_thread_entry: start 2024-04-19T23:46:41.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.376+0000 7f0f586f6a80 20 init_complete bucket index max shards: 11 2024-04-19T23:46:41.388 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.376+0000 7f0f586f6a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:46:41.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.376+0000 7f0f36e61700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:11 2024 2024-04-19T23:46:41.389 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:46:41.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.376+0000 7f0f3663f700 20 reqs_thread_entry: start 2024-04-19T23:46:41.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.376+0000 7f0f586f6a80 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-19T23:46:41.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.376+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.376+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9c00 con 0x55fbdb678000 2024-04-19T23:46:41.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.377+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.377+0000 7f0f586f6a80 20 rados_obj.operate() r=0 bl.length=346 2024-04-19T23:46:41.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.377+0000 7f0f586f6a80 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-19T23:46:41.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.377+0000 7f0f586f6a80 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-19T23:46:41.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.377+0000 7f0f586f6a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:46:41.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.377+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678c00 con 0x55fbdb678000 2024-04-19T23:46:41.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(63 fud.buckets [call out=184b] v0'0 uv5 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f586f6a80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 : miss 2024-04-19T23:46:41.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 8.13 8:cf7b2220:root::.bucket.meta.myfoo7%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747400 con 0x55fbdb678000 2024-04-19T23:46:41.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(64 .bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv10 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f586f6a80 20 rados_obj.operate() r=0 bl.length=353 2024-04-19T23:46:41.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f586f6a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 info.flags=0x17 2024-04-19T23:46:41.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f586f6a80 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 to cache LRU end 2024-04-19T23:46:41.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f586f6a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:46:41.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f586f6a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:46:41.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f586f6a80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 2024-04-19T23:46:41.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.378+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 4.3 4:c2effc23:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746400 con 0x55fbdb231800 2024-04-19T23:46:41.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.379+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(65 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.379+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 4.a 4:521545a8:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747800 con 0x55fbdb5b9400 2024-04-19T23:46:41.392 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.379+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(66 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.1 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.379+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 4.36 4:6dcc351d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746800 con 0x55fbdb231800 2024-04-19T23:46:41.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.379+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(67 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.379+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:68 4.7 4:e29dc2a8:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746c00 con 0x55fbdb678000 2024-04-19T23:46:41.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.380+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(68 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.3 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.380+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 4.a 4:536f2e69:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747c00 con 0x55fbdb5b9400 2024-04-19T23:46:41.393 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.380+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(69 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.380+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:70 4.3a 4:5d0cbb98:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746000 con 0x55fbdb5b9000 2024-04-19T23:46:41.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.380+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(70 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5 [call out=377b] v0'0 uv13 ondisk = 0) v8 ==== 194+0+377 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.380+0000 7f0f586f6a80 10 cls_bucket_list_unordered: got fourteen 2024-04-19T23:46:41.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.380+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:71 4.15 4:a8e10450:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9c00 con 0x55fbdb5b9000 2024-04-19T23:46:41.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.381+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(71 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.394 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.381+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 4.2c 4:379a141e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f400 con 0x55fbdb231800 2024-04-19T23:46:41.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.381+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(72 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.381+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:73 4.3e 4:7f3929c0:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f000 con 0x55fbdb5b9400 2024-04-19T23:46:41.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.381+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(73 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.8 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.381+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 4.18 4:18094ed1:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71e800 con 0x55fbdb5b9400 2024-04-19T23:46:41.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(74 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 4.2a 4:5412e746:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71fc00 con 0x55fbdb231800 2024-04-19T23:46:41.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(75 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f586f6a80 20 get_obj_state: rctx=0x55fbdb658cb0 obj=myfoo7:fourteen state=0x55fbdb7e61e8 s->prefetch_data=0 2024-04-19T23:46:41.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 3.1 3:8339dcc5:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679c00 con 0x55fbdb678000 2024-04-19T23:46:41.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(76 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8_fourteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+870 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f586f6a80 10 manifest: total_size = 8 2024-04-19T23:46:41.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f586f6a80 20 get_obj_state: setting s->obj_tag to 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4221.1183293290517317223 2024-04-19T23:46:41.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f586f6a80 20 get_obj_state: rctx=0x55fbdb658cb0 obj=myfoo7:fourteen state=0x55fbdb7e61e8 s->prefetch_data=0 2024-04-19T23:46:41.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f586f6a80 20 prepare_atomic_modification: state is not atomic. state=0x55fbdb7e61e8 2024-04-19T23:46:41.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f586f6a80 20 bucket index object: default.rgw.buckets.index:.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.382+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:77 4.3a 4:5d0cbb98:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ea000 con 0x55fbdb5b9000 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.384+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(77 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5 [stat,call,call] v32'14 uv14 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.384+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 3.1 3:8339dcc5:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ea400 con 0x55fbdb678000 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(78 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8_fourteen [call] v32'2 uv2 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:79 4.3a 4:5d0cbb98:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eac00 con 0x55fbdb5b9000 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 20 list_objects_ordered: starting attempt 1 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:80 4.3 4:c2effc23:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb000 con 0x55fbdb231800 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:81 4.a 4:521545a8:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb400 con 0x55fbdb5b9400 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:82 4.36 4:6dcc351d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb800 con 0x55fbdb231800 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:83 4.7 4:e29dc2a8:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ebc00 con 0x55fbdb678000 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:84 4.a 4:536f2e69:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ea000 con 0x55fbdb5b9400 2024-04-19T23:46:41.397 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:85 4.3a 4:5d0cbb98:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eac00 con 0x55fbdb5b9000 2024-04-19T23:46:41.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:86 4.15 4:a8e10450:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ea400 con 0x55fbdb5b9000 2024-04-19T23:46:41.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:87 4.2c 4:379a141e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679000 con 0x55fbdb231800 2024-04-19T23:46:41.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:88 4.3e 4:7f3929c0:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678c00 con 0x55fbdb5b9400 2024-04-19T23:46:41.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:89 4.18 4:18094ed1:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679c00 con 0x55fbdb5b9400 2024-04-19T23:46:41.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.385+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:90 4.2a 4:5412e746:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f400 con 0x55fbdb231800 2024-04-19T23:46:41.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(82 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(80 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(83 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.3 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(86 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.398 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(81 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.1 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(88 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.8 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(89 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(87 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(90 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 20 ==== osd_op_reply(84 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(79 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5 [stat,call,call] v32'15 uv15 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.386+0000 7f0f50694700 20 handle_completion(): completion ok for obj=fourteen 2024-04-19T23:46:41.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(85 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5 [call out=124b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-19T23:46:41.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8])"; uploads.size()=0; is_truncated=0 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo7[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8]) 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 20 lifecycle: rados->read ofs=0 len=0 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:91 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71fc00 con 0x55fbdb5b9400 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 21 ==== osd_op_reply(91 myfoo7 [call out=48b,stat out=16b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv42 ondisk = 0) v8 ==== 276+0+305 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 20 lifecycle: rados_obj.operate() r=0 bl.length=166 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x17 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 10 lifecycle: adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:46:41.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.387+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:92 8.13 8:cf7b2220:root::.bucket.meta.myfoo7%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746000 con 0x55fbdb678000 2024-04-19T23:46:41.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(92 .bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 [delete,create,call,call,writefull 0~353,setxattr (123)] v32'11 uv11 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f586f6a80 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 info.flags=0x17 2024-04-19T23:46:41.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f586f6a80 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 to cache LRU end 2024-04-19T23:46:41.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f586f6a80 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:46:41.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f586f6a80 10 lifecycle: distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8, ofs0, ns] 2024-04-19T23:46:41.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify cookie 94540206214528 in=739b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746400 con 0x55fbdb678000 2024-04-19T23:46:41.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== watch-notify(notify (1) cookie 94540204675456 notify 137438953510 ret 0) v3 ==== 769+0+0 (crc 0 0 0) 0x55fbdb6e9d40 con 0x55fbdb678000 2024-04-19T23:46:41.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(93 notify.5 [notify cookie 94540206214528 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f50694700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94540204675456 notifier 4829 bl.length()=727 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f50694700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 info.flags=0x17 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f50694700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 to cache LRU end 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f50694700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.389+0000 7f0f50694700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ea800 con 0x55fbdb678000 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.390+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== osd_op_reply(94 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.390+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== watch-notify(notify_complete (2) cookie 94540206214528 notify 137438953510 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fbdb617a00 con 0x55fbdb678000 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.390+0000 7f0f586f6a80 20 lifecycle: handle_bi_update(): bucket=:myfoo7[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8]): orig_sources= new_sources= 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.390+0000 7f0f586f6a80 20 lifecycle: handle_bi_update(): bucket=:myfoo7[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8]): potential sources added=[] removed=[] 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.390+0000 7f0f586f6a80 20 lifecycle: handle_bi_update(): bucket=:myfoo7[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8]): orig_dests= new_dests= 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.390+0000 7f0f586f6a80 20 lifecycle: handle_bi_update(): bucket=:myfoo7[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8]): potential dests added=[] removed=[] 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.390+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:33 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746800 con 0x55fbdb71ec00 2024-04-19T23:46:41.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.391+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(33 lc.20 [call] v32'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.391+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 6.16 6:6b0d4d95:lc::lc.20:head [call rgw.lc_rm_entry in=93b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746c00 con 0x55fbdb71ec00 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.392+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(34 lc.20 [call] v32'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.392+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:35 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9c00 con 0x55fbdb71ec00 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f56ea1700 1 -- 172.21.15.155:0/3367526931 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(35 lc.20 [call] v32'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb71ec00 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:95 4.3 4:c2effc23:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb231c00 con 0x55fbdb231800 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:96 4.a 4:521545a8:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb000 con 0x55fbdb5b9400 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:97 4.36 4:6dcc351d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb800 con 0x55fbdb231800 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:98 4.7 4:e29dc2a8:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ebc00 con 0x55fbdb678000 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:99 4.a 4:536f2e69:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ea800 con 0x55fbdb5b9400 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:100 4.3a 4:5d0cbb98:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb400 con 0x55fbdb5b9000 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:101 4.15 4:a8e10450:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ea000 con 0x55fbdb5b9000 2024-04-19T23:46:41.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:102 4.2c 4:379a141e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f400 con 0x55fbdb231800 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:103 4.3e 4:7f3929c0:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f000 con 0x55fbdb5b9400 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:104 4.18 4:18094ed1:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71e800 con 0x55fbdb5b9400 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:105 4.2a 4:5412e746:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747400 con 0x55fbdb231800 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 22 ==== osd_op_reply(96 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.1 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(95 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 23 ==== osd_op_reply(103 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.8 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(100 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5 [call out=124b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(97 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 24 ==== osd_op_reply(104 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 33 ==== osd_op_reply(102 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(101 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 25 ==== osd_op_reply(99 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 34 ==== osd_op_reply(105 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(98 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.3 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.393+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:106 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747000 con 0x55fbdb678000 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.395+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 28 ==== osd_op_reply(106 fud.buckets [call] v32'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.395+0000 7f0f586f6a80 10 cache get: name=default.rgw.meta+root+myfoo7 : hit (requested=0x11, cached=0x17) 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.395+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:107 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746000 con 0x55fbdb5b9400 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.396+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 26 ==== osd_op_reply(107 myfoo7 [call,call,delete] v32'43 uv43 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.396+0000 7f0f586f6a80 10 removing default.rgw.meta+root+myfoo7 from cache 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.396+0000 7f0f586f6a80 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.396+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [notify cookie 94540206214528 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746400 con 0x55fbdb5b9400 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.396+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 27 ==== watch-notify(notify (1) cookie 94540204673152 notify 137438953491 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x55fbdb617ba0 con 0x55fbdb5b9400 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.396+0000 7f0f50694700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94540204673152 notifier 4829 bl.length()=150 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.396+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 28 ==== osd_op_reply(108 notify.3 [notify cookie 94540206214528 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.396+0000 7f0f50694700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb678c00 con 0x55fbdb5b9400 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.396+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 29 ==== osd_op_reply(109 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.396+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 30 ==== watch-notify(notify_complete (2) cookie 94540206214528 notify 137438953491 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fbdb6161a0 con 0x55fbdb5b9400 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.396+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:110 8.13 8:cf7b2220:root::.bucket.meta.myfoo7%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747800 con 0x55fbdb678000 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.398+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 29 ==== osd_op_reply(110 .bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 [call,call,delete] v32'12 uv12 ondisk = 0) v8 ==== 291+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.398+0000 7f0f586f6a80 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 from cache 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.398+0000 7f0f586f6a80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8, ofs0, ns] 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.398+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [notify cookie 94540206214528 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747c00 con 0x55fbdb678000 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.398+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 30 ==== watch-notify(notify (1) cookie 94540204675456 notify 137438953511 ret 0) v3 ==== 249+0+0 (crc 0 0 0) 0x55fbdb617a00 con 0x55fbdb678000 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.398+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 31 ==== osd_op_reply(111 notify.5 [notify cookie 94540206214528 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.398+0000 7f0f50e95700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94540204675456 notifier 4829 bl.length()=207 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.398+0000 7f0f50e95700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb231c00 con 0x55fbdb678000 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 32 ==== osd_op_reply(112 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 33 ==== watch-notify(notify_complete (2) cookie 94540206214528 notify 137438953511 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fbdb6e84e0 con 0x55fbdb678000 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:113 4.3 4:c2effc23:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679000 con 0x55fbdb231800 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:114 4.a 4:521545a8:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f400 con 0x55fbdb5b9400 2024-04-19T23:46:41.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:115 4.36 4:6dcc351d:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71fc00 con 0x55fbdb231800 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:116 4.7 4:e29dc2a8:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71f000 con 0x55fbdb678000 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:117 4.a 4:536f2e69:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb71e800 con 0x55fbdb5b9400 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:118 4.3a 4:5d0cbb98:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb800 con 0x55fbdb5b9000 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:119 4.15 4:a8e10450:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ebc00 con 0x55fbdb5b9000 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:120 4.2c 4:379a141e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb000 con 0x55fbdb231800 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:121 4.3e 4:7f3929c0:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ea800 con 0x55fbdb5b9400 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:122 4.18 4:18094ed1:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb679c00 con 0x55fbdb5b9400 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.399+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:123 4.2a 4:5412e746:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746800 con 0x55fbdb231800 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.400+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== osd_op_reply(119 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.6 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.401+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 35 ==== osd_op_reply(120 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.7 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.401+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 36 ==== osd_op_reply(115 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.2 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.401+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 34 ==== osd_op_reply(116 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.3 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.401+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 31 ==== osd_op_reply(121 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.8 [delete] v32'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.401+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 32 ==== osd_op_reply(114 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.1 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.401+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 37 ==== osd_op_reply(113 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.0 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.401+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(118 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.5 [delete] v32'16 uv16 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.401+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 38 ==== osd_op_reply(123 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.10 [delete] v32'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.401+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 33 ==== osd_op_reply(117 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.4 [delete] v32'7 uv7 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.401+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 34 ==== osd_op_reply(122 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8.9 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.401+0000 7f0f586f6a80 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 : miss 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.402+0000 7f0f586f6a80 20 rados->read ofs=0 len=0 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.402+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:124 6.b 6:d1f1115c:::pubsub..bucket.myfoo7%2f1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746c00 con 0x55fbdb5b9000 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.402+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(124 pubsub..bucket.myfoo7/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.402+0000 7f0f586f6a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.402+0000 7f0f586f6a80 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 info.flags=0x0 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.402+0000 7f0f586f6a80 10 adding default.rgw.log++pubsub..bucket.myfoo7/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 to cache LRU end 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.402+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:125 6.b 6:d1f1115c:::pubsub..bucket.myfoo7%2f1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747400 con 0x55fbdb5b9000 2024-04-19T23:46:41.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.403+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 25 ==== osd_op_reply(125 pubsub..bucket.myfoo7/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.8 [delete] v32'28 uv21 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.403+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:126 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747000 con 0x55fbdb678000 2024-04-19T23:46:41.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.404+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 35 ==== osd_op_reply(126 fud.buckets [call] v32'7 uv7 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.404+0000 7f0f586f6a80 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-19T23:46:41.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.404+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:127 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747800 con 0x55fbdb678000 2024-04-19T23:46:41.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.405+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 36 ==== osd_op_reply(127 p5YnriCv1nAtykxBrupQ [delete] v32'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.405+0000 7f0f586f6a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-19T23:46:41.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.405+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:128 7.15 7:a93a5511:::notify.2:head [notify cookie 94540206214528 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747c00 con 0x55fbdb5b9000 2024-04-19T23:46:41.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.405+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 26 ==== watch-notify(notify (1) cookie 94540204672000 notify 137438953492 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55fbdb579d40 con 0x55fbdb5b9000 2024-04-19T23:46:41.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.405+0000 7f0f50694700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94540204672000 notifier 4829 bl.length()=170 2024-04-19T23:46:41.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.405+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 27 ==== osd_op_reply(128 notify.2 [notify cookie 94540206214528 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.405+0000 7f0f50694700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:129 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eac00 con 0x55fbdb5b9000 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.406+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 28 ==== watch-notify(notify_complete (2) cookie 94540206214528 notify 137438953492 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fbdb6e7ba0 con 0x55fbdb5b9000 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.406+0000 7f0f586f6a80 10 removing email index: 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.406+0000 7f0f586f6a80 10 removing user buckets index 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.406+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 29 ==== osd_op_reply(129 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.406+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:130 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746c00 con 0x55fbdb678000 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.407+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 37 ==== osd_op_reply(130 fud.buckets [delete] v32'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.407+0000 7f0f586f6a80 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.407+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:131 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94540206214528 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747400 con 0x55fbdb678000 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.407+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 38 ==== watch-notify(notify (1) cookie 94540204676608 notify 137438953512 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55fbdb6e84e0 con 0x55fbdb678000 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.407+0000 7f0f50e95700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953512 cookie 94540204676608 notifier 4829 bl.length()=160 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.407+0000 7f0f50e95700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:132 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9c00 con 0x55fbdb678000 2024-04-19T23:46:41.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.407+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 39 ==== osd_op_reply(131 notify.6 [notify cookie 94540206214528 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.408+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 40 ==== osd_op_reply(132 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.408+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 41 ==== watch-notify(notify_complete (2) cookie 94540206214528 notify 137438953512 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fbdb6e8680 con 0x55fbdb678000 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.408+0000 7f0f586f6a80 10 removing user index: fud 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.408+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:133 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb400 con 0x55fbdb678000 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.409+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 42 ==== osd_op_reply(133 fud [call,call,delete] v32'7 uv7 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.409+0000 7f0f586f6a80 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.409+0000 7f0f586f6a80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.409+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:134 7.3 7:c609908c:::notify.5:head [notify cookie 94540206214528 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ea000 con 0x55fbdb678000 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.409+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 43 ==== watch-notify(notify (1) cookie 94540204675456 notify 137438953513 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55fbdb6e8680 con 0x55fbdb678000 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.409+0000 7f0f50694700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94540204675456 notifier 4829 bl.length()=152 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.409+0000 7f0f50694700 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:135 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ea400 con 0x55fbdb678000 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.409+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 44 ==== osd_op_reply(134 notify.5 [notify cookie 94540206214528 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.409+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 45 ==== osd_op_reply(135 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.410+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 46 ==== watch-notify(notify_complete (2) cookie 94540206214528 notify 137438953513 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fbdb6e8820 con 0x55fbdb678000 2024-04-19T23:46:41.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.410+0000 7f0f3d66e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:46:41.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.410+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:136 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94540206211072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7ebc00 con 0x55fbdb231800 2024-04-19T23:46:41.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.411+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 39 ==== osd_op_reply(136 data_loggenerations_metadata [watch unwatch cookie 94540206211072] v32'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.411+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:137 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94540204669696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb800 con 0x55fbdb5b9400 2024-04-19T23:46:41.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.412+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 35 ==== osd_op_reply(137 notify.0 [watch unwatch cookie 94540204669696] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.412+0000 7f0f586f6a80 20 remove_watcher() i=0 2024-04-19T23:46:41.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.412+0000 7f0f586f6a80 2 removed watcher, disabling cache 2024-04-19T23:46:41.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.412+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:138 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94540204670848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb000 con 0x55fbdb231800 2024-04-19T23:46:41.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.414+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 40 ==== osd_op_reply(138 notify.1 [watch unwatch cookie 94540204670848] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.414+0000 7f0f586f6a80 20 remove_watcher() i=1 2024-04-19T23:46:41.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.414+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:139 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94540204672000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb7eb400 con 0x55fbdb5b9000 2024-04-19T23:46:41.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.415+0000 7f0f566a0700 1 -- 172.21.15.155:0/1880188640 <== osd.3 v2:172.21.15.155:6808/41835 30 ==== osd_op_reply(139 notify.2 [watch unwatch cookie 94540204672000] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb655200 con 0x55fbdb5b9000 2024-04-19T23:46:41.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.415+0000 7f0f586f6a80 20 remove_watcher() i=2 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.415+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94540204673152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb5b9c00 con 0x55fbdb5b9400 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.416+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 <== osd.2 v2:172.21.15.155:6812/41834 36 ==== osd_op_reply(140 notify.3 [watch unwatch cookie 94540204673152] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb655440 con 0x55fbdb5b9400 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.416+0000 7f0f586f6a80 20 remove_watcher() i=3 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.416+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94540204674304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746800 con 0x55fbdb231800 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.418+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.1 v2:172.21.15.155:6800/41833 41 ==== osd_op_reply(141 notify.4 [watch unwatch cookie 94540204674304] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb231800 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.418+0000 7f0f586f6a80 20 remove_watcher() i=4 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.418+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:142 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94540204675456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747000 con 0x55fbdb678000 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.419+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 47 ==== osd_op_reply(142 notify.5 [watch unwatch cookie 94540204675456] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.419+0000 7f0f586f6a80 20 remove_watcher() i=5 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.419+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:143 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94540204676608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb747800 con 0x55fbdb678000 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.420+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 48 ==== osd_op_reply(143 notify.6 [watch unwatch cookie 94540204676608] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.420+0000 7f0f586f6a80 20 remove_watcher() i=6 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.420+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:144 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94540204677760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55fbdb746c00 con 0x55fbdb678000 2024-04-19T23:46:41.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.421+0000 7f0f56ea1700 1 -- 172.21.15.155:0/1880188640 <== osd.0 v2:172.21.15.76:6800/39408 49 ==== osd_op_reply(144 notify.7 [watch unwatch cookie 94540204677760] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fbdb654b40 con 0x55fbdb678000 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.421+0000 7f0f586f6a80 20 remove_watcher() i=7 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.421+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55fbdb678000 msgr2=0x55fbdb51b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55fbdb678000 0x55fbdb51b180 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55fbdb231800 msgr2=0x55fbdb519b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55fbdb231800 0x55fbdb519b80 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55fbdb5b9400 msgr2=0x55fbdb51ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55fbdb5b9400 0x55fbdb51ac00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55fbdb5b9000 msgr2=0x55fbdb51a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55fbdb5b9000 0x55fbdb51a100 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb5b8c00 msgr2=0x55fbdb519600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb5b8c00 0x55fbdb519600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55fbdb5cfd70 tx=0x55fbdb57b920 comp rx=0 tx=0).stop 2024-04-19T23:46:41.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 msgr2=0x55fbdb518b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/1880188640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb231400 0x55fbdb518b00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x55fbdc009ec0 tx=0x55fbdb57a780 comp rx=0 tx=0).stop 2024-04-19T23:46:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 reap_dead start 2024-04-19T23:46:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 shutdown_connections 2024-04-19T23:46:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 >> 172.21.15.155:0/1880188640 conn(0x55fbdb230c00 msgr2=0x55fbdb31d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f55e9f700 1 -- 172.21.15.155:0/1880188640 reap_dead start 2024-04-19T23:46:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 shutdown_connections 2024-04-19T23:46:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/1880188640 wait complete. 2024-04-19T23:46:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55fbdb71e400 msgr2=0x55fbdb734580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55fbdb71e400 0x55fbdb734580 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55fbdb679800 msgr2=0x55fbdb734000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55fbdb679800 0x55fbdb734000 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55fbdb71f800 msgr2=0x55fbdb735080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55fbdb71f800 0x55fbdb735080 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55fbdb71ec00 msgr2=0x55fbdb734b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55fbdb71ec00 0x55fbdb734b00 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb71e000 msgr2=0x55fbdb51b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb71e000 0x55fbdb51b700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55fbdb613ce0 tx=0x55fbdb57bb60 comp rx=0 tx=0).stop 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 msgr2=0x55fbdb51a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/3367526931 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb679400 0x55fbdb51a680 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x55fbdb69b290 tx=0x55fbdb57be60 comp rx=0 tx=0).stop 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f566a0700 1 -- 172.21.15.155:0/3367526931 reap_dead start 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 shutdown_connections 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 >> 172.21.15.155:0/3367526931 conn(0x55fbdb678800 msgr2=0x55fbdb31e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 shutdown_connections 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.422+0000 7f0f586f6a80 1 -- 172.21.15.155:0/3367526931 wait complete. 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.423+0000 7f0f586f6a80 1 -- 172.21.15.155:0/881398534 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb5b8000 msgr2=0x55fbdb519080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.423+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/881398534 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb5b8000 0x55fbdb519080 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55fbdc0c2f60 tx=0x55fbdb57a8a0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.423+0000 7f0f586f6a80 1 -- 172.21.15.155:0/881398534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 msgr2=0x55fbdb518580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:46:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.423+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/881398534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55fbdc0095f0 tx=0x55fbdb321920 comp rx=0 tx=0).stop 2024-04-19T23:46:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.423+0000 7f0f586f6a80 1 -- 172.21.15.155:0/881398534 shutdown_connections 2024-04-19T23:46:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.423+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/881398534 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55fbdb5b8000 0x55fbdb519080 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.423+0000 7f0f586f6a80 1 --2- 172.21.15.155:0/881398534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55fbdb230800 0x55fbdb518580 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:46:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.423+0000 7f0f586f6a80 1 -- 172.21.15.155:0/881398534 >> 172.21.15.155:0/881398534 conn(0x55fbdb230400 msgr2=0x55fbdb31d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:46:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.423+0000 7f0f586f6a80 1 -- 172.21.15.155:0/881398534 shutdown_connections 2024-04-19T23:46:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:46:41.423+0000 7f0f586f6a80 1 -- 172.21.15.155:0/881398534 wait complete. 2024-04-19T23:47:21.438 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-04-19T23:47:21.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-04-19T23:47:21.439 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-04-19T23:47:21.493 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:47:21.493 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:47:21.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.493+0000 7f89e2cdba80 1 Processor -- start 2024-04-19T23:47:21.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.493+0000 7f89e2cdba80 1 -- start start 2024-04-19T23:47:21.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.494+0000 7f89e2cdba80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56088bff4c00 0x56088c2dc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.494+0000 7f89e2cdba80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56088c31f500 con 0x56088bff4800 2024-04-19T23:47:21.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.494+0000 7f89e2cdba80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x56088c096a00 con 0x56088bff4c00 2024-04-19T23:47:21.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.494+0000 7f89e0484700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56088bff4c00 0x56088c2dc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.494+0000 7f89e0484700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56088bff4c00 0x56088c2dc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38280/0 (socket says 172.21.15.155:38280) 2024-04-19T23:47:21.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.494+0000 7f89e0484700 1 -- 172.21.15.155:0/3220040016 learned_addr learned my addr 172.21.15.155:0/3220040016 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.494+0000 7f89e0484700 1 -- 172.21.15.155:0/3220040016 >> v1:172.21.15.76:6789/0 conn(0x56088bff4800 legacy=0x56088c0e0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.494+0000 7f89e0484700 1 -- 172.21.15.155:0/3220040016 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56088c01dd40 con 0x56088bff4c00 2024-04-19T23:47:21.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.495+0000 7f89e0484700 1 --2- 172.21.15.155:0/3220040016 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4c00 0x56088c2dc580 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x56088c2d7890 tx=0x56088c0e5920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6506d985b753f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.495+0000 7f89dfc83700 1 -- 172.21.15.155:0/3220040016 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c0ad4a0 con 0x56088bff4c00 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.495+0000 7f89dfc83700 1 -- 172.21.15.155:0/3220040016 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56088c31f800 con 0x56088bff4c00 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.495+0000 7f89dfc83700 1 -- 172.21.15.155:0/3220040016 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c0ad600 con 0x56088bff4c00 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.495+0000 7f89e2cdba80 1 -- 172.21.15.155:0/3220040016 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4c00 msgr2=0x56088c2dc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.495+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/3220040016 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4c00 0x56088c2dc580 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x56088c2d7890 tx=0x56088c0e5920 comp rx=0 tx=0).stop 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.495+0000 7f89e2cdba80 1 -- 172.21.15.155:0/3220040016 shutdown_connections 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.495+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/3220040016 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4c00 0x56088c2dc580 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.495+0000 7f89e2cdba80 1 -- 172.21.15.155:0/3220040016 >> 172.21.15.155:0/3220040016 conn(0x56088bff4400 msgr2=0x56088c0e0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.495+0000 7f89e2cdba80 1 -- 172.21.15.155:0/3220040016 shutdown_connections 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.495+0000 7f89e2cdba80 1 -- 172.21.15.155:0/3220040016 wait complete. 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.496+0000 7f89e2cdba80 1 Processor -- start 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.496+0000 7f89e2cdba80 1 -- start start 2024-04-19T23:47:21.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.496+0000 7f89e2cdba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.496+0000 7f89e2cdba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56088c096500 con 0x56088bff4800 2024-04-19T23:47:21.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.497+0000 7f89e0c85700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.497+0000 7f89e0c85700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38284/0 (socket says 172.21.15.155:38284) 2024-04-19T23:47:21.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.497+0000 7f89e0c85700 1 -- 172.21.15.155:0/3657843433 learned_addr learned my addr 172.21.15.155:0/3657843433 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.497+0000 7f89e0c85700 1 -- 172.21.15.155:0/3657843433 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56088c01dba0 con 0x56088bff4800 2024-04-19T23:47:21.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.497+0000 7f89e0c85700 1 --2- 172.21.15.155:0/3657843433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x56088cdbf860 tx=0x56088c0e5b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667de5018c95a84f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.497+0000 7f89df482700 1 -- 172.21.15.155:0/3657843433 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c0ad4a0 con 0x56088bff4800 2024-04-19T23:47:21.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.497+0000 7f89df482700 1 -- 172.21.15.155:0/3657843433 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56088c31fb00 con 0x56088bff4800 2024-04-19T23:47:21.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.497+0000 7f89df482700 1 -- 172.21.15.155:0/3657843433 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c0ad600 con 0x56088bff4800 2024-04-19T23:47:21.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e2cdba80 1 -- 172.21.15.155:0/3657843433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 msgr2=0x56088c2dc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/3657843433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x56088cdbf860 tx=0x56088c0e5b60 comp rx=0 tx=0).stop 2024-04-19T23:47:21.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e2cdba80 1 -- 172.21.15.155:0/3657843433 shutdown_connections 2024-04-19T23:47:21.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/3657843433 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e2cdba80 1 -- 172.21.15.155:0/3657843433 >> 172.21.15.155:0/3657843433 conn(0x56088bff4400 msgr2=0x56088c0e1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e2cdba80 1 -- 172.21.15.155:0/3657843433 shutdown_connections 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e2cdba80 1 -- 172.21.15.155:0/3657843433 wait complete. 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e2cdba80 1 Processor -- start 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e2cdba80 1 -- start start 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e2cdba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e2cdba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56088c0963c0 con 0x56088bff4800 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e0c85700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e0c85700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38292/0 (socket says 172.21.15.155:38292) 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.498+0000 7f89e0c85700 1 -- 172.21.15.155:0/471889762 learned_addr learned my addr 172.21.15.155:0/471889762 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.499+0000 7f89e0c85700 1 -- 172.21.15.155:0/471889762 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56088c01da00 con 0x56088bff4800 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.499+0000 7f89e0c85700 1 --2- 172.21.15.155:0/471889762 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x56088cdbf8c0 tx=0x56088c0e5a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.499+0000 7f89ddc7f700 1 -- 172.21.15.155:0/471889762 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c0ad8c0 con 0x56088bff4800 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.499+0000 7f89ddc7f700 1 -- 172.21.15.155:0/471889762 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56088c095c80 con 0x56088bff4800 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.499+0000 7f89e2cdba80 1 -- 172.21.15.155:0/471889762 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56088c01d860 con 0x56088bff4800 2024-04-19T23:47:21.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.499+0000 7f89ddc7f700 1 -- 172.21.15.155:0/471889762 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c0ad4a0 con 0x56088bff4800 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.499+0000 7f89e2cdba80 1 -- 172.21.15.155:0/471889762 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56088c01d6c0 con 0x56088bff4800 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.500+0000 7f89e2cdba80 1 Processor -- start 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.500+0000 7f89e2cdba80 1 -- start start 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.500+0000 7f89ddc7f700 1 -- 172.21.15.155:0/471889762 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56088cd96b00 con 0x56088bff4800 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.500+0000 7f89e2cdba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 0x56088c2dcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.500+0000 7f89e2cdba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56088c030640 con 0x56088bff5400 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.500+0000 7f89ddc7f700 1 --2- 172.21.15.155:0/471889762 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c37a000 0x56088c2dd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.500+0000 7f89ddc7f700 1 -- 172.21.15.155:0/471889762 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x56088c06f180 con 0x56088bff4800 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.500+0000 7f89e1486700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 0x56088c2dcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.500+0000 7f89e1486700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 0x56088c2dcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38304/0 (socket says 172.21.15.155:38304) 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.500+0000 7f89e1486700 1 -- 172.21.15.155:0/788792855 learned_addr learned my addr 172.21.15.155:0/788792855 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.500+0000 7f89e0c85700 1 --2- 172.21.15.155:0/471889762 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c37a000 0x56088c2dd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89e1486700 1 -- 172.21.15.155:0/788792855 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56088c01c000 con 0x56088bff5400 2024-04-19T23:47:21.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89e0c85700 1 --2- 172.21.15.155:0/471889762 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c37a000 0x56088c2dd080 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x56088ce72bd0 tx=0x56088c340240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89e1486700 1 --2- 172.21.15.155:0/788792855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 0x56088c2dcb00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x56088ce72420 tx=0x56088c340d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf42ad0707dc32e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89db47a700 1 -- 172.21.15.155:0/788792855 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c0ad8c0 con 0x56088bff5400 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89db47a700 1 -- 172.21.15.155:0/788792855 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56088c31e300 con 0x56088bff5400 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89db47a700 1 -- 172.21.15.155:0/788792855 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c0ad4a0 con 0x56088bff5400 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89e2cdba80 1 -- 172.21.15.155:0/788792855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 msgr2=0x56088c2dcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/788792855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 0x56088c2dcb00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x56088ce72420 tx=0x56088c340d20 comp rx=0 tx=0).stop 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89e2cdba80 1 -- 172.21.15.155:0/788792855 shutdown_connections 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/788792855 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 0x56088c2dcb00 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89e2cdba80 1 -- 172.21.15.155:0/788792855 >> 172.21.15.155:0/788792855 conn(0x56088bff4c00 msgr2=0x56088c0e1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89e2cdba80 1 -- 172.21.15.155:0/788792855 shutdown_connections 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.501+0000 7f89e2cdba80 1 -- 172.21.15.155:0/788792855 wait complete. 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.502+0000 7f89e2cdba80 1 Processor -- start 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.502+0000 7f89e2cdba80 1 -- start start 2024-04-19T23:47:21.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.502+0000 7f89e2cdba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 0x56088c2dcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.502+0000 7f89e2cdba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56088c0308c0 con 0x56088bff5400 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.502+0000 7f89e1486700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 0x56088c2dcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.502+0000 7f89e1486700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 0x56088c2dcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38308/0 (socket says 172.21.15.155:38308) 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.502+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 learned_addr learned my addr 172.21.15.155:0/1699436755 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.503+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56088c01cea0 con 0x56088bff5400 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.503+0000 7f89e1486700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 0x56088c2dcb00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x56088ce724b0 tx=0x56088c340a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.503+0000 7f89d9c77700 1 -- 172.21.15.155:0/1699436755 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c0adb80 con 0x56088bff5400 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.503+0000 7f89d9c77700 1 -- 172.21.15.155:0/1699436755 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56088c095c80 con 0x56088bff5400 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.503+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56088c01c820 con 0x56088bff5400 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.503+0000 7f89d9c77700 1 -- 172.21.15.155:0/1699436755 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c0ad8c0 con 0x56088bff5400 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.503+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56088c01c9c0 con 0x56088bff5400 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.504+0000 7f89d9c77700 1 -- 172.21.15.155:0/1699436755 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56088cd96dc0 con 0x56088bff5400 2024-04-19T23:47:21.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.504+0000 7f89d9c77700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c37ac00 0x56088c2dd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.504+0000 7f89d9c77700 1 -- 172.21.15.155:0/1699436755 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x56088c06f340 con 0x56088bff5400 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.504+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.504+0000 7f89e0484700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c37ac00 0x56088c2dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.504+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56088bff5800 0x56088c2ddb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.504+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088bff5c00 con 0x56088bff5800 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.504+0000 7f89e1486700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56088bff5800 0x56088c2ddb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e0484700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c37ac00 0x56088c2dd600 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56088c2d7890 tx=0x56088c0e5800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e1486700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56088bff5800 0x56088c2ddb80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e2cdba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e2cdba80 20 realm 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c37b000 con 0x56088bff5800 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e2cdba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e2cdba80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.505+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c37b400 con 0x56088bff5800 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e2cdba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c37b800 con 0x56088bff5800 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e2cdba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c37bc00 con 0x56088bff5800 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e2cdba80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:47:21.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e2cdba80 20 searching for the correct realm 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56088c37b000 0x56088c2de100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.506+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c37b400 con 0x56088c37b000 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.507+0000 7f89e0c85700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56088c37b000 0x56088c2de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.507+0000 7f89e0c85700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56088c37b000 0x56088c2de100 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.507+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.507+0000 7f89e0c85700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56088c37b400 0x56088c2dec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.507+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e000 con 0x56088c37b400 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.507+0000 7f89e0484700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56088c37b400 0x56088c2dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.508+0000 7f89e0484700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56088c37b400 0x56088c2dec00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.508+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.508+0000 7f89e0484700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56088c43e000 0x56088c2df180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.508+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c43e000 2024-04-19T23:47:21.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.508+0000 7f89e1486700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56088c43e000 0x56088c2df180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.508+0000 7f89e1486700 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56088c43e000 0x56088c2df180 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.509+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.509+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088bff5800 2024-04-19T23:47:21.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.509+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.509+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088bff5800 2024-04-19T23:47:21.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.509+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.509+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088bff5800 2024-04-19T23:47:21.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.510+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.510+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c43e000 2024-04-19T23:47:21.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.510+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.510+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b400 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.510+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.510+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b000 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.510+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.510+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088bff5800 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.511+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.511+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c43e000 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.511+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.511+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088bff5800 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.511+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.511+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b400 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.511+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.511+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b000 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.512+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.512+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b000 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.512+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.512+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b400 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.512+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.512+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b000 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.512+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.512+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b000 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.513+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.513+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088bff5800 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.513+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.513+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088bff5800 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.513+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.513+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c43e000 2024-04-19T23:47:21.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.514+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.514+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b000 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.514+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.514+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b400 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.514+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.514+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088bff5800 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.514+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.514+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c43e000 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.515+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.515+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b000 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.515+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.515+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c43e000 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.515+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.515+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b400 2024-04-19T23:47:21.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.515+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.515+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b000 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.516+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.516+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c43e000 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.516+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.516+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088bff5800 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.516+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.516+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b400 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088bff5c00 con 0x56088bff5800 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43ec00 con 0x56088bff5800 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43f000 con 0x56088c37b400 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 zone default found 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 4 Realm: () 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:47:21.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 zonegroup default 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.517+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43f400 con 0x56088c43e000 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e2cdba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43f800 con 0x56088c37b000 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e2cdba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43fc00 con 0x56088c37b000 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e2cdba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e2cdba80 20 started sync module instance, tier type = 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e2cdba80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:47:21.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.518+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43ec00 con 0x56088c37b400 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.519+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.520+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94594711501568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088bff5c00 con 0x56088c37b400 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.520+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c37b800 con 0x56088bff5800 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.521+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94594711501568] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.521+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.521+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94594711502720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c37bc00 con 0x56088bff5800 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.521+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c37b000 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.522+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94594711502720] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.523+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.523+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94594711503872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43f000 con 0x56088c37b000 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.523+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43ec00 con 0x56088c37b400 2024-04-19T23:47:21.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.524+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.524+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94594711505024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e400 con 0x56088c37b400 2024-04-19T23:47:21.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.524+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94594711503872] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.524+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43f800 con 0x56088bff5800 2024-04-19T23:47:21.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.525+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94594711505024] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.525+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.525+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94594711506176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43fc00 con 0x56088bff5800 2024-04-19T23:47:21.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.525+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43e800 con 0x56088c43e000 2024-04-19T23:47:21.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.526+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94594711506176] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.527+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.527+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94594711507328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43f400 con 0x56088c43e000 2024-04-19T23:47:21.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.527+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43f800 con 0x56088c43e000 2024-04-19T23:47:21.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.529+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94594711507328] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.529+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.529+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94594711508480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43fc00 con 0x56088c43e000 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.529+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c37b800 con 0x56088c43e000 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.531+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94594711508480] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.531+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.531+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94594711509632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c37bc00 con 0x56088c43e000 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.531+0000 7f89e2cdba80 20 add_watcher() i=0 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.531+0000 7f89e2cdba80 20 add_watcher() i=1 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.531+0000 7f89e2cdba80 20 add_watcher() i=2 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.531+0000 7f89e2cdba80 20 add_watcher() i=3 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.531+0000 7f89e2cdba80 20 add_watcher() i=4 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.531+0000 7f89e2cdba80 20 add_watcher() i=5 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.531+0000 7f89e2cdba80 20 add_watcher() i=6 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.532+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94594711509632] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.532+0000 7f89e2cdba80 20 add_watcher() i=7 2024-04-19T23:47:21.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.532+0000 7f89e2cdba80 2 all 8 watchers are set, enabling cache 2024-04-19T23:47:21.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.532+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c37b800 con 0x56088bff5800 2024-04-19T23:47:21.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.532+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.532+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94594713051136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c37bc00 con 0x56088bff5800 2024-04-19T23:47:21.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.534+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94594713051136] v32'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.534+0000 7f89c7c53700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:47:21.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.534+0000 7f89e2cdba80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:47:21.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.534+0000 7f89e2cdba80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:47:21.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.534+0000 7f89e2cdba80 1 Processor -- start 2024-04-19T23:47:21.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.534+0000 7f89e2cdba80 1 -- start start 2024-04-19T23:47:21.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.534+0000 7f89e2cdba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.534+0000 7f89e2cdba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56088c0963c0 con 0x56088c43f400 2024-04-19T23:47:21.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.534+0000 7f89e0484700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.534+0000 7f89e0484700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38314/0 (socket says 172.21.15.155:38314) 2024-04-19T23:47:21.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.534+0000 7f89e0484700 1 -- 172.21.15.155:0/1122316818 learned_addr learned my addr 172.21.15.155:0/1122316818 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.535+0000 7f89e0484700 1 -- 172.21.15.155:0/1122316818 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56088c01cb60 con 0x56088c43f400 2024-04-19T23:47:21.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.535+0000 7f89e0484700 1 --2- 172.21.15.155:0/1122316818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x56088c452600 tx=0x56088c341da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d50d3c6d5d85ff server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.535+0000 7f89c7452700 1 -- 172.21.15.155:0/1122316818 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c0ad760 con 0x56088c43f400 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.535+0000 7f89c7452700 1 -- 172.21.15.155:0/1122316818 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56088c466000 con 0x56088c43f400 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.535+0000 7f89c7452700 1 -- 172.21.15.155:0/1122316818 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c468000 con 0x56088c43f400 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.536+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1122316818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 msgr2=0x56088c2de680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.536+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1122316818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x56088c452600 tx=0x56088c341da0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.536+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1122316818 shutdown_connections 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.536+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1122316818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.536+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1122316818 >> 172.21.15.155:0/1122316818 conn(0x56088c43e800 msgr2=0x56088c0e2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.536+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1122316818 shutdown_connections 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.536+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1122316818 wait complete. 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.536+0000 7f89e2cdba80 1 Processor -- start 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.536+0000 7f89e2cdba80 1 -- start start 2024-04-19T23:47:21.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.536+0000 7f89e2cdba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.536+0000 7f89e2cdba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56088c096500 con 0x56088c43f400 2024-04-19T23:47:21.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.537+0000 7f89e0484700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.537+0000 7f89e0484700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38316/0 (socket says 172.21.15.155:38316) 2024-04-19T23:47:21.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.537+0000 7f89e0484700 1 -- 172.21.15.155:0/1198587781 learned_addr learned my addr 172.21.15.155:0/1198587781 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.537+0000 7f89e0484700 1 -- 172.21.15.155:0/1198587781 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56088c01cd00 con 0x56088c43f400 2024-04-19T23:47:21.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.537+0000 7f89e0484700 1 --2- 172.21.15.155:0/1198587781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x56088c4532c0 tx=0x56088c0e5980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.537+0000 7f89c5c4f700 1 -- 172.21.15.155:0/1198587781 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c468160 con 0x56088c43f400 2024-04-19T23:47:21.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.537+0000 7f89c5c4f700 1 -- 172.21.15.155:0/1198587781 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56088c466180 con 0x56088c43f400 2024-04-19T23:47:21.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.537+0000 7f89c5c4f700 1 -- 172.21.15.155:0/1198587781 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56088c4682c0 con 0x56088c43f400 2024-04-19T23:47:21.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.537+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1198587781 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56088c01c340 con 0x56088c43f400 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.537+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1198587781 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56088c01cb60 con 0x56088c43f400 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.538+0000 7f89c5c4f700 1 -- 172.21.15.155:0/1198587781 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x56088cd97b80 con 0x56088c43f400 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.538+0000 7f89c5c4f700 1 --2- 172.21.15.155:0/1198587781 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c4e2000 0x56088c2df700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.538+0000 7f89c5c4f700 1 -- 172.21.15.155:0/1198587781 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x56088c06f500 con 0x56088c43f400 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.538+0000 7f89e1486700 1 --2- 172.21.15.155:0/1198587781 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c4e2000 0x56088c2df700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.538+0000 7f89e2cdba80 5 note: GC not initialized 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.539+0000 7f89e1486700 1 --2- 172.21.15.155:0/1198587781 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c4e2000 0x56088c2df700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56088c3e5dd0 tx=0x56088c341bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.539+0000 7f89c344a700 20 reqs_thread_entry: start 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89e2cdba80 20 init_complete bucket index max shards: 11 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89e2cdba80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89c1446700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:51 2024 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89c0c24700 20 reqs_thread_entry: start 2024-04-19T23:47:21.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89e2cdba80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:47:21.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89e2cdba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c43fc00 con 0x56088bff5800 2024-04-19T23:47:21.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89e2cdba80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:47:21.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89e2cdba80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:47:21.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89e2cdba80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:47:21.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89e2cdba80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:47:21.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.540+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c4e2400 con 0x56088c43e000 2024-04-19T23:47:21.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.542+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(63 usage.10 [call] v32'32 uv32 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.542+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c4e2800 con 0x56088c43e000 2024-04-19T23:47:21.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.543+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(64 usage.10 [call] v32'33 uv32 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.543+0000 7f89c7c53700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:47:21.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.543+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94594713051136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c4e2c00 con 0x56088bff5800 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.545+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94594713051136] v32'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.545+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94594711501568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c4e3000 con 0x56088c37b400 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.546+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94594711501568] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.546+0000 7f89e2cdba80 20 remove_watcher() i=0 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.546+0000 7f89e2cdba80 2 removed watcher, disabling cache 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.546+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94594711502720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c4e3400 con 0x56088bff5800 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.547+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94594711502720] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.547+0000 7f89e2cdba80 20 remove_watcher() i=1 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.547+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94594711503872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c4e3800 con 0x56088c37b000 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.548+0000 7f89e0c85700 1 -- 172.21.15.155:0/1699436755 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94594711503872] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c437200 con 0x56088c37b000 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.548+0000 7f89e2cdba80 20 remove_watcher() i=2 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.548+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94594711505024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c4e3c00 con 0x56088c37b400 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.549+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94594711505024] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c437440 con 0x56088c37b400 2024-04-19T23:47:21.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.549+0000 7f89e2cdba80 20 remove_watcher() i=3 2024-04-19T23:47:21.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.549+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94594711506176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c4e3000 con 0x56088bff5800 2024-04-19T23:47:21.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.550+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94594711506176] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088bff5800 2024-04-19T23:47:21.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.550+0000 7f89e2cdba80 20 remove_watcher() i=4 2024-04-19T23:47:21.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.550+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94594711507328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c4e3c00 con 0x56088c43e000 2024-04-19T23:47:21.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.552+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94594711507328] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.552+0000 7f89e2cdba80 20 remove_watcher() i=5 2024-04-19T23:47:21.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.552+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94594711508480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c4e2400 con 0x56088c43e000 2024-04-19T23:47:21.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.553+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94594711508480] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.553+0000 7f89e2cdba80 20 remove_watcher() i=6 2024-04-19T23:47:21.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.553+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94594711509632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56088c4e2800 con 0x56088c43e000 2024-04-19T23:47:21.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e1486700 1 -- 172.21.15.155:0/1699436755 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94594711509632] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56088c436b40 con 0x56088c43e000 2024-04-19T23:47:21.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 20 remove_watcher() i=7 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56088c43e000 msgr2=0x56088c2df180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x56088c43e000 0x56088c2df180 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56088bff5800 msgr2=0x56088c2ddb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56088bff5800 0x56088c2ddb80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56088c37b400 msgr2=0x56088c2dec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x56088c37b400 0x56088c2dec00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56088c37b000 msgr2=0x56088c2de100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x56088c37b000 0x56088c2de100 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c37ac00 msgr2=0x56088c2dd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c37ac00 0x56088c2dd600 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56088c2d7890 tx=0x56088c0e5800 comp rx=0 tx=0).stop 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 msgr2=0x56088c2dcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1699436755 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff5400 0x56088c2dcb00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x56088ce724b0 tx=0x56088c340a20 comp rx=0 tx=0).stop 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 reap_dead start 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e0484700 1 -- 172.21.15.155:0/1699436755 reap_dead start 2024-04-19T23:47:21.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 shutdown_connections 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 >> 172.21.15.155:0/1699436755 conn(0x56088bff4c00 msgr2=0x56088c0e1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 shutdown_connections 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.554+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1699436755 wait complete. 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1198587781 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c4e2000 msgr2=0x56088c2df700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1198587781 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c4e2000 0x56088c2df700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56088c3e5dd0 tx=0x56088c341bc0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1198587781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 msgr2=0x56088c2de680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1198587781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x56088c4532c0 tx=0x56088c0e5980 comp rx=0 tx=0).stop 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1198587781 shutdown_connections 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1198587781 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c4e2000 0x56088c2df700 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/1198587781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088c43f400 0x56088c2de680 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1198587781 >> 172.21.15.155:0/1198587781 conn(0x56088c43e800 msgr2=0x56088c0e2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1198587781 shutdown_connections 2024-04-19T23:47:21.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/1198587781 wait complete. 2024-04-19T23:47:21.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/471889762 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c37a000 msgr2=0x56088c2dd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/471889762 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c37a000 0x56088c2dd080 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x56088ce72bd0 tx=0x56088c340240 comp rx=0 tx=0).stop 2024-04-19T23:47:21.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/471889762 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 msgr2=0x56088c2dc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/471889762 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x56088cdbf8c0 tx=0x56088c0e5a40 comp rx=0 tx=0).stop 2024-04-19T23:47:21.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/471889762 shutdown_connections 2024-04-19T23:47:21.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/471889762 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56088c37a000 0x56088c2dd080 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 --2- 172.21.15.155:0/471889762 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56088bff4800 0x56088c2dc580 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/471889762 >> 172.21.15.155:0/471889762 conn(0x56088bff4400 msgr2=0x56088c0e1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/471889762 shutdown_connections 2024-04-19T23:47:21.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.555+0000 7f89e2cdba80 1 -- 172.21.15.155:0/471889762 wait complete. 2024-04-19T23:47:21.560 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-19T23:47:21.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-19T23:47:21.561 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-19T23:47:21.607 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:47:21.607 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:47:21.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.607+0000 7f978d6e0a80 1 Processor -- start 2024-04-19T23:47:21.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.607+0000 7f978d6e0a80 1 -- start start 2024-04-19T23:47:21.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.607+0000 7f978d6e0a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5557b9c56c00 0x5557b9f3e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.607+0000 7f978d6e0a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5557b9f81500 con 0x5557b9c56800 2024-04-19T23:47:21.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.607+0000 7f978d6e0a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5557b9cf8a00 con 0x5557b9c56c00 2024-04-19T23:47:21.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.608+0000 7f978ae89700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5557b9c56c00 0x5557b9f3e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.608+0000 7f978b68a700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5557b9c56800 0x5557b9d42800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:47654/0 (socket says 172.21.15.155:47654) 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.608+0000 7f978b68a700 1 -- 172.21.15.155:0/1175521940 learned_addr learned my addr 172.21.15.155:0/1175521940 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.608+0000 7f978ae89700 1 -- 172.21.15.155:0/1175521940 >> v1:172.21.15.76:6789/0 conn(0x5557b9c56800 legacy=0x5557b9d42800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.608+0000 7f978ae89700 1 -- 172.21.15.155:0/1175521940 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557b9c7fd40 con 0x5557b9c56c00 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.608+0000 7f978ae89700 1 --2- 172.21.15.155:0/1175521940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56c00 0x5557b9f3e580 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x5557b9f39890 tx=0x5557b9d47920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47cac69f847e18f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.608+0000 7f978a688700 1 -- 172.21.15.155:0/1175521940 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557b9d0f4a0 con 0x5557b9c56c00 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.609+0000 7f978a688700 1 -- 172.21.15.155:0/1175521940 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557b9f81800 con 0x5557b9c56c00 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.609+0000 7f978a688700 1 -- 172.21.15.155:0/1175521940 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557b9d0f600 con 0x5557b9c56c00 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.609+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1175521940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56c00 msgr2=0x5557b9f3e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.609+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1175521940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56c00 0x5557b9f3e580 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x5557b9f39890 tx=0x5557b9d47920 comp rx=0 tx=0).stop 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.609+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1175521940 shutdown_connections 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.609+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1175521940 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56c00 0x5557b9f3e580 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.609+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1175521940 >> 172.21.15.155:0/1175521940 conn(0x5557b9c56400 msgr2=0x5557b9d42000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.609+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1175521940 shutdown_connections 2024-04-19T23:47:21.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.609+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1175521940 wait complete. 2024-04-19T23:47:21.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.610+0000 7f978d6e0a80 1 Processor -- start 2024-04-19T23:47:21.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.610+0000 7f978d6e0a80 1 -- start start 2024-04-19T23:47:21.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.610+0000 7f978d6e0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.610+0000 7f978d6e0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557b9cf8500 con 0x5557b9c56800 2024-04-19T23:47:21.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.610+0000 7f978b68a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.610+0000 7f978b68a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38330/0 (socket says 172.21.15.155:38330) 2024-04-19T23:47:21.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.610+0000 7f978b68a700 1 -- 172.21.15.155:0/3050677953 learned_addr learned my addr 172.21.15.155:0/3050677953 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.610+0000 7f978b68a700 1 -- 172.21.15.155:0/3050677953 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557b9c7fba0 con 0x5557b9c56800 2024-04-19T23:47:21.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.611+0000 7f978b68a700 1 --2- 172.21.15.155:0/3050677953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x5557baa2f860 tx=0x5557b9d47b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18794ba9a4c837e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.611+0000 7f9789e87700 1 -- 172.21.15.155:0/3050677953 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557b9d0f1e0 con 0x5557b9c56800 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.611+0000 7f9789e87700 1 -- 172.21.15.155:0/3050677953 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557b9f81b00 con 0x5557b9c56800 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.611+0000 7f9789e87700 1 -- 172.21.15.155:0/3050677953 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557b9d0f4a0 con 0x5557b9c56800 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.611+0000 7f978d6e0a80 1 -- 172.21.15.155:0/3050677953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 msgr2=0x5557b9f3e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.611+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/3050677953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x5557baa2f860 tx=0x5557b9d47b60 comp rx=0 tx=0).stop 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.611+0000 7f978d6e0a80 1 -- 172.21.15.155:0/3050677953 shutdown_connections 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.611+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/3050677953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.611+0000 7f978d6e0a80 1 -- 172.21.15.155:0/3050677953 >> 172.21.15.155:0/3050677953 conn(0x5557b9c56400 msgr2=0x5557b9d43000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.611+0000 7f978d6e0a80 1 -- 172.21.15.155:0/3050677953 shutdown_connections 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.611+0000 7f978d6e0a80 1 -- 172.21.15.155:0/3050677953 wait complete. 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.612+0000 7f978d6e0a80 1 Processor -- start 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.612+0000 7f978d6e0a80 1 -- start start 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.612+0000 7f978d6e0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.612+0000 7f978d6e0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557b9cf83c0 con 0x5557b9c56800 2024-04-19T23:47:21.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.612+0000 7f978b68a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.612+0000 7f978b68a700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38346/0 (socket says 172.21.15.155:38346) 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.612+0000 7f978b68a700 1 -- 172.21.15.155:0/1122243960 learned_addr learned my addr 172.21.15.155:0/1122243960 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.612+0000 7f978b68a700 1 -- 172.21.15.155:0/1122243960 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557b9c7fa00 con 0x5557b9c56800 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.612+0000 7f978b68a700 1 --2- 172.21.15.155:0/1122243960 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5557baa2fa40 tx=0x5557b9d47a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.613+0000 7f9788684700 1 -- 172.21.15.155:0/1122243960 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557b9d0f600 con 0x5557b9c56800 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.613+0000 7f9788684700 1 -- 172.21.15.155:0/1122243960 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557b9cf7c80 con 0x5557b9c56800 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.613+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1122243960 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5557b9c7f860 con 0x5557b9c56800 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.613+0000 7f9788684700 1 -- 172.21.15.155:0/1122243960 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557b9d0f1e0 con 0x5557b9c56800 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.613+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1122243960 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557b9c7f6c0 con 0x5557b9c56800 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.613+0000 7f978d6e0a80 1 Processor -- start 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.613+0000 7f978d6e0a80 1 -- start start 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.613+0000 7f978d6e0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.613+0000 7f978d6e0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557b9cf8000 con 0x5557b9c57400 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.613+0000 7f9788684700 1 -- 172.21.15.155:0/1122243960 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5557ba9f8b00 con 0x5557b9c56800 2024-04-19T23:47:21.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.613+0000 7f978be8b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.614+0000 7f978be8b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38354/0 (socket says 172.21.15.155:38354) 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.614+0000 7f978be8b700 1 -- 172.21.15.155:0/3673086129 learned_addr learned my addr 172.21.15.155:0/3673086129 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.614+0000 7f9788684700 1 --2- 172.21.15.155:0/1122243960 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557b9fe8000 0x5557b9f3f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.614+0000 7f9788684700 1 -- 172.21.15.155:0/1122243960 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5557b9cd1180 con 0x5557b9c56800 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.614+0000 7f978b68a700 1 --2- 172.21.15.155:0/1122243960 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557b9fe8000 0x5557b9f3f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.614+0000 7f978be8b700 1 -- 172.21.15.155:0/3673086129 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557b9c7e000 con 0x5557b9c57400 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.614+0000 7f978b68a700 1 --2- 172.21.15.155:0/1122243960 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557b9fe8000 0x5557b9f3f080 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5557baad4bd0 tx=0x5557b9faa240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.614+0000 7f978be8b700 1 --2- 172.21.15.155:0/3673086129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x5557b9fe4060 tx=0x5557b9faaa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5af16681d178035 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.614+0000 7f9785e7f700 1 -- 172.21.15.155:0/3673086129 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557b9d0f600 con 0x5557b9c57400 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.614+0000 7f9785e7f700 1 -- 172.21.15.155:0/3673086129 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557b9f80300 con 0x5557b9c57400 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.614+0000 7f9785e7f700 1 -- 172.21.15.155:0/3673086129 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557b9d0f1e0 con 0x5557b9c57400 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978d6e0a80 1 -- 172.21.15.155:0/3673086129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 msgr2=0x5557b9f3eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/3673086129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x5557b9fe4060 tx=0x5557b9faaa20 comp rx=0 tx=0).stop 2024-04-19T23:47:21.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978d6e0a80 1 -- 172.21.15.155:0/3673086129 shutdown_connections 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/3673086129 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978d6e0a80 1 -- 172.21.15.155:0/3673086129 >> 172.21.15.155:0/3673086129 conn(0x5557b9c56c00 msgr2=0x5557b9d43800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978d6e0a80 1 -- 172.21.15.155:0/3673086129 shutdown_connections 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978d6e0a80 1 -- 172.21.15.155:0/3673086129 wait complete. 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978d6e0a80 1 Processor -- start 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978d6e0a80 1 -- start start 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978d6e0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978d6e0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557b9c92640 con 0x5557b9c57400 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978be8b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978be8b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38366/0 (socket says 172.21.15.155:38366) 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.615+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 learned_addr learned my addr 172.21.15.155:0/1473896228 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.616+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557b9c7eea0 con 0x5557b9c57400 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.616+0000 7f978be8b700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x5557baad44b0 tx=0x5557b9faa840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.616+0000 7f978467c700 1 -- 172.21.15.155:0/1473896228 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557b9d0fa20 con 0x5557b9c57400 2024-04-19T23:47:21.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.616+0000 7f978467c700 1 -- 172.21.15.155:0/1473896228 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557b9cf7c80 con 0x5557b9c57400 2024-04-19T23:47:21.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.616+0000 7f978467c700 1 -- 172.21.15.155:0/1473896228 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557b9d0f600 con 0x5557b9c57400 2024-04-19T23:47:21.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.616+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5557b9c7e820 con 0x5557b9c57400 2024-04-19T23:47:21.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.616+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557b9c7e9c0 con 0x5557b9c57400 2024-04-19T23:47:21.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.617+0000 7f978467c700 1 -- 172.21.15.155:0/1473896228 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5557ba9f8dc0 con 0x5557b9c57400 2024-04-19T23:47:21.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.617+0000 7f978467c700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557b9fe8c00 0x5557b9f3f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.617+0000 7f978467c700 1 -- 172.21.15.155:0/1473896228 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5557b9cd1340 con 0x5557b9c57400 2024-04-19T23:47:21.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.617+0000 7f978ae89700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557b9fe8c00 0x5557b9f3f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.617+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.617+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5557b9c57800 0x5557b9f3fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.617+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9c57c00 con 0x5557b9c57800 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.617+0000 7f978ae89700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557b9fe8c00 0x5557b9f3f600 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x5557b9f39890 tx=0x5557b9d47800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978be8b700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5557b9c57800 0x5557b9f3fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978be8b700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5557b9c57800 0x5557b9f3fb80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978d6e0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978d6e0a80 20 realm 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9fe9000 con 0x5557b9c57800 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978d6e0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978d6e0a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9fe9400 con 0x5557b9c57800 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978d6e0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.618+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9fe9800 con 0x5557b9c57800 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.619+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.619+0000 7f978d6e0a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.619+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.619+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9fe9c00 con 0x5557b9c57800 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.619+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.619+0000 7f978d6e0a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.619+0000 7f978d6e0a80 20 searching for the correct realm 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.619+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5557b9fe9000 0x5557b9f40100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.619+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9fe9400 con 0x5557b9fe9000 2024-04-19T23:47:21.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.619+0000 7f978b68a700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5557b9fe9000 0x5557b9f40100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.619+0000 7f978b68a700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5557b9fe9000 0x5557b9f40100 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.620+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.620+0000 7f978b68a700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5557b9fe9400 0x5557b9f40c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.620+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e000 con 0x5557b9fe9400 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.620+0000 7f978ae89700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5557b9fe9400 0x5557b9f40c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.620+0000 7f978ae89700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5557b9fe9400 0x5557b9f40c00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.620+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.620+0000 7f978ae89700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5557ba09e000 0x5557b9f41180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.620+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557ba09e000 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.621+0000 7f978be8b700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5557ba09e000 0x5557b9f41180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.621+0000 7f978be8b700 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5557ba09e000 0x5557b9f41180 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.621+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.621+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9c57800 2024-04-19T23:47:21.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.621+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.621+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9c57800 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.622+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.622+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9c57800 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.622+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.622+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557ba09e000 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.622+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.622+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9400 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.622+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.622+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9000 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.623+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.623+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9c57800 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.623+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.623+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557ba09e000 2024-04-19T23:47:21.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.623+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.623+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9c57800 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.623+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.623+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9400 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.623+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.624+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9000 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.624+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.624+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9000 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.624+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.624+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9400 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.624+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.624+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9000 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.624+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.624+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9000 2024-04-19T23:47:21.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.625+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.625+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9c57800 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.625+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.625+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9c57800 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.625+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.625+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557ba09e000 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.625+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.625+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9000 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.626+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.626+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9400 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.626+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.626+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9c57800 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.626+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.626+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557ba09e000 2024-04-19T23:47:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.626+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.626+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9000 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.627+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.627+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557ba09e000 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.627+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.627+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9400 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.627+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.627+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9000 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.627+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.627+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557ba09e000 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9c57800 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9400 2024-04-19T23:47:21.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978d6e0a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978d6e0a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978d6e0a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978d6e0a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9c57c00 con 0x5557b9c57800 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978d6e0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.628+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09ec00 con 0x5557b9c57800 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09f000 con 0x5557b9fe9400 2024-04-19T23:47:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 20 zone default found 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 4 Realm: () 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 20 zonegroup default 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09f400 con 0x5557ba09e000 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09f800 con 0x5557b9fe9000 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.629+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.630+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09fc00 con 0x5557b9fe9000 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.630+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.630+0000 7f978d6e0a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.630+0000 7f978d6e0a80 20 started sync module instance, tier type = 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.630+0000 7f978d6e0a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.630+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09ec00 con 0x5557b9fe9400 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.631+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.631+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93835270249216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9c57c00 con 0x5557b9fe9400 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.631+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9fe9800 con 0x5557b9c57800 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.632+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93835270249216] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.632+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.632+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93835270250368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9fe9c00 con 0x5557b9c57800 2024-04-19T23:47:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.632+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557b9fe9000 2024-04-19T23:47:21.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.633+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93835270250368] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.634+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.634+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93835270251520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09f000 con 0x5557b9fe9000 2024-04-19T23:47:21.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.634+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09ec00 con 0x5557b9fe9400 2024-04-19T23:47:21.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.635+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93835270251520] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.635+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.635+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93835270252672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e400 con 0x5557b9fe9400 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.635+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09f800 con 0x5557b9c57800 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.636+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93835270252672] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.636+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.636+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93835270253824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09fc00 con 0x5557b9c57800 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.636+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09e800 con 0x5557ba09e000 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.637+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.637+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93835270254976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09f400 con 0x5557ba09e000 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.637+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09f800 con 0x5557ba09e000 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.637+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93835270253824] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.638+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.638+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93835270256128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09fc00 con 0x5557ba09e000 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.638+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9fe9800 con 0x5557ba09e000 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.639+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93835270254976] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.639+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93835270256128] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.640+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.640+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93835270257280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9fe9c00 con 0x5557ba09e000 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.640+0000 7f978d6e0a80 20 add_watcher() i=0 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.640+0000 7f978d6e0a80 20 add_watcher() i=1 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.640+0000 7f978d6e0a80 20 add_watcher() i=2 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.640+0000 7f978d6e0a80 20 add_watcher() i=3 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.640+0000 7f978d6e0a80 20 add_watcher() i=4 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.640+0000 7f978d6e0a80 20 add_watcher() i=5 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.640+0000 7f978d6e0a80 20 add_watcher() i=6 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.641+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93835270257280] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.641+0000 7f978d6e0a80 20 add_watcher() i=7 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.641+0000 7f978d6e0a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.641+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9fe9800 con 0x5557b9c57800 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.641+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.642+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93835271798784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557b9fe9c00 con 0x5557b9c57800 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.643+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93835271798784] v32'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.643+0000 7f9772658700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.643+0000 7f978d6e0a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.643+0000 7f978d6e0a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.643+0000 7f978d6e0a80 1 Processor -- start 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.643+0000 7f978d6e0a80 1 -- start start 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.643+0000 7f978d6e0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.643+0000 7f978d6e0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557b9c92780 con 0x5557ba09f400 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.643+0000 7f978ae89700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.644+0000 7f978ae89700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38376/0 (socket says 172.21.15.155:38376) 2024-04-19T23:47:21.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.644+0000 7f978ae89700 1 -- 172.21.15.155:0/2061456554 learned_addr learned my addr 172.21.15.155:0/2061456554 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.644+0000 7f978ae89700 1 -- 172.21.15.155:0/2061456554 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557b9c7eb60 con 0x5557ba09f400 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.644+0000 7f978ae89700 1 --2- 172.21.15.155:0/2061456554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x5557ba0b8000 tx=0x5557b9fabda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de630788757e7b8f server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.644+0000 7f9771e57700 1 -- 172.21.15.155:0/2061456554 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557b9d0f760 con 0x5557ba09f400 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.644+0000 7f9771e57700 1 -- 172.21.15.155:0/2061456554 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557ba0c2000 con 0x5557ba09f400 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.644+0000 7f9771e57700 1 -- 172.21.15.155:0/2061456554 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557ba0c4000 con 0x5557ba09f400 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.645+0000 7f978d6e0a80 1 -- 172.21.15.155:0/2061456554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 msgr2=0x5557b9f40680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.645+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/2061456554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x5557ba0b8000 tx=0x5557b9fabda0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.645+0000 7f978d6e0a80 1 -- 172.21.15.155:0/2061456554 shutdown_connections 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.645+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/2061456554 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.645+0000 7f978d6e0a80 1 -- 172.21.15.155:0/2061456554 >> 172.21.15.155:0/2061456554 conn(0x5557ba09e800 msgr2=0x5557b9d44000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.645+0000 7f978d6e0a80 1 -- 172.21.15.155:0/2061456554 shutdown_connections 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.645+0000 7f978d6e0a80 1 -- 172.21.15.155:0/2061456554 wait complete. 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.645+0000 7f978d6e0a80 1 Processor -- start 2024-04-19T23:47:21.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.645+0000 7f978d6e0a80 1 -- start start 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.645+0000 7f978d6e0a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.645+0000 7f978d6e0a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557b9cf8000 con 0x5557ba09f400 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.646+0000 7f978ae89700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.646+0000 7f978ae89700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38378/0 (socket says 172.21.15.155:38378) 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.646+0000 7f978ae89700 1 -- 172.21.15.155:0/4278040553 learned_addr learned my addr 172.21.15.155:0/4278040553 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.646+0000 7f978ae89700 1 -- 172.21.15.155:0/4278040553 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557b9c7ed00 con 0x5557ba09f400 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.646+0000 7f978ae89700 1 --2- 172.21.15.155:0/4278040553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x5557ba0b8060 tx=0x5557b9d47980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.646+0000 7f9770654700 1 -- 172.21.15.155:0/4278040553 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557ba0c4160 con 0x5557ba09f400 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.646+0000 7f9770654700 1 -- 172.21.15.155:0/4278040553 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557ba0c2180 con 0x5557ba09f400 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.646+0000 7f9770654700 1 -- 172.21.15.155:0/4278040553 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5557ba0c42c0 con 0x5557ba09f400 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.646+0000 7f978d6e0a80 1 -- 172.21.15.155:0/4278040553 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5557b9c7e340 con 0x5557ba09f400 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.646+0000 7f978d6e0a80 1 -- 172.21.15.155:0/4278040553 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557b9c7fd40 con 0x5557ba09f400 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.647+0000 7f9770654700 1 -- 172.21.15.155:0/4278040553 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5557ba9f9b80 con 0x5557ba09f400 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.647+0000 7f9770654700 1 --2- 172.21.15.155:0/4278040553 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557ba142000 0x5557b9f41700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.647+0000 7f9770654700 1 -- 172.21.15.155:0/4278040553 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5557b9cd1500 con 0x5557ba09f400 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.647+0000 7f978be8b700 1 --2- 172.21.15.155:0/4278040553 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557ba142000 0x5557b9f41700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.647+0000 7f978d6e0a80 5 note: GC not initialized 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.648+0000 7f978be8b700 1 --2- 172.21.15.155:0/4278040553 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557ba142000 0x5557b9f41700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x5557ba02bf20 tx=0x5557b9fabbc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.648+0000 7f976de4f700 20 reqs_thread_entry: start 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.648+0000 7f978d6e0a80 20 init_complete bucket index max shards: 11 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.648+0000 7f978d6e0a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.648+0000 7f976be4b700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:51 2024 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.648+0000 7f976b629700 20 reqs_thread_entry: start 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.648+0000 7f978d6e0a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.648+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba09fc00 con 0x5557b9c57800 2024-04-19T23:47:21.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.649+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.649+0000 7f978d6e0a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:47:21.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.649+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba142400 con 0x5557ba09e000 2024-04-19T23:47:21.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.649+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.650+0000 7f9772658700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:47:21.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.650+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93835271798784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba142800 con 0x5557b9c57800 2024-04-19T23:47:21.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.651+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93835271798784] v32'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.651+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93835270249216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba142c00 con 0x5557b9fe9400 2024-04-19T23:47:21.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.652+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93835270249216] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.652+0000 7f978d6e0a80 20 remove_watcher() i=0 2024-04-19T23:47:21.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.652+0000 7f978d6e0a80 2 removed watcher, disabling cache 2024-04-19T23:47:21.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.652+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93835270250368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba143000 con 0x5557b9c57800 2024-04-19T23:47:21.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.653+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93835270250368] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.653+0000 7f978d6e0a80 20 remove_watcher() i=1 2024-04-19T23:47:21.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.653+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93835270251520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba143400 con 0x5557b9fe9000 2024-04-19T23:47:21.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.655+0000 7f978b68a700 1 -- 172.21.15.155:0/1473896228 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93835270251520] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08b200 con 0x5557b9fe9000 2024-04-19T23:47:21.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.655+0000 7f978d6e0a80 20 remove_watcher() i=2 2024-04-19T23:47:21.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.655+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93835270252672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba143800 con 0x5557b9fe9400 2024-04-19T23:47:21.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.656+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93835270252672] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08b440 con 0x5557b9fe9400 2024-04-19T23:47:21.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.656+0000 7f978d6e0a80 20 remove_watcher() i=3 2024-04-19T23:47:21.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.656+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93835270253824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba143c00 con 0x5557b9c57800 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.657+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93835270253824] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557b9c57800 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.657+0000 7f978d6e0a80 20 remove_watcher() i=4 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.657+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93835270254976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba142400 con 0x5557ba09e000 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.658+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93835270254976] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.658+0000 7f978d6e0a80 20 remove_watcher() i=5 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.658+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93835270256128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba142800 con 0x5557ba09e000 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.660+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93835270256128] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.660+0000 7f978d6e0a80 20 remove_watcher() i=6 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.660+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93835270257280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5557ba143000 con 0x5557ba09e000 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978be8b700 1 -- 172.21.15.155:0/1473896228 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93835270257280] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5557ba08ab40 con 0x5557ba09e000 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 20 remove_watcher() i=7 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5557ba09e000 msgr2=0x5557b9f41180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5557ba09e000 0x5557b9f41180 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5557b9c57800 msgr2=0x5557b9f3fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5557b9c57800 0x5557b9f3fb80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5557b9fe9400 msgr2=0x5557b9f40c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5557b9fe9400 0x5557b9f40c00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5557b9fe9000 msgr2=0x5557b9f40100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5557b9fe9000 0x5557b9f40100 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557b9fe8c00 msgr2=0x5557b9f3f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557b9fe8c00 0x5557b9f3f600 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x5557b9f39890 tx=0x5557b9d47800 comp rx=0 tx=0).stop 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 msgr2=0x5557b9f3eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x5557baad44b0 tx=0x5557b9faa840 comp rx=0 tx=0).stop 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.661+0000 7f978ae89700 1 -- 172.21.15.155:0/1473896228 reap_dead start 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 shutdown_connections 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1473896228 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c57400 0x5557b9f3eb00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 >> 172.21.15.155:0/1473896228 conn(0x5557b9c56c00 msgr2=0x5557b9d43800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 shutdown_connections 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1473896228 wait complete. 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/4278040553 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557ba142000 msgr2=0x5557b9f41700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/4278040553 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557ba142000 0x5557b9f41700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x5557ba02bf20 tx=0x5557b9fabbc0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/4278040553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 msgr2=0x5557b9f40680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/4278040553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x5557ba0b8060 tx=0x5557b9d47980 comp rx=0 tx=0).stop 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/4278040553 shutdown_connections 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/4278040553 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557ba142000 0x5557b9f41700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/4278040553 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557ba09f400 0x5557b9f40680 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/4278040553 >> 172.21.15.155:0/4278040553 conn(0x5557ba09e800 msgr2=0x5557b9d44000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/4278040553 shutdown_connections 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/4278040553 wait complete. 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1122243960 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557b9fe8000 msgr2=0x5557b9f3f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1122243960 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557b9fe8000 0x5557b9f3f080 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5557baad4bd0 tx=0x5557b9faa240 comp rx=0 tx=0).stop 2024-04-19T23:47:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1122243960 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 msgr2=0x5557b9f3e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1122243960 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5557baa2fa40 tx=0x5557b9d47a40 comp rx=0 tx=0).stop 2024-04-19T23:47:21.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1122243960 shutdown_connections 2024-04-19T23:47:21.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1122243960 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5557b9fe8000 0x5557b9f3f080 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 --2- 172.21.15.155:0/1122243960 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5557b9c56800 0x5557b9f3e580 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.662+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1122243960 >> 172.21.15.155:0/1122243960 conn(0x5557b9c56400 msgr2=0x5557b9d43000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.663+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1122243960 shutdown_connections 2024-04-19T23:47:21.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.663+0000 7f978d6e0a80 1 -- 172.21.15.155:0/1122243960 wait complete. 2024-04-19T23:47:21.669 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:47:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: "entries": [], 2024-04-19T23:47:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: "summary": [] 2024-04-19T23:47:21.669 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:47:21.669 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-19T23:47:21.670 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-19T23:47:21.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-19T23:47:21.670 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-04-19T23:47:21.716 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:47:21.716 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.716+0000 7f51d1bb3a80 1 Processor -- start 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.717+0000 7f51d1bb3a80 1 -- start start 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.717+0000 7f51d1bb3a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56115272e800 0x561152a16580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.717+0000 7f51d1bb3a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561152a59500 con 0x56115272ec00 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.717+0000 7f51d1bb3a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5611527d0a00 con 0x56115272e800 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.717+0000 7f51cfb5d700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56115272e800 0x561152a16580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.717+0000 7f51cf35c700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x56115272ec00 0x56115281a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:47664/0 (socket says 172.21.15.155:47664) 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.717+0000 7f51cfb5d700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x56115272e800 0x561152a16580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38386/0 (socket says 172.21.15.155:38386) 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.717+0000 7f51cf35c700 1 -- 172.21.15.155:0/3453138583 learned_addr learned my addr 172.21.15.155:0/3453138583 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.717+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3453138583 >> v1:172.21.15.76:6789/0 conn(0x56115272ec00 legacy=0x56115281a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.717+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3453138583 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561152757d40 con 0x56115272e800 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.717+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/3453138583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x561152a119e0 tx=0x56115281f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507a2405c3bed4e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.718+0000 7f51ceb5b700 1 -- 172.21.15.155:0/3453138583 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5611527e74a0 con 0x56115272e800 2024-04-19T23:47:21.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.718+0000 7f51ceb5b700 1 -- 172.21.15.155:0/3453138583 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561152a59800 con 0x56115272e800 2024-04-19T23:47:21.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.718+0000 7f51ceb5b700 1 -- 172.21.15.155:0/3453138583 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5611527e7600 con 0x56115272e800 2024-04-19T23:47:21.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.718+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3453138583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 msgr2=0x561152a16580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.718+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3453138583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x561152a119e0 tx=0x56115281f920 comp rx=0 tx=0).stop 2024-04-19T23:47:21.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.718+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3453138583 shutdown_connections 2024-04-19T23:47:21.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.718+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3453138583 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.718+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3453138583 >> 172.21.15.155:0/3453138583 conn(0x56115272e400 msgr2=0x56115281a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.718+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3453138583 shutdown_connections 2024-04-19T23:47:21.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.718+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3453138583 wait complete. 2024-04-19T23:47:21.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.719+0000 7f51d1bb3a80 1 Processor -- start 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.719+0000 7f51d1bb3a80 1 -- start start 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.719+0000 7f51d1bb3a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.719+0000 7f51d1bb3a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611527d0500 con 0x56115272e800 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.719+0000 7f51cfb5d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.719+0000 7f51cfb5d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38394/0 (socket says 172.21.15.155:38394) 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.719+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3579855676 learned_addr learned my addr 172.21.15.155:0/3579855676 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3579855676 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561152757ba0 con 0x56115272e800 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/3579855676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x5611535078c0 tx=0x56115281f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe9fd63ee502870 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51ce35a700 1 -- 172.21.15.155:0/3579855676 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5611527e7760 con 0x56115272e800 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51ce35a700 1 -- 172.21.15.155:0/3579855676 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561152a59b00 con 0x56115272e800 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51ce35a700 1 -- 172.21.15.155:0/3579855676 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5611527e74a0 con 0x56115272e800 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3579855676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 msgr2=0x561152a16580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3579855676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x5611535078c0 tx=0x56115281f800 comp rx=0 tx=0).stop 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3579855676 shutdown_connections 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3579855676 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3579855676 >> 172.21.15.155:0/3579855676 conn(0x56115272e400 msgr2=0x56115281b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3579855676 shutdown_connections 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.720+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3579855676 wait complete. 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.721+0000 7f51d1bb3a80 1 Processor -- start 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.721+0000 7f51d1bb3a80 1 -- start start 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.721+0000 7f51d1bb3a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.721+0000 7f51d1bb3a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611527d03c0 con 0x56115272e800 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.721+0000 7f51cfb5d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.721+0000 7f51cfb5d700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38402/0 (socket says 172.21.15.155:38402) 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.721+0000 7f51cfb5d700 1 -- 172.21.15.155:0/448571785 learned_addr learned my addr 172.21.15.155:0/448571785 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.721+0000 7f51cfb5d700 1 -- 172.21.15.155:0/448571785 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561152757a00 con 0x56115272e800 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.721+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/448571785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x561152a10a50 tx=0x56115281f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.722+0000 7f51ccb57700 1 -- 172.21.15.155:0/448571785 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5611527e7600 con 0x56115272e800 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.722+0000 7f51ccb57700 1 -- 172.21.15.155:0/448571785 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561152a59c80 con 0x56115272e800 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.722+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/448571785 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561152757860 con 0x56115272e800 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.722+0000 7f51ccb57700 1 -- 172.21.15.155:0/448571785 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5611527e78c0 con 0x56115272e800 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.722+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/448571785 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611527576c0 con 0x56115272e800 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.722+0000 7f51d1bb3a80 1 Processor -- start 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.722+0000 7f51d1bb3a80 1 -- start start 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.722+0000 7f51ccb57700 1 -- 172.21.15.155:0/448571785 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5611534d0b00 con 0x56115272e800 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51d1bb3a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 0x561152a16b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51d1bb3a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115276a640 con 0x56115272f400 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51ccb57700 1 --2- 172.21.15.155:0/448571785 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152aac000 0x561152a17080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51ccb57700 1 -- 172.21.15.155:0/448571785 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5611527a9180 con 0x56115272e800 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/448571785 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152aac000 0x561152a17080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51d035e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 0x561152a16b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51d035e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 0x561152a16b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38414/0 (socket says 172.21.15.155:38414) 2024-04-19T23:47:21.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51d035e700 1 -- 172.21.15.155:0/1891053480 learned_addr learned my addr 172.21.15.155:0/1891053480 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/448571785 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152aac000 0x561152a17080 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5611535baed0 tx=0x561152a72780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51d035e700 1 -- 172.21.15.155:0/1891053480 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561152756000 con 0x56115272f400 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51d035e700 1 --2- 172.21.15.155:0/1891053480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 0x561152a16b00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x5611535ba2a0 tx=0x561152a72a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fccc3f9f979f689 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51ca352700 1 -- 172.21.15.155:0/1891053480 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5611527e7600 con 0x56115272f400 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51ca352700 1 -- 172.21.15.155:0/1891053480 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611527cfc80 con 0x56115272f400 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.723+0000 7f51ca352700 1 -- 172.21.15.155:0/1891053480 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5611527e78c0 con 0x56115272f400 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.724+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1891053480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 msgr2=0x561152a16b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.724+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/1891053480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 0x561152a16b00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x5611535ba2a0 tx=0x561152a72a80 comp rx=0 tx=0).stop 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.724+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1891053480 shutdown_connections 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.724+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/1891053480 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 0x561152a16b00 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.724+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1891053480 >> 172.21.15.155:0/1891053480 conn(0x56115272ec00 msgr2=0x56115281b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.724+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1891053480 shutdown_connections 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.724+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1891053480 wait complete. 2024-04-19T23:47:21.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.724+0000 7f51d1bb3a80 1 Processor -- start 2024-04-19T23:47:21.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.724+0000 7f51d1bb3a80 1 -- start start 2024-04-19T23:47:21.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.724+0000 7f51d1bb3a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 0x561152a16b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.724+0000 7f51d1bb3a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115276a8c0 con 0x56115272f400 2024-04-19T23:47:21.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.725+0000 7f51d035e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 0x561152a16b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.725+0000 7f51d035e700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 0x561152a16b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38420/0 (socket says 172.21.15.155:38420) 2024-04-19T23:47:21.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.725+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 learned_addr learned my addr 172.21.15.155:0/1523336845 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.725+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561152756ea0 con 0x56115272f400 2024-04-19T23:47:21.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.725+0000 7f51d035e700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 0x561152a16b00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x5611535ba870 tx=0x561152a72660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.725+0000 7f51c8b4f700 1 -- 172.21.15.155:0/1523336845 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5611527e7760 con 0x56115272f400 2024-04-19T23:47:21.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.725+0000 7f51c8b4f700 1 -- 172.21.15.155:0/1523336845 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611527cfb00 con 0x56115272f400 2024-04-19T23:47:21.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.725+0000 7f51c8b4f700 1 -- 172.21.15.155:0/1523336845 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5611527e7600 con 0x56115272f400 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.725+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561152756820 con 0x56115272f400 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.725+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611527569c0 con 0x56115272f400 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.726+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.726+0000 7f51c8b4f700 1 -- 172.21.15.155:0/1523336845 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5611534d0dc0 con 0x56115272f400 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51c8b4f700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152aacc00 0x561152a17600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51c8b4f700 1 -- 172.21.15.155:0/1523336845 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5611527a9340 con 0x56115272f400 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51cf35c700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152aacc00 0x561152a17600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56115272f800 0x561152a17b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56115272fc00 con 0x56115272f800 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51d035e700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56115272f800 0x561152a17b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51cf35c700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152aacc00 0x561152a17600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x561152aafcb0 tx=0x561152a73920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51d035e700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56115272f800 0x561152a17b80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51d1bb3a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51d1bb3a80 20 realm 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.727+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aad000 con 0x56115272f800 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aad400 con 0x56115272f800 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aad800 con 0x56115272f800 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:47:21.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aadc00 con 0x56115272f800 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 20 searching for the correct realm 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561152aad000 0x561152a18100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.728+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aad400 con 0x561152aad000 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.729+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561152aad000 0x561152a18100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.729+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561152aad000 0x561152a18100 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.729+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.729+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561152aad400 0x561152a18c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.729+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6000 con 0x561152aad400 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.729+0000 7f51cf35c700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561152aad400 0x561152a18c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.729+0000 7f51cf35c700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561152aad400 0x561152a18c00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.730+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.730+0000 7f51cf35c700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5611535c6000 0x561152a19180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.730+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x5611535c6000 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.730+0000 7f51d035e700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5611535c6000 0x561152a19180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.730+0000 7f51d035e700 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5611535c6000 0x561152a19180 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.731+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.731+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x56115272f800 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.731+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.731+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x56115272f800 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.731+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.731+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x56115272f800 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.731+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.731+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x5611535c6000 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.732+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.732+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad400 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.732+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.732+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad000 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.732+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.732+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x56115272f800 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.732+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.732+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x5611535c6000 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.732+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.732+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x56115272f800 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.733+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.733+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad400 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.733+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.733+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad000 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.733+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.733+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad000 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.733+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.733+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad400 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.734+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.734+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad000 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.734+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.734+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad000 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.734+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.734+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x56115272f800 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.734+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.734+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x56115272f800 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.734+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.734+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x5611535c6000 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.735+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.735+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad000 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.735+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.735+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad400 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.735+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.735+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x56115272f800 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.735+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.735+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x5611535c6000 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.736+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.736+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad000 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.736+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.736+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x5611535c6000 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.736+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.736+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad400 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.736+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.736+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad000 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x5611535c6000 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x56115272f800 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad400 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51d1bb3a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51d1bb3a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51d1bb3a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51d1bb3a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.737+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56115272fc00 con 0x56115272f800 2024-04-19T23:47:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6c00 con 0x56115272f800 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7000 con 0x561152aad400 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 20 zone default found 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 4 Realm: () 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:47:21.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 20 zonegroup default 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.738+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7400 con 0x5611535c6000 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51d1bb3a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7800 con 0x561152aad000 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51d1bb3a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7c00 con 0x561152aad000 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51d1bb3a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51d1bb3a80 20 started sync module instance, tier type = 2024-04-19T23:47:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51d1bb3a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.739+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6c00 con 0x561152aad400 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.740+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.740+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94632400706304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56115272fc00 con 0x561152aad400 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.740+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aad800 con 0x56115272f800 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.741+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94632400706304] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.741+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.741+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94632400707456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aadc00 con 0x56115272f800 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.741+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x561152aad000 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.742+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.742+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94632400708608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7000 con 0x561152aad000 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.742+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6c00 con 0x561152aad400 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.743+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94632400707456] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.743+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.743+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94632400709760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6400 con 0x561152aad400 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.743+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7800 con 0x56115272f800 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.743+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94632400708608] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.744+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.745+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94632400710912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7c00 con 0x56115272f800 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.745+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6800 con 0x5611535c6000 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.745+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94632400709760] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.746+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94632400710912] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.746+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.746+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94632400712064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7400 con 0x5611535c6000 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.746+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7800 con 0x5611535c6000 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.747+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94632400712064] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.747+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.747+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94632400713216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7c00 con 0x5611535c6000 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.747+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aad800 con 0x5611535c6000 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.748+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.748+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94632400713216] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.748+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94632400714368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aadc00 con 0x5611535c6000 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.748+0000 7f51d1bb3a80 20 add_watcher() i=0 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.748+0000 7f51d1bb3a80 20 add_watcher() i=1 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.748+0000 7f51d1bb3a80 20 add_watcher() i=2 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.748+0000 7f51d1bb3a80 20 add_watcher() i=3 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.748+0000 7f51d1bb3a80 20 add_watcher() i=4 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.748+0000 7f51d1bb3a80 20 add_watcher() i=5 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.748+0000 7f51d1bb3a80 20 add_watcher() i=6 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.749+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94632400714368] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.749+0000 7f51d1bb3a80 20 add_watcher() i=7 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.749+0000 7f51d1bb3a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:47:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.749+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aad800 con 0x56115272f800 2024-04-19T23:47:21.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.749+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.749+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94632402223104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aadc00 con 0x56115272f800 2024-04-19T23:47:21.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.750+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94632402223104] v32'233 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.750+0000 7f51b6b2b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:47:21.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.750+0000 7f51d1bb3a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.750+0000 7f51d1bb3a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.750+0000 7f51d1bb3a80 1 Processor -- start 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.750+0000 7f51d1bb3a80 1 -- start start 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.751+0000 7f51d1bb3a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 0x561152a18680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.751+0000 7f51d1bb3a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611527d03c0 con 0x5611535c7400 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.751+0000 7f51cf35c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 0x561152a18680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.751+0000 7f51cf35c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 0x561152a18680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38428/0 (socket says 172.21.15.155:38428) 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.751+0000 7f51cf35c700 1 -- 172.21.15.155:0/2146014526 learned_addr learned my addr 172.21.15.155:0/2146014526 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.751+0000 7f51cf35c700 1 -- 172.21.15.155:0/2146014526 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561152756b60 con 0x5611535c7400 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.751+0000 7f51cf35c700 1 --2- 172.21.15.155:0/2146014526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 0x561152a18680 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x561152b880c0 tx=0x561152a73d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272d547205516a70 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.751+0000 7f51b632a700 1 -- 172.21.15.155:0/2146014526 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561152b98000 con 0x5611535c7400 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.752+0000 7f51b632a700 1 -- 172.21.15.155:0/2146014526 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561152b9a000 con 0x5611535c7400 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.752+0000 7f51b632a700 1 -- 172.21.15.155:0/2146014526 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561152b98160 con 0x5611535c7400 2024-04-19T23:47:21.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.752+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/2146014526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 msgr2=0x561152a18680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.752+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/2146014526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 0x561152a18680 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x561152b880c0 tx=0x561152a73d40 comp rx=0 tx=0).stop 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.752+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/2146014526 shutdown_connections 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.752+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/2146014526 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 0x561152a18680 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.752+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/2146014526 >> 172.21.15.155:0/2146014526 conn(0x5611535c6800 msgr2=0x56115281c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.752+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/2146014526 shutdown_connections 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.752+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/2146014526 wait complete. 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.752+0000 7f51d1bb3a80 1 Processor -- start 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51d1bb3a80 1 -- start start 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51d1bb3a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 0x561152a18680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51d1bb3a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611527d0500 con 0x5611535c7400 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51cf35c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 0x561152a18680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51cf35c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 0x561152a18680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38432/0 (socket says 172.21.15.155:38432) 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51cf35c700 1 -- 172.21.15.155:0/3160875257 learned_addr learned my addr 172.21.15.155:0/3160875257 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51cf35c700 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561152756d00 con 0x5611535c7400 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51cf35c700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 0x561152a18680 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x561152b88d80 tx=0x561152a73e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51b4b27700 1 -- 172.21.15.155:0/3160875257 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561152b982c0 con 0x5611535c7400 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51b4b27700 1 -- 172.21.15.155:0/3160875257 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561152b9a180 con 0x5611535c7400 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561152756340 con 0x5611535c7400 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51b4b27700 1 -- 172.21.15.155:0/3160875257 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561152b98000 con 0x5611535c7400 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.753+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561152756b60 con 0x5611535c7400 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.754+0000 7f51b4b27700 1 -- 172.21.15.155:0/3160875257 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5611534d1b80 con 0x5611535c7400 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.754+0000 7f51b4b27700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152c1c000 0x561152a19700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.754+0000 7f51b4b27700 1 -- 172.21.15.155:0/3160875257 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5611527a9500 con 0x5611535c7400 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.754+0000 7f51d035e700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152c1c000 0x561152a19700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.754+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5611535c7800 0x561152c32000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.755+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7c00 con 0x5611535c7800 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.755+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5611535c7800 0x561152c32000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.755+0000 7f51d035e700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152c1c000 0x561152a19700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x561152b1dd10 tx=0x561152a73b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.755+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5611535c7800 0x561152c32000 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.756+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v32'40 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561152b2d200 con 0x5611535c7800 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.756+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561152c1c400 0x561152c32580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.756+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1c800 con 0x561152c1c400 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.756+0000 7f51cf35c700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561152c1c400 0x561152c32580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.756+0000 7f51cf35c700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561152c1c400 0x561152c32580 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.757+0000 7f51cf35c700 1 -- 172.21.15.155:0/3160875257 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561152b2d440 con 0x561152c1c400 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.757+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561152c1cc00 0x561152c32b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.757+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d000 con 0x561152c1cc00 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.757+0000 7f51d035e700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561152c1cc00 0x561152c32b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.758+0000 7f51d035e700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561152c1cc00 0x561152c32b00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.758+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.759+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d400 con 0x5611535c7800 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.759+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v32'234 uv163 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561152b2d200 con 0x5611535c7800 2024-04-19T23:47:21.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.760+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561152c1d800 0x561152c33080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.760+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1dc00 con 0x561152c1d800 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.760+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561152c1d800 0x561152c33080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.760+0000 7f51cfb5d700 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561152c1d800 0x561152c33080 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.761+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v32'74 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152c1d800 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.761+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40000 con 0x561152c1cc00 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.762+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v32'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.762+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40400 con 0x5611535c7800 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.763+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v32'32 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561152b2d200 con 0x5611535c7800 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.763+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40800 con 0x561152c1c400 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.764+0000 7f51cf35c700 1 -- 172.21.15.155:0/3160875257 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v32'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561152b2d440 con 0x561152c1c400 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.764+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40c00 con 0x561152c1d800 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.765+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152c1d800 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.765+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41000 con 0x561152c1cc00 2024-04-19T23:47:21.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.766+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.766+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41400 con 0x561152c1d800 2024-04-19T23:47:21.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.767+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v32'75 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152c1d800 2024-04-19T23:47:21.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.767+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41800 con 0x561152c1c400 2024-04-19T23:47:21.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.768+0000 7f51cf35c700 1 -- 172.21.15.155:0/3160875257 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v32'34 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d440 con 0x561152c1c400 2024-04-19T23:47:21.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.768+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41c00 con 0x561152c1d800 2024-04-19T23:47:21.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.769+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152c1d800 2024-04-19T23:47:21.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.769+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40800 con 0x561152c1c400 2024-04-19T23:47:21.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.770+0000 7f51cf35c700 1 -- 172.21.15.155:0/3160875257 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v32'58 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d440 con 0x561152c1c400 2024-04-19T23:47:21.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.770+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40400 con 0x5611535c7800 2024-04-19T23:47:21.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.771+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v32'235 uv165 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d200 con 0x5611535c7800 2024-04-19T23:47:21.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.771+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1c800 con 0x561152c1cc00 2024-04-19T23:47:21.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.772+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v32'73 uv50 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.772+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d400 con 0x561152c1d800 2024-04-19T23:47:21.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.773+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v32'76 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152c1d800 2024-04-19T23:47:21.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.773+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1dc00 con 0x561152c1cc00 2024-04-19T23:47:21.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.774+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.774+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6c00 con 0x5611535c7800 2024-04-19T23:47:21.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.775+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d200 con 0x5611535c7800 2024-04-19T23:47:21.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.775+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7000 con 0x5611535c7800 2024-04-19T23:47:21.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.776+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'236 uv167 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d200 con 0x5611535c7800 2024-04-19T23:47:21.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.776+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7c00 con 0x561152c1cc00 2024-04-19T23:47:21.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.777+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'74 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.777+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56115272fc00 con 0x561152c1d800 2024-04-19T23:47:21.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.778+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'38 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152c1d800 2024-04-19T23:47:21.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.778+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d400 con 0x561152c1cc00 2024-04-19T23:47:21.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.779+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.779+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d000 con 0x561152c1cc00 2024-04-19T23:47:21.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.780+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.780 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.780+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1c800 con 0x561152c1cc00 2024-04-19T23:47:21.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.781+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'24 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.781+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1dc00 con 0x561152c1cc00 2024-04-19T23:47:21.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.782+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.782+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40c00 con 0x561152c1c400 2024-04-19T23:47:21.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.783+0000 7f51cf35c700 1 -- 172.21.15.155:0/3160875257 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d440 con 0x561152c1c400 2024-04-19T23:47:21.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.783+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41400 con 0x561152c1cc00 2024-04-19T23:47:21.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.784+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.784+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41c00 con 0x561152c1c400 2024-04-19T23:47:21.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.785+0000 7f51cf35c700 1 -- 172.21.15.155:0/3160875257 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d440 con 0x561152c1c400 2024-04-19T23:47:21.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.785+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40400 con 0x561152c1cc00 2024-04-19T23:47:21.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.786+0000 7f51d035e700 1 -- 172.21.15.155:0/3160875257 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'75 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x561152c1cc00 2024-04-19T23:47:21.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.786+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40000 con 0x561152c1c400 2024-04-19T23:47:21.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.787+0000 7f51cf35c700 1 -- 172.21.15.155:0/3160875257 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'59 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d440 con 0x561152c1c400 2024-04-19T23:47:21.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.787+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41000 con 0x561152c1d800 2024-04-19T23:47:21.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.788+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152c1d800 2024-04-19T23:47:21.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.789+0000 7f51b2322700 20 reqs_thread_entry: start 2024-04-19T23:47:21.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.789+0000 7f51d1bb3a80 20 init_complete bucket index max shards: 11 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.789+0000 7f51d1bb3a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.789+0000 7f51b031e700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:52 2024 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.789+0000 7f51afafc700 20 reqs_thread_entry: start 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.789+0000 7f51d1bb3a80 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.789+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.789+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aadc00 con 0x56115272f800 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.790+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.790+0000 7f51d1bb3a80 20 rados_obj.operate() r=0 bl.length=357 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.790+0000 7f51d1bb3a80 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.790+0000 7f51d1bb3a80 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.790+0000 7f51d1bb3a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.790+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6c00 con 0x561152aad400 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.790+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.790+0000 7f51d1bb3a80 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 : miss 2024-04-19T23:47:21.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.790+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.790+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 8.1a 8:5aa4d607:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41400 con 0x5611535c6000 2024-04-19T23:47:21.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.791+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(64 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.791+0000 7f51d1bb3a80 20 rados_obj.operate() r=0 bl.length=352 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.791+0000 7f51d1bb3a80 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 info.flags=0x17 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.791+0000 7f51d1bb3a80 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 to cache LRU end 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.791+0000 7f51d1bb3a80 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.791+0000 7f51d1bb3a80 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.791+0000 7f51d1bb3a80 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.791+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 4.20 4:0482fb0b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40400 con 0x56115272f800 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.792+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(65 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.0 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.792+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:66 4.1b 4:d9369ec0:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41800 con 0x561152aad400 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.792+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(66 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.792+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:67 4.19 4:9acb7a54:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40800 con 0x561152aad000 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.792+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(67 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.792+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:68 4.a 4:5122361b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40c00 con 0x561152aad400 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.792+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 15 ==== osd_op_reply(68 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2d440 con 0x561152aad400 2024-04-19T23:47:21.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.792+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 4.1e 4:7add5e34:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41c00 con 0x5611535c6000 2024-04-19T23:47:21.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.793+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(69 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4 [call out=425b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.793+0000 7f51d1bb3a80 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-04-19T23:47:21.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.793+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 4.2b 4:d471633e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40000 con 0x56115272f800 2024-04-19T23:47:21.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.793+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(70 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.793+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 4.3e 4:7f7de258:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aadc00 con 0x561152aad400 2024-04-19T23:47:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.794+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 16 ==== osd_op_reply(71 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.794+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:72 4.16 4:6867171c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d400 con 0x561152aad000 2024-04-19T23:47:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.794+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(72 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.7 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.794+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:73 4.3c 4:3c941730:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d000 con 0x56115272f800 2024-04-19T23:47:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.794+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(73 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.794+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:74 4.26 4:669a8e38:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1c800 con 0x5611535c6000 2024-04-19T23:47:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(74 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.9 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:75 4.3b 4:dc603670:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1dc00 con 0x561152aad000 2024-04-19T23:47:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(75 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51d1bb3a80 20 get_obj_state: rctx=0x561152b58cb0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x561152cd81e8 s->prefetch_data=0 2024-04-19T23:47:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:76 3.39 3:9fa62a9e:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7c00 con 0x561152aad000 2024-04-19T23:47:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== osd_op_reply(76 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51d1bb3a80 10 manifest: total_size = 6 2024-04-19T23:47:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51d1bb3a80 20 get_obj_state: setting s->obj_tag to 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4221.3418941625660923466 2024-04-19T23:47:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51d1bb3a80 20 get_obj_state: rctx=0x561152b58cb0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x561152cd81e8 s->prefetch_data=0 2024-04-19T23:47:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51d1bb3a80 20 prepare_atomic_modification: state is not atomic. state=0x561152cd81e8 2024-04-19T23:47:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51d1bb3a80 20 bucket index object: default.rgw.buckets.index:.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4 2024-04-19T23:47:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.795+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 4.1e 4:7add5e34:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7000 con 0x5611535c6000 2024-04-19T23:47:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.796+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(77 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4 [stat,call,call] v32'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.796+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:78 3.39 3:9fa62a9e:::1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7c00 con 0x561152aad000 2024-04-19T23:47:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.797+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(78 1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6_15f6f8dc036519d7fe15b39338f6e5db [call] v32'6 uv6 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.797+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:79 4.1e 4:7add5e34:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1dc00 con 0x5611535c6000 2024-04-19T23:47:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.797+0000 7f51d1bb3a80 20 list_objects_ordered: starting attempt 1 2024-04-19T23:47:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.797+0000 7f51d1bb3a80 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-19T23:47:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.797+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:80 4.20 4:0482fb0b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41000 con 0x56115272f800 2024-04-19T23:47:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.797+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:81 4.1b 4:d9369ec0:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40800 con 0x561152aad400 2024-04-19T23:47:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.797+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:82 4.19 4:9acb7a54:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56115272fc00 con 0x561152aad000 2024-04-19T23:47:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.797+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:83 4.a 4:5122361b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41400 con 0x561152aad400 2024-04-19T23:47:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.797+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:84 4.1e 4:7add5e34:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40400 con 0x5611535c6000 2024-04-19T23:47:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:85 4.2b 4:d471633e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41c00 con 0x56115272f800 2024-04-19T23:47:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:86 4.3e 4:7f7de258:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40000 con 0x561152aad400 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:87 4.16 4:6867171c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41000 con 0x561152aad000 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:88 4.3c 4:3c941730:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d000 con 0x56115272f800 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:89 4.26 4:669a8e38:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1c800 con 0x5611535c6000 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:90 4.3b 4:dc603670:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1dc00 con 0x561152aad000 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 17 ==== osd_op_reply(81 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 18 ==== osd_op_reply(83 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 19 ==== osd_op_reply(86 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== osd_op_reply(80 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.0 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(85 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 19 ==== osd_op_reply(82 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 20 ==== osd_op_reply(90 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(88 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 21 ==== osd_op_reply(87 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.7 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.798+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(89 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.9 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 20 ==== osd_op_reply(79 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4 [stat,call,call] v32'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51c9b51700 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 21 ==== osd_op_reply(84 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6])"; uploads.size()=0; is_truncated=0 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6]) 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 20 lifecycle: rados->read ofs=0 len=0 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:91 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7000 con 0x561152aad400 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 20 ==== osd_op_reply(91 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv39 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 20 lifecycle: rados_obj.operate() r=0 bl.length=165 2024-04-19T23:47:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 10 lifecycle: adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.799+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:92 8.1a 8:5aa4d607:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40c00 con 0x5611535c6000 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 22 ==== osd_op_reply(92 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 [delete,create,call,call,writefull 0~352,setxattr (123)] v32'4 uv4 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51d1bb3a80 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 info.flags=0x17 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51d1bb3a80 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 to cache LRU end 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51d1bb3a80 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51d1bb3a80 10 lifecycle: distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6, ofs0, ns] 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:93 7.15 7:a93a5511:::notify.2:head [notify cookie 94632402226560 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41400 con 0x561152aad000 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 22 ==== watch-notify(notify (1) cookie 94632400708608 notify 137438953493 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x561152a71d40 con 0x561152aad000 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51c9b51700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94632400708608 notifier 4853 bl.length()=725 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 23 ==== osd_op_reply(93 notify.2 [notify cookie 94632402226560 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51c9b51700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 info.flags=0x17 2024-04-19T23:47:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51c9b51700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 to cache LRU end 2024-04-19T23:47:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51c9b51700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-19T23:47:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51c9b51700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:94 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d400 con 0x561152aad000 2024-04-19T23:47:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 24 ==== osd_op_reply(94 notify.2 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 25 ==== watch-notify(notify_complete (2) cookie 94632402226560 notify 137438953493 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561152be7d40 con 0x561152aad000 2024-04-19T23:47:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51d1bb3a80 20 lifecycle: handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6]): orig_sources= new_sources= 2024-04-19T23:47:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51d1bb3a80 20 lifecycle: handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6]): potential sources added=[] removed=[] 2024-04-19T23:47:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51d1bb3a80 20 lifecycle: handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6]): orig_dests= new_dests= 2024-04-19T23:47:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51d1bb3a80 20 lifecycle: handle_bi_update(): bucket=:myfoo[1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6]): potential dests added=[] removed=[] 2024-04-19T23:47:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.801+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:33 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aadc00 con 0x5611535c7800 2024-04-19T23:47:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.802+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(33 lc.26 [call] v32'237 uv237 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x561152b2d200 con 0x5611535c7800 2024-04-19T23:47:21.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.802+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:34 6.4 6:26625e58:lc::lc.26:head [call rgw.lc_rm_entry in=92b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6c00 con 0x5611535c7800 2024-04-19T23:47:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.803+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(34 lc.26 [call] v32'238 uv238 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x561152b2d200 con 0x5611535c7800 2024-04-19T23:47:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.803+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:35 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7c00 con 0x5611535c7800 2024-04-19T23:47:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(35 lc.26 [call] v32'239 uv239 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x561152b2d200 con 0x5611535c7800 2024-04-19T23:47:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:95 4.20 4:0482fb0b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6c00 con 0x56115272f800 2024-04-19T23:47:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:96 4.1b 4:d9369ec0:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aadc00 con 0x561152aad400 2024-04-19T23:47:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:97 4.19 4:9acb7a54:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1dc00 con 0x561152aad000 2024-04-19T23:47:21.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:98 4.a 4:5122361b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d400 con 0x561152aad400 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:99 4.1e 4:7add5e34:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41000 con 0x5611535c6000 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:100 4.2b 4:d471633e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41400 con 0x56115272f800 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:101 4.3e 4:7f7de258:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56115272fc00 con 0x561152aad400 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:102 4.16 4:6867171c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce0000 con 0x561152aad000 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:103 4.3c 4:3c941730:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce0400 con 0x56115272f800 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:104 4.26 4:669a8e38:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce0800 con 0x5611535c6000 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:105 4.3b 4:dc603670:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce0c00 con 0x561152aad000 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.804+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(95 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.0 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.805+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 21 ==== osd_op_reply(101 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.805+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 22 ==== osd_op_reply(96 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.805+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(100 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.805+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 32 ==== osd_op_reply(103 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.805+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 23 ==== osd_op_reply(98 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.805+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 26 ==== osd_op_reply(97 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.805+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 27 ==== osd_op_reply(102 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.7 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.805+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 28 ==== osd_op_reply(105 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.805+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 23 ==== osd_op_reply(99 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.805+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 24 ==== osd_op_reply(104 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.9 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.805+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:106 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce1000 con 0x561152aad400 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.806+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 24 ==== osd_op_reply(106 foo.buckets [call] v32'44 uv44 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.806+0000 7f51d1bb3a80 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x17) 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.806+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:107 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce1400 con 0x561152aad400 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.807+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 25 ==== osd_op_reply(107 myfoo [call,call,delete] v32'45 uv45 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.807+0000 7f51d1bb3a80 10 removing default.rgw.meta+root+myfoo from cache 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.807+0000 7f51d1bb3a80 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.807+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94632402226560 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce1800 con 0x5611535c6000 2024-04-19T23:47:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.808+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 25 ==== watch-notify(notify (1) cookie 94632400713216 notify 137438953514 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x561152be5ba0 con 0x5611535c6000 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.808+0000 7f51ca352700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94632400713216 notifier 4853 bl.length()=149 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.808+0000 7f51ca352700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56115272fc00 con 0x5611535c6000 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.808+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 26 ==== osd_op_reply(108 notify.6 [notify cookie 94632402226560 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.808+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 27 ==== osd_op_reply(109 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.808+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 28 ==== watch-notify(notify_complete (2) cookie 94632402226560 notify 137438953514 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561152be31e0 con 0x5611535c6000 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.808+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:110 8.1a 8:5aa4d607:root::.bucket.meta.myfoo%3a1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce1c00 con 0x5611535c6000 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.809+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 29 ==== osd_op_reply(110 .bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 [call,call,delete] v32'5 uv5 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.809+0000 7f51d1bb3a80 10 removing default.rgw.meta+root+.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 from cache 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.809+0000 7f51d1bb3a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6, ofs0, ns] 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.809+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:111 7.15 7:a93a5511:::notify.2:head [notify cookie 94632402226560 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce1000 con 0x561152aad000 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.809+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 29 ==== watch-notify(notify (1) cookie 94632400708608 notify 137438953494 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x561152be7d40 con 0x561152aad000 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.809+0000 7f51c9b51700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94632400708608 notifier 4853 bl.length()=206 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.809+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 30 ==== osd_op_reply(111 notify.2 [notify cookie 94632402226560 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.809+0000 7f51c9b51700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c5c000 con 0x561152aad000 2024-04-19T23:47:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 31 ==== osd_op_reply(112 notify.2 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 32 ==== watch-notify(notify_complete (2) cookie 94632402226560 notify 137438953494 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561152b19a00 con 0x561152aad000 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:113 4.20 4:0482fb0b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce1400 con 0x56115272f800 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:114 4.1b 4:d9369ec0:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce0800 con 0x561152aad400 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:115 4.19 4:9acb7a54:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40000 con 0x561152aad000 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:116 4.a 4:5122361b:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40400 con 0x561152aad400 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:117 4.1e 4:7add5e34:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41c00 con 0x5611535c6000 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:118 4.2b 4:d471633e:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40800 con 0x56115272f800 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:119 4.3e 4:7f7de258:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41800 con 0x561152aad400 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:120 4.16 4:6867171c:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40c00 con 0x561152aad000 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:121 4.3c 4:3c941730:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41000 con 0x56115272f800 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:122 4.26 4:669a8e38:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7000 con 0x5611535c6000 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.810+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:123 4.3b 4:dc603670:::.dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6c00 con 0x561152aad000 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.811+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 33 ==== osd_op_reply(120 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.7 [delete] v32'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.811+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 26 ==== osd_op_reply(114 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.1 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.811+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 27 ==== osd_op_reply(116 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.3 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.811+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 30 ==== osd_op_reply(122 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.9 [delete] v32'16 uv16 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.812+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 33 ==== osd_op_reply(113 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.0 [delete] v32'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.812+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 31 ==== osd_op_reply(117 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.4 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.812+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 28 ==== osd_op_reply(119 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.6 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.812+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 34 ==== osd_op_reply(123 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.10 [delete] v32'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.812+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 35 ==== osd_op_reply(115 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.2 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.812+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 34 ==== osd_op_reply(118 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.5 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.814+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 35 ==== osd_op_reply(121 .dir.1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6.8 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.814+0000 7f51d1bb3a80 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 : miss 2024-04-19T23:47:21.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.814+0000 7f51d1bb3a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.814+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:124 6.5 6:a0715df1:::pubsub..bucket.myfoo%2f1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d400 con 0x561152aad400 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.814+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 29 ==== osd_op_reply(124 pubsub..bucket.myfoo/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.814+0000 7f51d1bb3a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.814+0000 7f51d1bb3a80 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 info.flags=0x0 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.814+0000 7f51d1bb3a80 10 adding default.rgw.log++pubsub..bucket.myfoo/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 to cache LRU end 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.814+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:125 6.5 6:a0715df1:::pubsub..bucket.myfoo%2f1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d000 con 0x561152aad400 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.815+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 30 ==== osd_op_reply(125 pubsub..bucket.myfoo/1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.6 [delete] v32'15 uv13 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.815+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:126 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1c800 con 0x561152aad400 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.816+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 31 ==== osd_op_reply(126 foo.buckets [call] v32'46 uv46 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.816+0000 7f51d1bb3a80 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.816+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:127 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7c00 con 0x5611535c6000 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.818+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 32 ==== osd_op_reply(127 9te6NH5mcdcq0Tc5i8i1 [delete] v32'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.818+0000 7f51d1bb3a80 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.818+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:128 7.e 7:7759931f:::notify.3:head [notify cookie 94632402226560 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6c00 con 0x561152aad400 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.818+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 32 ==== watch-notify(notify (1) cookie 94632400709760 notify 137438953492 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x561152b15d40 con 0x561152aad400 2024-04-19T23:47:21.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.818+0000 7f51c9b51700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94632400709760 notifier 4853 bl.length()=170 2024-04-19T23:47:21.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.818+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 33 ==== osd_op_reply(128 notify.3 [notify cookie 94632402226560 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.818+0000 7f51c9b51700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:129 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce0400 con 0x561152aad400 2024-04-19T23:47:21.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.818+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 34 ==== osd_op_reply(129 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.818+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 35 ==== watch-notify(notify_complete (2) cookie 94632402226560 notify 137438953492 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561152b16000 con 0x561152aad400 2024-04-19T23:47:21.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.818+0000 7f51d1bb3a80 10 removing email index: foo@foo.com 2024-04-19T23:47:21.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.818+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:130 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40000 con 0x56115272f800 2024-04-19T23:47:21.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.819+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 36 ==== osd_op_reply(130 foo@foo.com [delete] v32'5 uv5 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.819+0000 7f51d1bb3a80 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-19T23:47:21.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.819+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:131 7.e 7:7759931f:::notify.3:head [notify cookie 94632402226560 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40c00 con 0x561152aad400 2024-04-19T23:47:21.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.820+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 36 ==== watch-notify(notify (1) cookie 94632400709760 notify 137438953493 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x561152b16000 con 0x561152aad400 2024-04-19T23:47:21.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.820+0000 7f51ca352700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94632400709760 notifier 4853 bl.length()=162 2024-04-19T23:47:21.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.820+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 37 ==== osd_op_reply(131 notify.3 [notify cookie 94632402226560 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.820+0000 7f51ca352700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:132 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152aadc00 con 0x561152aad400 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.820+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 38 ==== watch-notify(notify_complete (2) cookie 94632402226560 notify 137438953493 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561152b161a0 con 0x561152aad400 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.820+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 39 ==== osd_op_reply(132 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.820+0000 7f51d1bb3a80 10 removing user buckets index 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.820+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:133 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce0000 con 0x561152aad400 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.821+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 40 ==== osd_op_reply(133 foo.buckets [delete] v32'47 uv47 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.821+0000 7f51d1bb3a80 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.821+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:134 7.3 7:c609908c:::notify.5:head [notify cookie 94632402226560 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce0c00 con 0x5611535c6000 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.821+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 33 ==== watch-notify(notify (1) cookie 94632400712064 notify 137438953515 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x561152be31e0 con 0x5611535c6000 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.821+0000 7f51ca352700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953515 cookie 94632400712064 notifier 4853 bl.length()=160 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.821+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 34 ==== osd_op_reply(134 notify.5 [notify cookie 94632402226560 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.821+0000 7f51ca352700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:135 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d400 con 0x5611535c6000 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.822+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 35 ==== osd_op_reply(135 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.822+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 36 ==== watch-notify(notify_complete (2) cookie 94632402226560 notify 137438953515 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561152be3380 con 0x5611535c6000 2024-04-19T23:47:21.825 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.822+0000 7f51d1bb3a80 10 removing user index: foo 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.822+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:136 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152ce1000 con 0x56115272f800 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.823+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 37 ==== osd_op_reply(136 foo [call,call,delete] v32'22 uv22 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.823+0000 7f51d1bb3a80 10 removing default.rgw.meta+users.uid+foo from cache 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.823+0000 7f51d1bb3a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.823+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:137 7.d 7:b4812045:::notify.4:head [notify cookie 94632402226560 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1dc00 con 0x56115272f800 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.823+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 38 ==== watch-notify(notify (1) cookie 94632400710912 notify 137438953492 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x561152be3380 con 0x56115272f800 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.823+0000 7f51ca352700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94632400710912 notifier 4853 bl.length()=152 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.823+0000 7f51ca352700 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c1d000 con 0x56115272f800 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.823+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 39 ==== osd_op_reply(137 notify.4 [notify cookie 94632402226560 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.823+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 40 ==== watch-notify(notify_complete (2) cookie 94632402226560 notify 137438953492 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561152be3520 con 0x56115272f800 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.823+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 41 ==== osd_op_reply(138 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.824+0000 7f51b6b2b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:47:21.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.824+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:139 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94632402223104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c6c00 con 0x56115272f800 2024-04-19T23:47:21.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.825+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 42 ==== osd_op_reply(139 data_loggenerations_metadata [watch unwatch cookie 94632402223104] v32'240 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.825+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94632400706304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7000 con 0x561152aad400 2024-04-19T23:47:21.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.826+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 41 ==== osd_op_reply(140 notify.0 [watch unwatch cookie 94632400706304] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.826+0000 7f51d1bb3a80 20 remove_watcher() i=0 2024-04-19T23:47:21.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.826+0000 7f51d1bb3a80 2 removed watcher, disabling cache 2024-04-19T23:47:21.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.826+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94632400707456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5611535c7c00 con 0x56115272f800 2024-04-19T23:47:21.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.827+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 43 ==== osd_op_reply(141 notify.1 [watch unwatch cookie 94632400707456] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.827+0000 7f51d1bb3a80 20 remove_watcher() i=1 2024-04-19T23:47:21.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.827+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:142 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94632400708608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40400 con 0x561152aad000 2024-04-19T23:47:21.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.828+0000 7f51cfb5d700 1 -- 172.21.15.155:0/1523336845 <== osd.3 v2:172.21.15.155:6808/41835 36 ==== osd_op_reply(142 notify.2 [watch unwatch cookie 94632400708608] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2d200 con 0x561152aad000 2024-04-19T23:47:21.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.828+0000 7f51d1bb3a80 20 remove_watcher() i=2 2024-04-19T23:47:21.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.828+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:143 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94632400709760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41800 con 0x561152aad400 2024-04-19T23:47:21.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.829+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 <== osd.2 v2:172.21.15.155:6812/41834 42 ==== osd_op_reply(143 notify.3 [watch unwatch cookie 94632400709760] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152c28240 con 0x561152aad400 2024-04-19T23:47:21.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.829+0000 7f51d1bb3a80 20 remove_watcher() i=3 2024-04-19T23:47:21.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.829+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:144 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94632400710912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41400 con 0x56115272f800 2024-04-19T23:47:21.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.830+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.1 v2:172.21.15.155:6800/41833 44 ==== osd_op_reply(144 notify.4 [watch unwatch cookie 94632400710912] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x56115272f800 2024-04-19T23:47:21.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.830+0000 7f51d1bb3a80 20 remove_watcher() i=4 2024-04-19T23:47:21.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.830+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:145 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94632400712064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41c00 con 0x5611535c6000 2024-04-19T23:47:21.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.831+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 37 ==== osd_op_reply(145 notify.5 [watch unwatch cookie 94632400712064] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.831+0000 7f51d1bb3a80 20 remove_watcher() i=5 2024-04-19T23:47:21.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.831+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:146 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94632400713216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c40800 con 0x5611535c6000 2024-04-19T23:47:21.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.832+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 38 ==== osd_op_reply(146 notify.6 [watch unwatch cookie 94632400713216] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.832+0000 7f51d1bb3a80 20 remove_watcher() i=6 2024-04-19T23:47:21.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.832+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:147 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94632400714368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561152c41000 con 0x5611535c6000 2024-04-19T23:47:21.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d035e700 1 -- 172.21.15.155:0/1523336845 <== osd.0 v2:172.21.15.76:6800/39408 39 ==== osd_op_reply(147 notify.7 [watch unwatch cookie 94632400714368] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561152b2cb40 con 0x5611535c6000 2024-04-19T23:47:21.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 20 remove_watcher() i=7 2024-04-19T23:47:21.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5611535c6000 msgr2=0x561152a19180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5611535c6000 0x561152a19180 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56115272f800 msgr2=0x561152a17b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56115272f800 0x561152a17b80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561152aad400 msgr2=0x561152a18c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561152aad400 0x561152a18c00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561152aad000 msgr2=0x561152a18100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561152aad000 0x561152a18100 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152aacc00 msgr2=0x561152a17600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152aacc00 0x561152a17600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x561152aafcb0 tx=0x561152a73920 comp rx=0 tx=0).stop 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 msgr2=0x561152a16b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/1523336845 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272f400 0x561152a16b00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x5611535ba870 tx=0x561152a72660 comp rx=0 tx=0).stop 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 reap_dead start 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 shutdown_connections 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51cf35c700 1 -- 172.21.15.155:0/1523336845 reap_dead start 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 >> 172.21.15.155:0/1523336845 conn(0x56115272ec00 msgr2=0x56115281b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 shutdown_connections 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.833+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/1523336845 wait complete. 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561152c1c400 msgr2=0x561152c32580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x561152c1c400 0x561152c32580 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5611535c7800 msgr2=0x561152c32000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5611535c7800 0x561152c32000 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561152c1d800 msgr2=0x561152c33080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x561152c1d800 0x561152c33080 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561152c1cc00 msgr2=0x561152c32b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x561152c1cc00 0x561152c32b00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152c1c000 msgr2=0x561152a19700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152c1c000 0x561152a19700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x561152b1dd10 tx=0x561152a73b60 comp rx=0 tx=0).stop 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 msgr2=0x561152a18680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/3160875257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5611535c7400 0x561152a18680 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x561152b88d80 tx=0x561152a73e60 comp rx=0 tx=0).stop 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51cfb5d700 1 -- 172.21.15.155:0/3160875257 reap_dead start 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 shutdown_connections 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 >> 172.21.15.155:0/3160875257 conn(0x5611535c6800 msgr2=0x56115281c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 shutdown_connections 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/3160875257 wait complete. 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/448571785 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152aac000 msgr2=0x561152a17080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/448571785 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152aac000 0x561152a17080 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5611535baed0 tx=0x561152a72780 comp rx=0 tx=0).stop 2024-04-19T23:47:21.838 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/448571785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 msgr2=0x561152a16580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/448571785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x561152a10a50 tx=0x56115281f920 comp rx=0 tx=0).stop 2024-04-19T23:47:21.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/448571785 shutdown_connections 2024-04-19T23:47:21.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/448571785 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561152aac000 0x561152a17080 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 --2- 172.21.15.155:0/448571785 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56115272e800 0x561152a16580 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/448571785 >> 172.21.15.155:0/448571785 conn(0x56115272e400 msgr2=0x56115281b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/448571785 shutdown_connections 2024-04-19T23:47:21.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.834+0000 7f51d1bb3a80 1 -- 172.21.15.155:0/448571785 wait complete. 2024-04-19T23:47:21.840 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-19T23:47:21.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-19T23:47:21.840 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-19T23:47:21.885 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:47:21.885 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:47:21.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.885+0000 7f4a9db9ba80 1 Processor -- start 2024-04-19T23:47:21.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.885+0000 7f4a9db9ba80 1 -- start start 2024-04-19T23:47:21.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.886+0000 7f4a9db9ba80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.886+0000 7f4a9db9ba80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cafba37500 con 0x55cafb70cc00 2024-04-19T23:47:21.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.886+0000 7f4a9db9ba80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cafb7aea00 con 0x55cafb70c800 2024-04-19T23:47:21.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.886+0000 7f4a9bb45700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.886+0000 7f4a9b344700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55cafb70cc00 0x55cafb7f8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:47674/0 (socket says 172.21.15.155:47674) 2024-04-19T23:47:21.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.886+0000 7f4a9bb45700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38446/0 (socket says 172.21.15.155:38446) 2024-04-19T23:47:21.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.886+0000 7f4a9b344700 1 -- 172.21.15.155:0/671702079 learned_addr learned my addr 172.21.15.155:0/671702079 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:47:21.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.886+0000 7f4a9bb45700 1 -- 172.21.15.155:0/671702079 >> v1:172.21.15.76:6789/0 conn(0x55cafb70cc00 legacy=0x55cafb7f8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.886+0000 7f4a9bb45700 1 -- 172.21.15.155:0/671702079 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cafb735d40 con 0x55cafb70c800 2024-04-19T23:47:21.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.887+0000 7f4a9bb45700 1 --2- 172.21.15.155:0/671702079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55cafb9ef9e0 tx=0x55cafb7fd920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecd3dc70df163d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.887+0000 7f4a9ab43700 1 -- 172.21.15.155:0/671702079 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafb7c54a0 con 0x55cafb70c800 2024-04-19T23:47:21.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.887+0000 7f4a9ab43700 1 -- 172.21.15.155:0/671702079 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cafba37800 con 0x55cafb70c800 2024-04-19T23:47:21.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.887+0000 7f4a9ab43700 1 -- 172.21.15.155:0/671702079 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafb7c5600 con 0x55cafb70c800 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.887+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/671702079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 msgr2=0x55cafb9f4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.887+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/671702079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55cafb9ef9e0 tx=0x55cafb7fd920 comp rx=0 tx=0).stop 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.887+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/671702079 shutdown_connections 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.887+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/671702079 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.887+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/671702079 >> 172.21.15.155:0/671702079 conn(0x55cafb70c400 msgr2=0x55cafb7f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.887+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/671702079 shutdown_connections 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.887+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/671702079 wait complete. 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.888+0000 7f4a9db9ba80 1 Processor -- start 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.888+0000 7f4a9db9ba80 1 -- start start 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.888+0000 7f4a9db9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.888+0000 7f4a9db9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb7ae500 con 0x55cafb70c800 2024-04-19T23:47:21.891 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.888+0000 7f4a9bb45700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.888+0000 7f4a9bb45700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38458/0 (socket says 172.21.15.155:38458) 2024-04-19T23:47:21.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.888+0000 7f4a9bb45700 1 -- 172.21.15.155:0/2718317961 learned_addr learned my addr 172.21.15.155:0/2718317961 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9bb45700 1 -- 172.21.15.155:0/2718317961 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cafb735ba0 con 0x55cafb70c800 2024-04-19T23:47:21.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9bb45700 1 --2- 172.21.15.155:0/2718317961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55cafc4d41e0 tx=0x55cafb7fd800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80917d1d9d169273 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9a342700 1 -- 172.21.15.155:0/2718317961 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafb7c5760 con 0x55cafb70c800 2024-04-19T23:47:21.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9a342700 1 -- 172.21.15.155:0/2718317961 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cafba37b00 con 0x55cafb70c800 2024-04-19T23:47:21.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9a342700 1 -- 172.21.15.155:0/2718317961 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafb7c54a0 con 0x55cafb70c800 2024-04-19T23:47:21.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/2718317961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 msgr2=0x55cafb9f4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/2718317961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55cafc4d41e0 tx=0x55cafb7fd800 comp rx=0 tx=0).stop 2024-04-19T23:47:21.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/2718317961 shutdown_connections 2024-04-19T23:47:21.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/2718317961 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/2718317961 >> 172.21.15.155:0/2718317961 conn(0x55cafb70c400 msgr2=0x55cafb7f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/2718317961 shutdown_connections 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.889+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/2718317961 wait complete. 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.890+0000 7f4a9db9ba80 1 Processor -- start 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.890+0000 7f4a9db9ba80 1 -- start start 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.890+0000 7f4a9db9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.890+0000 7f4a9db9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb7ae3c0 con 0x55cafb70c800 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.890+0000 7f4a9bb45700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.890+0000 7f4a9bb45700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38464/0 (socket says 172.21.15.155:38464) 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.890+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1037524085 learned_addr learned my addr 172.21.15.155:0/1037524085 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.890+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1037524085 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cafb735a00 con 0x55cafb70c800 2024-04-19T23:47:21.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.890+0000 7f4a9bb45700 1 --2- 172.21.15.155:0/1037524085 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x55cafc4d59e0 tx=0x55cafb7fd920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.891+0000 7f4a98b3f700 1 -- 172.21.15.155:0/1037524085 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafb7c5600 con 0x55cafb70c800 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.891+0000 7f4a98b3f700 1 -- 172.21.15.155:0/1037524085 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cafba37c80 con 0x55cafb70c800 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.891+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1037524085 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cafb735860 con 0x55cafb70c800 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.891+0000 7f4a98b3f700 1 -- 172.21.15.155:0/1037524085 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafb7c58c0 con 0x55cafb70c800 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.891+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1037524085 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cafb7356c0 con 0x55cafb70c800 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.891+0000 7f4a9db9ba80 1 Processor -- start 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.891+0000 7f4a9db9ba80 1 -- start start 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.891+0000 7f4a9db9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 0x55cafb9f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.891+0000 7f4a9db9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb7ae000 con 0x55cafb70d400 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.891+0000 7f4a98b3f700 1 -- 172.21.15.155:0/1037524085 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55cafc4aeb00 con 0x55cafb70c800 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a98b3f700 1 --2- 172.21.15.155:0/1037524085 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafba8c000 0x55cafb9f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a9c346700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 0x55cafb9f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a98b3f700 1 -- 172.21.15.155:0/1037524085 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55cafb787180 con 0x55cafb70c800 2024-04-19T23:47:21.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a9c346700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 0x55cafb9f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38466/0 (socket says 172.21.15.155:38466) 2024-04-19T23:47:21.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a9c346700 1 -- 172.21.15.155:0/2715957101 learned_addr learned my addr 172.21.15.155:0/2715957101 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a9bb45700 1 --2- 172.21.15.155:0/1037524085 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafba8c000 0x55cafb9f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a9c346700 1 -- 172.21.15.155:0/2715957101 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cafb734000 con 0x55cafb70d400 2024-04-19T23:47:21.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a9bb45700 1 --2- 172.21.15.155:0/1037524085 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafba8c000 0x55cafb9f5080 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55cafc589080 tx=0x55cafba52780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a9c346700 1 --2- 172.21.15.155:0/2715957101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 0x55cafb9f4b00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x55cafc4d5980 tx=0x55cafba52a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d867ae0f9e540e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a9633a700 1 -- 172.21.15.155:0/2715957101 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafb7c5600 con 0x55cafb70d400 2024-04-19T23:47:21.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a9633a700 1 -- 172.21.15.155:0/2715957101 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cafb7adc80 con 0x55cafb70d400 2024-04-19T23:47:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.892+0000 7f4a9633a700 1 -- 172.21.15.155:0/2715957101 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafb7c58c0 con 0x55cafb70d400 2024-04-19T23:47:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.893+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/2715957101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 msgr2=0x55cafb9f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.893+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/2715957101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 0x55cafb9f4b00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x55cafc4d5980 tx=0x55cafba52a80 comp rx=0 tx=0).stop 2024-04-19T23:47:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.893+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/2715957101 shutdown_connections 2024-04-19T23:47:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.893+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/2715957101 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 0x55cafb9f4b00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.893+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/2715957101 >> 172.21.15.155:0/2715957101 conn(0x55cafb70cc00 msgr2=0x55cafb7f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.893+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/2715957101 shutdown_connections 2024-04-19T23:47:21.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.893+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/2715957101 wait complete. 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.893+0000 7f4a9db9ba80 1 Processor -- start 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.893+0000 7f4a9db9ba80 1 -- start start 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.893+0000 7f4a9db9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 0x55cafb9f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.893+0000 7f4a9db9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb748640 con 0x55cafb70d400 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.894+0000 7f4a9c346700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 0x55cafb9f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.894+0000 7f4a9c346700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 0x55cafb9f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38472/0 (socket says 172.21.15.155:38472) 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.894+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 learned_addr learned my addr 172.21.15.155:0/1697626389 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.894+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cafb734ea0 con 0x55cafb70d400 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.894+0000 7f4a9c346700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 0x55cafb9f4b00 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x55cafc5886c0 tx=0x55cafba525a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.894+0000 7f4a94b37700 1 -- 172.21.15.155:0/1697626389 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafb7c5760 con 0x55cafb70d400 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.894+0000 7f4a94b37700 1 -- 172.21.15.155:0/1697626389 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cafb7adb00 con 0x55cafb70d400 2024-04-19T23:47:21.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.894+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cafb734820 con 0x55cafb70d400 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.894+0000 7f4a94b37700 1 -- 172.21.15.155:0/1697626389 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafb7c5600 con 0x55cafb70d400 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.894+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cafb7349c0 con 0x55cafb70d400 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.895+0000 7f4a94b37700 1 -- 172.21.15.155:0/1697626389 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55cafc4aedc0 con 0x55cafb70d400 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.895+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.895+0000 7f4a94b37700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafba8cc00 0x55cafb9f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.895+0000 7f4a94b37700 1 -- 172.21.15.155:0/1697626389 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55cafb787340 con 0x55cafb70d400 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.895+0000 7f4a9b344700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafba8cc00 0x55cafb9f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.895+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55cafb70d800 0x55cafb9f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.895+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafb70dc00 con 0x55cafb70d800 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9c346700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55cafb70d800 0x55cafb9f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9b344700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafba8cc00 0x55cafb9f5600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55cafc4d4030 tx=0x55cafba53920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9c346700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55cafb70d800 0x55cafb9f5b80 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.923 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9db9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9db9ba80 20 realm 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafba8d000 con 0x55cafb70d800 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9db9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9db9ba80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.896+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafba8d400 con 0x55cafb70d800 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9db9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafba8d800 con 0x55cafb70d800 2024-04-19T23:47:21.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9db9ba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafba8dc00 con 0x55cafb70d800 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9db9ba80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9db9ba80 20 searching for the correct realm 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55cafba8d000 0x55cafb9f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafba8d400 con 0x55cafba8d000 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.897+0000 7f4a9bb45700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55cafba8d000 0x55cafb9f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.898+0000 7f4a9bb45700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55cafba8d000 0x55cafb9f6100 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.898+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.898+0000 7f4a9bb45700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55cafba8d400 0x55cafb9f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.898+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58000 con 0x55cafba8d400 2024-04-19T23:47:21.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.898+0000 7f4a9b344700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55cafba8d400 0x55cafb9f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.898+0000 7f4a9b344700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55cafba8d400 0x55cafb9f6c00 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.898+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.899+0000 7f4a9b344700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55cafbb58000 0x55cafb9f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.899+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafbb58000 2024-04-19T23:47:21.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.899+0000 7f4a9c346700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55cafbb58000 0x55cafb9f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.899+0000 7f4a9c346700 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55cafbb58000 0x55cafb9f7180 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.899+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.899+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafb70d800 2024-04-19T23:47:21.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.900+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.900+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafb70d800 2024-04-19T23:47:21.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.900+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.900+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafb70d800 2024-04-19T23:47:21.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.900+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.900+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafbb58000 2024-04-19T23:47:21.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.900+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.900+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d400 2024-04-19T23:47:21.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.900+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.900+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d000 2024-04-19T23:47:21.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.901+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.901+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafb70d800 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.901+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.901+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafbb58000 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.901+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.901+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafb70d800 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.901+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.901+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d400 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.902+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.902+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d000 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.902+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.902+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d000 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.902+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.902+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d400 2024-04-19T23:47:21.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.902+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.902+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d000 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.902+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.902+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d000 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.902+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.903+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafb70d800 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.903+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.903+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafb70d800 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.903+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.903+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafbb58000 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.903+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.903+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d000 2024-04-19T23:47:21.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.903+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.903+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d400 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.904+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.904+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafb70d800 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.904+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.904+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafbb58000 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.904+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.904+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d000 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.904+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.904+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafbb58000 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.905+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.905+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d400 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.905+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.905+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d000 2024-04-19T23:47:21.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.905+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.905+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafbb58000 2024-04-19T23:47:21.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.905+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.905+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafb70d800 2024-04-19T23:47:21.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d400 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafb70dc00 con 0x55cafb70d800 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58c00 con 0x55cafb70d800 2024-04-19T23:47:21.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.906+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb59000 con 0x55cafba8d400 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 20 zone default found 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 4 Realm: () 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 20 zonegroup default 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb59400 con 0x55cafbb58000 2024-04-19T23:47:21.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb59800 con 0x55cafba8d000 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb59c00 con 0x55cafba8d000 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.907+0000 7f4a9db9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.908+0000 7f4a9db9ba80 20 started sync module instance, tier type = 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.908+0000 7f4a9db9ba80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.908+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58c00 con 0x55cafba8d400 2024-04-19T23:47:21.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.909+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.909+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94330293238528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafb70dc00 con 0x55cafba8d400 2024-04-19T23:47:21.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.909+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafba8d800 con 0x55cafb70d800 2024-04-19T23:47:21.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.910+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94330293238528] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.910+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.910+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94330293239680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafba8dc00 con 0x55cafb70d800 2024-04-19T23:47:21.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.910+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafba8d000 2024-04-19T23:47:21.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.911+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94330293239680] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.911+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.911+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94330293240832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb59000 con 0x55cafba8d000 2024-04-19T23:47:21.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.911+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58c00 con 0x55cafba8d400 2024-04-19T23:47:21.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.912+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94330293240832] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.912+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.912+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94330293241984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58400 con 0x55cafba8d400 2024-04-19T23:47:21.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.912+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb59800 con 0x55cafb70d800 2024-04-19T23:47:21.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.913+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.913+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94330293243136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb59c00 con 0x55cafb70d800 2024-04-19T23:47:21.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.913+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb58800 con 0x55cafbb58000 2024-04-19T23:47:21.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.913+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94330293241984] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.914+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.914+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94330293244288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb59400 con 0x55cafbb58000 2024-04-19T23:47:21.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.914+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb59800 con 0x55cafbb58000 2024-04-19T23:47:21.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.914+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94330293243136] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.915+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94330293244288] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.915+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.915+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94330293245440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb59c00 con 0x55cafbb58000 2024-04-19T23:47:21.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.915+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafba8d800 con 0x55cafbb58000 2024-04-19T23:47:21.948 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T23:47:21.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.916+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.916+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94330293246592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafba8dc00 con 0x55cafbb58000 2024-04-19T23:47:21.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.916+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94330293245440] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.916+0000 7f4a9db9ba80 20 add_watcher() i=0 2024-04-19T23:47:21.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.916+0000 7f4a9db9ba80 20 add_watcher() i=1 2024-04-19T23:47:21.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.916+0000 7f4a9db9ba80 20 add_watcher() i=2 2024-04-19T23:47:21.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.916+0000 7f4a9db9ba80 20 add_watcher() i=3 2024-04-19T23:47:21.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.916+0000 7f4a9db9ba80 20 add_watcher() i=4 2024-04-19T23:47:21.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.916+0000 7f4a9db9ba80 20 add_watcher() i=5 2024-04-19T23:47:21.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.916+0000 7f4a9db9ba80 20 add_watcher() i=6 2024-04-19T23:47:21.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.917+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94330293246592] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.917+0000 7f4a9db9ba80 20 add_watcher() i=7 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.917+0000 7f4a9db9ba80 2 all 8 watchers are set, enabling cache 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.917+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafba8d800 con 0x55cafb70d800 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.917+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.917+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94330294771712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafba8dc00 con 0x55cafb70d800 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.918+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94330294771712] v32'241 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.919+0000 7f4a82b13700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.919+0000 7f4a9db9ba80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.919+0000 7f4a9db9ba80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.919+0000 7f4a9db9ba80 1 Processor -- start 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.919+0000 7f4a9db9ba80 1 -- start start 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.919+0000 7f4a9db9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.919+0000 7f4a9db9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb748780 con 0x55cafbb59400 2024-04-19T23:47:21.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.919+0000 7f4a9b344700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.919+0000 7f4a9b344700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38478/0 (socket says 172.21.15.155:38478) 2024-04-19T23:47:21.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.919+0000 7f4a9b344700 1 -- 172.21.15.155:0/4019081128 learned_addr learned my addr 172.21.15.155:0/4019081128 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.920+0000 7f4a9b344700 1 -- 172.21.15.155:0/4019081128 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cafb734b60 con 0x55cafbb59400 2024-04-19T23:47:21.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.920+0000 7f4a9b344700 1 --2- 172.21.15.155:0/4019081128 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x55cafbb6e0c0 tx=0x55cafba53d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b0a838792745ab server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.951 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.920+0000 7f4a82312700 1 -- 172.21.15.155:0/4019081128 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafbb7e000 con 0x55cafbb59400 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.920+0000 7f4a82312700 1 -- 172.21.15.155:0/4019081128 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cafbb86000 con 0x55cafbb59400 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.920+0000 7f4a82312700 1 -- 172.21.15.155:0/4019081128 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafbb7e160 con 0x55cafbb59400 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.920+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/4019081128 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 msgr2=0x55cafb9f6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.920+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/4019081128 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x55cafbb6e0c0 tx=0x55cafba53d40 comp rx=0 tx=0).stop 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/4019081128 shutdown_connections 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/4019081128 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/4019081128 >> 172.21.15.155:0/4019081128 conn(0x55cafbb58800 msgr2=0x55cafb7fa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/4019081128 shutdown_connections 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/4019081128 wait complete. 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9db9ba80 1 Processor -- start 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9db9ba80 1 -- start start 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9db9ba80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9db9ba80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb7ae000 con 0x55cafbb59400 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9b344700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9b344700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38494/0 (socket says 172.21.15.155:38494) 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.921+0000 7f4a9b344700 1 -- 172.21.15.155:0/3447946063 learned_addr learned my addr 172.21.15.155:0/3447946063 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.922+0000 7f4a9b344700 1 -- 172.21.15.155:0/3447946063 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cafb734d00 con 0x55cafbb59400 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.922+0000 7f4a9b344700 1 --2- 172.21.15.155:0/3447946063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x55cafbb6e2d0 tx=0x55cafba53e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.922+0000 7f4a80b0f700 1 -- 172.21.15.155:0/3447946063 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafbb7e2c0 con 0x55cafbb59400 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.922+0000 7f4a80b0f700 1 -- 172.21.15.155:0/3447946063 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cafbb86180 con 0x55cafbb59400 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.922+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/3447946063 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cafb734340 con 0x55cafbb59400 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.922+0000 7f4a80b0f700 1 -- 172.21.15.155:0/3447946063 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cafbb7e000 con 0x55cafbb59400 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.922+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/3447946063 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cafb734b60 con 0x55cafbb59400 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.923+0000 7f4a80b0f700 1 -- 172.21.15.155:0/3447946063 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55cafc4afb80 con 0x55cafbb59400 2024-04-19T23:47:21.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.923+0000 7f4a80b0f700 1 --2- 172.21.15.155:0/3447946063 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafbbfe000 0x55cafb9f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.923+0000 7f4a80b0f700 1 -- 172.21.15.155:0/3447946063 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55cafb787500 con 0x55cafbb59400 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.923+0000 7f4a9db9ba80 5 note: GC not initialized 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.923+0000 7f4a9c346700 1 --2- 172.21.15.155:0/3447946063 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafbbfe000 0x55cafb9f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.923+0000 7f4a9c346700 1 --2- 172.21.15.155:0/3447946063 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafbbfe000 0x55cafb9f7700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55cafbae7ef0 tx=0x55cafba53b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.924+0000 7f4a7e30a700 20 reqs_thread_entry: start 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.924+0000 7f4a9db9ba80 20 init_complete bucket index max shards: 11 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.924+0000 7f4a9db9ba80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.924+0000 7f4a7c306700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:52 2024 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.924+0000 7f4a7bae4700 20 reqs_thread_entry: start 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.925+0000 7f4a9db9ba80 20 rados->read ofs=0 len=0 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.925+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbb59c00 con 0x55cafb70d800 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.925+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.925+0000 7f4a9db9ba80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:could not fetch user info: no user info saved 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.925+0000 7f4a82b13700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.925+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94330294771712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbbfe400 con 0x55cafb70d800 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.926+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94330294771712] v32'242 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.926+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94330293238528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbbfe800 con 0x55cafba8d400 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.927+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94330293238528] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.928+0000 7f4a9db9ba80 20 remove_watcher() i=0 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.928+0000 7f4a9db9ba80 2 removed watcher, disabling cache 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.928+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94330293239680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbbfec00 con 0x55cafb70d800 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.929+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94330293239680] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.929+0000 7f4a9db9ba80 20 remove_watcher() i=1 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.929+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94330293240832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbbff000 con 0x55cafba8d000 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.930+0000 7f4a9bb45700 1 -- 172.21.15.155:0/1697626389 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94330293240832] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb43200 con 0x55cafba8d000 2024-04-19T23:47:21.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.930+0000 7f4a9db9ba80 20 remove_watcher() i=2 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.930+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94330293241984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbbff400 con 0x55cafba8d400 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.931+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94330293241984] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb43440 con 0x55cafba8d400 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.931+0000 7f4a9db9ba80 20 remove_watcher() i=3 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.931+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94330293243136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbbff800 con 0x55cafb70d800 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.932+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94330293243136] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafb70d800 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.932+0000 7f4a9db9ba80 20 remove_watcher() i=4 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.932+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94330293244288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbbffc00 con 0x55cafbb58000 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.933+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94330293244288] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.933+0000 7f4a9db9ba80 20 remove_watcher() i=5 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.933+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94330293245440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbbfe400 con 0x55cafbb58000 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.934+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94330293245440] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.934+0000 7f4a9db9ba80 20 remove_watcher() i=6 2024-04-19T23:47:21.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.934+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94330293246592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cafbbfec00 con 0x55cafbb58000 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9c346700 1 -- 172.21.15.155:0/1697626389 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94330293246592] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cafbb42b40 con 0x55cafbb58000 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 20 remove_watcher() i=7 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55cafbb58000 msgr2=0x55cafb9f7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55cafbb58000 0x55cafb9f7180 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55cafb70d800 msgr2=0x55cafb9f5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55cafb70d800 0x55cafb9f5b80 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55cafba8d400 msgr2=0x55cafb9f6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55cafba8d400 0x55cafb9f6c00 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55cafba8d000 msgr2=0x55cafb9f6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x55cafba8d000 0x55cafb9f6100 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafba8cc00 msgr2=0x55cafb9f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafba8cc00 0x55cafb9f5600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55cafc4d4030 tx=0x55cafba53920 comp rx=0 tx=0).stop 2024-04-19T23:47:21.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 msgr2=0x55cafb9f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1697626389 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70d400 0x55cafb9f4b00 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x55cafc5886c0 tx=0x55cafba525a0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 reap_dead start 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9b344700 1 -- 172.21.15.155:0/1697626389 reap_dead start 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 shutdown_connections 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 >> 172.21.15.155:0/1697626389 conn(0x55cafb70cc00 msgr2=0x55cafb7f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 shutdown_connections 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1697626389 wait complete. 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/3447946063 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafbbfe000 msgr2=0x55cafb9f7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.935+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/3447946063 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafbbfe000 0x55cafb9f7700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55cafbae7ef0 tx=0x55cafba53b60 comp rx=0 tx=0).stop 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/3447946063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 msgr2=0x55cafb9f6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/3447946063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x55cafbb6e2d0 tx=0x55cafba53e60 comp rx=0 tx=0).stop 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/3447946063 shutdown_connections 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/3447946063 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafbbfe000 0x55cafb9f7700 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/3447946063 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafbb59400 0x55cafb9f6680 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/3447946063 >> 172.21.15.155:0/3447946063 conn(0x55cafbb58800 msgr2=0x55cafb7fa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/3447946063 shutdown_connections 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/3447946063 wait complete. 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1037524085 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafba8c000 msgr2=0x55cafb9f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1037524085 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafba8c000 0x55cafb9f5080 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55cafc589080 tx=0x55cafba52780 comp rx=0 tx=0).stop 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1037524085 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 msgr2=0x55cafb9f4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1037524085 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x55cafc4d59e0 tx=0x55cafb7fd920 comp rx=0 tx=0).stop 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1037524085 shutdown_connections 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1037524085 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55cafba8c000 0x55cafb9f5080 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 --2- 172.21.15.155:0/1037524085 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cafb70c800 0x55cafb9f4580 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1037524085 >> 172.21.15.155:0/1037524085 conn(0x55cafb70c400 msgr2=0x55cafb7f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1037524085 shutdown_connections 2024-04-19T23:47:21.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:21.936+0000 7f4a9db9ba80 1 -- 172.21.15.155:0/1037524085 wait complete. 2024-04-19T23:47:21.960 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-04-19T23:47:21.960 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-04-19T23:47:21.960 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-04-19T23:47:22.004 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:47:22.004 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:47:22.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.004+0000 7fda0ab31a80 1 Processor -- start 2024-04-19T23:47:22.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda0ab31a80 1 -- start start 2024-04-19T23:47:22.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda0ab31a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55c149298c00 0x55c149580580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda0ab31a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c1495c3500 con 0x55c149298800 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda0ab31a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c14933aa00 con 0x55c149298c00 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda082da700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55c149298c00 0x55c149580580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda08adb700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55c149298800 0x55c149384800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:47676/0 (socket says 172.21.15.155:47676) 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda082da700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55c149298c00 0x55c149580580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38504/0 (socket says 172.21.15.155:38504) 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda08adb700 1 -- 172.21.15.155:0/3068467600 learned_addr learned my addr 172.21.15.155:0/3068467600 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda082da700 1 -- 172.21.15.155:0/3068467600 >> v1:172.21.15.76:6789/0 conn(0x55c149298800 legacy=0x55c149384800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda082da700 1 -- 172.21.15.155:0/3068467600 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1492c1d40 con 0x55c149298c00 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda082da700 1 --2- 172.21.15.155:0/3068467600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298c00 0x55c149580580 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55c14957b890 tx=0x55c149389920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a5d2020a680a15 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.005+0000 7fda07ad9700 1 -- 172.21.15.155:0/3068467600 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c1493514a0 con 0x55c149298c00 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.006+0000 7fda07ad9700 1 -- 172.21.15.155:0/3068467600 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c1495c3800 con 0x55c149298c00 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.006+0000 7fda07ad9700 1 -- 172.21.15.155:0/3068467600 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c149351600 con 0x55c149298c00 2024-04-19T23:47:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.006+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3068467600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298c00 msgr2=0x55c149580580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.006+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/3068467600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298c00 0x55c149580580 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55c14957b890 tx=0x55c149389920 comp rx=0 tx=0).stop 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.006+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3068467600 shutdown_connections 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.006+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/3068467600 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298c00 0x55c149580580 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.006+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3068467600 >> 172.21.15.155:0/3068467600 conn(0x55c149298400 msgr2=0x55c149384000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.006+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3068467600 shutdown_connections 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.006+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3068467600 wait complete. 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda0ab31a80 1 Processor -- start 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda0ab31a80 1 -- start start 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda0ab31a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda0ab31a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c14933a500 con 0x55c149298800 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda08adb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda08adb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38512/0 (socket says 172.21.15.155:38512) 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda08adb700 1 -- 172.21.15.155:0/1117977951 learned_addr learned my addr 172.21.15.155:0/1117977951 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda08adb700 1 -- 172.21.15.155:0/1117977951 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1492c1ba0 con 0x55c149298800 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda08adb700 1 --2- 172.21.15.155:0/1117977951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x55c14a071800 tx=0x55c149389b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242fefa2fd7c5689 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda072d8700 1 -- 172.21.15.155:0/1117977951 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c1493514a0 con 0x55c149298800 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda072d8700 1 -- 172.21.15.155:0/1117977951 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c1495c3b00 con 0x55c149298800 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.007+0000 7fda072d8700 1 -- 172.21.15.155:0/1117977951 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c149351600 con 0x55c149298800 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1117977951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 msgr2=0x55c149580580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/1117977951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x55c14a071800 tx=0x55c149389b60 comp rx=0 tx=0).stop 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1117977951 shutdown_connections 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/1117977951 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1117977951 >> 172.21.15.155:0/1117977951 conn(0x55c149298400 msgr2=0x55c149385000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1117977951 shutdown_connections 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1117977951 wait complete. 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda0ab31a80 1 Processor -- start 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda0ab31a80 1 -- start start 2024-04-19T23:47:22.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda0ab31a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda0ab31a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c14933a3c0 con 0x55c149298800 2024-04-19T23:47:22.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda08adb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.008+0000 7fda08adb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38520/0 (socket says 172.21.15.155:38520) 2024-04-19T23:47:22.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.009+0000 7fda08adb700 1 -- 172.21.15.155:0/202446425 learned_addr learned my addr 172.21.15.155:0/202446425 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.009+0000 7fda08adb700 1 -- 172.21.15.155:0/202446425 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1492c1a00 con 0x55c149298800 2024-04-19T23:47:22.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.009+0000 7fda08adb700 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x55c14a071a40 tx=0x55c149389a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.009+0000 7fda05ad5700 1 -- 172.21.15.155:0/202446425 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c1493518c0 con 0x55c149298800 2024-04-19T23:47:22.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.009+0000 7fda0ab31a80 1 -- 172.21.15.155:0/202446425 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c1492c1860 con 0x55c149298800 2024-04-19T23:47:22.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.009+0000 7fda05ad5700 1 -- 172.21.15.155:0/202446425 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c149339c80 con 0x55c149298800 2024-04-19T23:47:22.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.009+0000 7fda05ad5700 1 -- 172.21.15.155:0/202446425 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c1493514a0 con 0x55c149298800 2024-04-19T23:47:22.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.009+0000 7fda0ab31a80 1 -- 172.21.15.155:0/202446425 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1492c16c0 con 0x55c149298800 2024-04-19T23:47:22.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda0ab31a80 1 Processor -- start 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda0ab31a80 1 -- start start 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda05ad5700 1 -- 172.21.15.155:0/202446425 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c14a03ab00 con 0x55c149298800 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda0ab31a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda0ab31a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c14933a000 con 0x55c149299400 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda05ad5700 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624000 0x55c149581080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda05ad5700 1 -- 172.21.15.155:0/202446425 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55c149313180 con 0x55c149298800 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda092dc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda08adb700 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624000 0x55c149581080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda092dc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38530/0 (socket says 172.21.15.155:38530) 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda092dc700 1 -- 172.21.15.155:0/1667123291 learned_addr learned my addr 172.21.15.155:0/1667123291 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda092dc700 1 -- 172.21.15.155:0/1667123291 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1492c0000 con 0x55c149299400 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.010+0000 7fda08adb700 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624000 0x55c149581080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55c14a11af90 tx=0x55c1495e8240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda092dc700 1 --2- 172.21.15.155:0/1667123291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x55c14a11a870 tx=0x55c1495e8d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07f11d8aae04806 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda032d0700 1 -- 172.21.15.155:0/1667123291 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c1493518c0 con 0x55c149299400 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda032d0700 1 -- 172.21.15.155:0/1667123291 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c1495c2300 con 0x55c149299400 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda032d0700 1 -- 172.21.15.155:0/1667123291 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c1493514a0 con 0x55c149299400 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1667123291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 msgr2=0x55c149580b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/1667123291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x55c14a11a870 tx=0x55c1495e8d20 comp rx=0 tx=0).stop 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1667123291 shutdown_connections 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/1667123291 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1667123291 >> 172.21.15.155:0/1667123291 conn(0x55c149298c00 msgr2=0x55c149385800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1667123291 shutdown_connections 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1667123291 wait complete. 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda0ab31a80 1 Processor -- start 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.011+0000 7fda0ab31a80 1 -- start start 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda0ab31a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda0ab31a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1492d4640 con 0x55c149299400 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda092dc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda092dc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38536/0 (socket says 172.21.15.155:38536) 2024-04-19T23:47:22.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda092dc700 1 -- 172.21.15.155:0/1812221733 learned_addr learned my addr 172.21.15.155:0/1812221733 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda092dc700 1 -- 172.21.15.155:0/1812221733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1492c0ea0 con 0x55c149299400 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda092dc700 1 --2- 172.21.15.155:0/1812221733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55c14a11a8d0 tx=0x55c1495e8120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda01acd700 1 -- 172.21.15.155:0/1812221733 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c149351b80 con 0x55c149299400 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda01acd700 1 -- 172.21.15.155:0/1812221733 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c149339c80 con 0x55c149299400 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1812221733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c1492c0820 con 0x55c149299400 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda01acd700 1 -- 172.21.15.155:0/1812221733 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c1493518c0 con 0x55c149299400 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.012+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1812221733 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1492c09c0 con 0x55c149299400 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.013+0000 7fda0ab31a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.013+0000 7fda0ab31a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.013+0000 7fda01acd700 1 -- 172.21.15.155:0/1812221733 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c14a03adc0 con 0x55c149299400 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.013+0000 7fda0ab31a80 1 Processor -- start 2024-04-19T23:47:22.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda0ab31a80 1 -- start start 2024-04-19T23:47:22.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda01acd700 1 --2- 172.21.15.155:0/1812221733 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624c00 0x55c149581600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda01acd700 1 -- 172.21.15.155:0/1812221733 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55c149313340 con 0x55c149299400 2024-04-19T23:47:22.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda0ab31a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda0ab31a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1492d48c0 con 0x55c149299c00 2024-04-19T23:47:22.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda092dc700 1 --2- 172.21.15.155:0/1812221733 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624c00 0x55c149581600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda08adb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda08adb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38544/0 (socket says 172.21.15.155:38544) 2024-04-19T23:47:22.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda08adb700 1 -- 172.21.15.155:0/2449522798 learned_addr learned my addr 172.21.15.155:0/2449522798 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda092dc700 1 --2- 172.21.15.155:0/1812221733 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624c00 0x55c149581600 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55c14968e210 tx=0x55c1495e93e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda08adb700 1 -- 172.21.15.155:0/2449522798 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1492c0b60 con 0x55c149299c00 2024-04-19T23:47:22.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fda08adb700 1 --2- 172.21.15.155:0/2449522798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55c1496274a0 tx=0x55c1495e8c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecbc9464eea025e server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fd9efaa9700 1 -- 172.21.15.155:0/2449522798 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c149351600 con 0x55c149299c00 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fd9efaa9700 1 -- 172.21.15.155:0/2449522798 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c149339c80 con 0x55c149299c00 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.014+0000 7fd9efaa9700 1 -- 172.21.15.155:0/2449522798 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c149351a20 con 0x55c149299c00 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda0ab31a80 1 -- 172.21.15.155:0/2449522798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 msgr2=0x55c149581b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/2449522798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55c1496274a0 tx=0x55c1495e8c00 comp rx=0 tx=0).stop 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda0ab31a80 1 -- 172.21.15.155:0/2449522798 shutdown_connections 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/2449522798 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda0ab31a80 1 -- 172.21.15.155:0/2449522798 >> 172.21.15.155:0/2449522798 conn(0x55c149299800 msgr2=0x55c149386000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda0ab31a80 1 -- 172.21.15.155:0/2449522798 shutdown_connections 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda0ab31a80 1 -- 172.21.15.155:0/2449522798 wait complete. 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda0ab31a80 1 Processor -- start 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda0ab31a80 1 -- start start 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda0ab31a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda0ab31a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1492d4f00 con 0x55c149299c00 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.015+0000 7fda08adb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.016+0000 7fda08adb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38556/0 (socket says 172.21.15.155:38556) 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.016+0000 7fda08adb700 1 -- 172.21.15.155:0/3640437368 learned_addr learned my addr 172.21.15.155:0/3640437368 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.016+0000 7fda08adb700 1 -- 172.21.15.155:0/3640437368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1492c0d00 con 0x55c149299c00 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.016+0000 7fda08adb700 1 --2- 172.21.15.155:0/3640437368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55c14968fda0 tx=0x55c1495e81e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.016+0000 7fd9ee2a6700 1 -- 172.21.15.155:0/3640437368 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c149351600 con 0x55c149299c00 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.016+0000 7fd9ee2a6700 1 -- 172.21.15.155:0/3640437368 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c1496e2000 con 0x55c149299c00 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.016+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3640437368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c1492c0340 con 0x55c149299c00 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.016+0000 7fd9ee2a6700 1 -- 172.21.15.155:0/3640437368 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c149351a20 con 0x55c149299c00 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.016+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3640437368 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1496ea000 con 0x55c149299c00 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.017+0000 7fd9ee2a6700 1 -- 172.21.15.155:0/3640437368 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55c14a03bb80 con 0x55c149299c00 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.017+0000 7fd9ee2a6700 1 --2- 172.21.15.155:0/3640437368 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c14974a000 0x55c149582c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.017+0000 7fd9ee2a6700 1 -- 172.21.15.155:0/3640437368 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55c149313500 con 0x55c149299c00 2024-04-19T23:47:22.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.017+0000 7fda082da700 1 --2- 172.21.15.155:0/3640437368 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c14974a000 0x55c149582c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.017+0000 7fd9ec2a2700 20 reqs_thread_entry: start 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.017+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c149625c00 0x55c149582100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.017+0000 7fda0ab31a80 1 -- 172.21.15.155:0/202446425 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c14974a400 con 0x55c149625c00 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.017+0000 7fda092dc700 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c149625c00 0x55c149582100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.017+0000 7fda082da700 1 --2- 172.21.15.155:0/3640437368 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c14974a000 0x55c149582c00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c14957b890 tx=0x55c149389800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.018+0000 7fda092dc700 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c149625c00 0x55c149582100 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.018+0000 7fda092dc700 1 -- 172.21.15.155:0/202446425 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55c14975e240 con 0x55c149625c00 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.018+0000 7fda0ab31a80 1 -- 172.21.15.155:0/202446425 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c14974a800 con 0x55c149625c00 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.018+0000 7fda092dc700 1 -- 172.21.15.155:0/202446425 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x55c14975e240 con 0x55c149625c00 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1812221733 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624c00 msgr2=0x55c149581600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/1812221733 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624c00 0x55c149581600 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55c14968e210 tx=0x55c1495e93e0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1812221733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 msgr2=0x55c149580b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/1812221733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55c14a11a8d0 tx=0x55c1495e8120 comp rx=0 tx=0).stop 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1812221733 shutdown_connections 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/1812221733 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624c00 0x55c149581600 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/1812221733 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299400 0x55c149580b00 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1812221733 >> 172.21.15.155:0/1812221733 conn(0x55c149298c00 msgr2=0x55c149385800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1812221733 shutdown_connections 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/1812221733 wait complete. 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3640437368 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c14974a000 msgr2=0x55c149582c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/3640437368 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c14974a000 0x55c149582c00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c14957b890 tx=0x55c149389800 comp rx=0 tx=0).stop 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3640437368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 msgr2=0x55c149581b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/3640437368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55c14968fda0 tx=0x55c1495e81e0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3640437368 shutdown_connections 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/3640437368 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c14974a000 0x55c149582c00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/3640437368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149299c00 0x55c149581b80 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3640437368 >> 172.21.15.155:0/3640437368 conn(0x55c149299800 msgr2=0x55c149386000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3640437368 shutdown_connections 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.019+0000 7fda0ab31a80 1 -- 172.21.15.155:0/3640437368 wait complete. 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 -- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c149625c00 msgr2=0x55c149582100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c149625c00 0x55c149582100 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 -- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624000 msgr2=0x55c149581080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624000 0x55c149581080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55c14a11af90 tx=0x55c1495e8240 comp rx=0 tx=0).stop 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 -- 172.21.15.155:0/202446425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 msgr2=0x55c149580580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x55c14a071a40 tx=0x55c149389a40 comp rx=0 tx=0).stop 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 -- 172.21.15.155:0/202446425 shutdown_connections 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55c149625c00 0x55c149582100 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55c149298800 0x55c149580580 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 --2- 172.21.15.155:0/202446425 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55c149624000 0x55c149581080 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 -- 172.21.15.155:0/202446425 >> 172.21.15.155:0/202446425 conn(0x55c149298400 msgr2=0x55c149385000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 -- 172.21.15.155:0/202446425 shutdown_connections 2024-04-19T23:47:22.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.020+0000 7fda0ab31a80 1 -- 172.21.15.155:0/202446425 wait complete. 2024-04-19T23:47:22.033 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:47:22.033 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87", 2024-04-19T23:47:22.033 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "default", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "domain_root": "default.rgw.meta:root", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "control_pool": "default.rgw.control", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "gc_pool": "default.rgw.log:gc", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "lc_pool": "default.rgw.log:lc", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "log_pool": "default.rgw.log", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "intent_log_pool": "default.rgw.log:intent", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "usage_log_pool": "default.rgw.log:usage", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "roles_pool": "default.rgw.meta:roles", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "reshard_pool": "default.rgw.log:reshard", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "user_email_pool": "default.rgw.meta:users.email", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2024-04-19T23:47:22.034 INFO:teuthology.orchestra.run.smithi155.stdout: "otp_pool": "default.rgw.otp", 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "system_key": { 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "", 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "" 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_pools": [ 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "default-placement", 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "val": { 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": "default.rgw.buckets.index", 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "storage_classes": { 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "STANDARD": { 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": "default.rgw.buckets.data" 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.035 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-04-19T23:47:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: "index_type": 0, 2024-04-19T23:47:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: "inline_data": true 2024-04-19T23:47:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:47:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: "realm_id": "", 2024-04-19T23:47:22.036 INFO:teuthology.orchestra.run.smithi155.stdout: "notif_pool": "default.rgw.log:notif" 2024-04-19T23:47:22.036 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:47:22.036 DEBUG:tasks.util.rgw: json result: {'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-04-19T23:47:22.037 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-04-19T23:47:22.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-04-19T23:47:22.037 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-04-19T23:47:22.080 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:47:22.080 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:47:22.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.080+0000 7fc5f3147a80 1 Processor -- start 2024-04-19T23:47:22.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.080+0000 7fc5f3147a80 1 -- start start 2024-04-19T23:47:22.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.081+0000 7fc5f3147a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5595f4768800 0x5595f4a50580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.081+0000 7fc5f3147a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5595f4a93500 con 0x5595f4768c00 2024-04-19T23:47:22.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.081+0000 7fc5f3147a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5595f480aa00 con 0x5595f4768800 2024-04-19T23:47:22.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.081+0000 7fc5f10f1700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5595f4768800 0x5595f4a50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.081+0000 7fc5f10f1700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5595f4768800 0x5595f4a50580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38560/0 (socket says 172.21.15.155:38560) 2024-04-19T23:47:22.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.081+0000 7fc5f10f1700 1 -- 172.21.15.155:0/3360018289 learned_addr learned my addr 172.21.15.155:0/3360018289 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.081+0000 7fc5f10f1700 1 -- 172.21.15.155:0/3360018289 >> v1:172.21.15.76:6789/0 conn(0x5595f4768c00 legacy=0x5595f4854800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.081+0000 7fc5f10f1700 1 -- 172.21.15.155:0/3360018289 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f4791d40 con 0x5595f4768800 2024-04-19T23:47:22.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.081+0000 7fc5f10f1700 1 --2- 172.21.15.155:0/3360018289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x5595f4a4b9e0 tx=0x5595f4859920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e321682fc003d8d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.082+0000 7fc5f00ef700 1 -- 172.21.15.155:0/3360018289 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f48214a0 con 0x5595f4768800 2024-04-19T23:47:22.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.082+0000 7fc5f00ef700 1 -- 172.21.15.155:0/3360018289 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595f4a93800 con 0x5595f4768800 2024-04-19T23:47:22.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.082+0000 7fc5f00ef700 1 -- 172.21.15.155:0/3360018289 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f4821600 con 0x5595f4768800 2024-04-19T23:47:22.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.082+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3360018289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 msgr2=0x5595f4a50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.082+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/3360018289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x5595f4a4b9e0 tx=0x5595f4859920 comp rx=0 tx=0).stop 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.082+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3360018289 shutdown_connections 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.082+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/3360018289 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.082+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3360018289 >> 172.21.15.155:0/3360018289 conn(0x5595f4768400 msgr2=0x5595f4854000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.082+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3360018289 shutdown_connections 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.082+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3360018289 wait complete. 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.083+0000 7fc5f3147a80 1 Processor -- start 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.083+0000 7fc5f3147a80 1 -- start start 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.083+0000 7fc5f3147a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.083+0000 7fc5f3147a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f480a500 con 0x5595f4768800 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.083+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.083+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38566/0 (socket says 172.21.15.155:38566) 2024-04-19T23:47:22.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.083+0000 7fc5f10f1700 1 -- 172.21.15.155:0/196895838 learned_addr learned my addr 172.21.15.155:0/196895838 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5f10f1700 1 -- 172.21.15.155:0/196895838 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f4791ba0 con 0x5595f4768800 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5f10f1700 1 --2- 172.21.15.155:0/196895838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x5595f553a1b0 tx=0x5595f4859800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ed4b4cf021ea6a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5ef8ee700 1 -- 172.21.15.155:0/196895838 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f4821760 con 0x5595f4768800 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5ef8ee700 1 -- 172.21.15.155:0/196895838 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595f4a93b00 con 0x5595f4768800 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5ef8ee700 1 -- 172.21.15.155:0/196895838 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f48211e0 con 0x5595f4768800 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5f3147a80 1 -- 172.21.15.155:0/196895838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 msgr2=0x5595f4a50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/196895838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x5595f553a1b0 tx=0x5595f4859800 comp rx=0 tx=0).stop 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5f3147a80 1 -- 172.21.15.155:0/196895838 shutdown_connections 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/196895838 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5f3147a80 1 -- 172.21.15.155:0/196895838 >> 172.21.15.155:0/196895838 conn(0x5595f4768400 msgr2=0x5595f4855000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5f3147a80 1 -- 172.21.15.155:0/196895838 shutdown_connections 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.084+0000 7fc5f3147a80 1 -- 172.21.15.155:0/196895838 wait complete. 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5f3147a80 1 Processor -- start 2024-04-19T23:47:22.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5f3147a80 1 -- start start 2024-04-19T23:47:22.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5f3147a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5f3147a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f480a3c0 con 0x5595f4768800 2024-04-19T23:47:22.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38568/0 (socket says 172.21.15.155:38568) 2024-04-19T23:47:22.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 learned_addr learned my addr 172.21.15.155:0/2765920032 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f4791a00 con 0x5595f4768800 2024-04-19T23:47:22.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5f10f1700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x5595f553b9b0 tx=0x5595f4859920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5ee0eb700 1 -- 172.21.15.155:0/2765920032 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f48214a0 con 0x5595f4768800 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5ee0eb700 1 -- 172.21.15.155:0/2765920032 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595f4a93c80 con 0x5595f4768800 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595f4791860 con 0x5595f4768800 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5ee0eb700 1 -- 172.21.15.155:0/2765920032 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f4821600 con 0x5595f4768800 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.085+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595f47916c0 con 0x5595f4768800 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.086+0000 7fc5f3147a80 1 Processor -- start 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.086+0000 7fc5f3147a80 1 -- start start 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.086+0000 7fc5ee0eb700 1 -- 172.21.15.155:0/2765920032 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5595f550ab00 con 0x5595f4768800 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.086+0000 7fc5ee0eb700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4769400 0x5595f4a51080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.086+0000 7fc5f3147a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.086+0000 7fc5f3147a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f480a000 con 0x5595f4769800 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.086+0000 7fc5ee0eb700 1 -- 172.21.15.155:0/2765920032 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5595f47e3180 con 0x5595f4768800 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.086+0000 7fc5f18f2700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4769400 0x5595f4a51080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.086+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.086+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38578/0 (socket says 172.21.15.155:38578) 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.086+0000 7fc5f10f1700 1 -- 172.21.15.155:0/1360211998 learned_addr learned my addr 172.21.15.155:0/1360211998 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5f10f1700 1 -- 172.21.15.155:0/1360211998 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f4790000 con 0x5595f4769800 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5f18f2700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4769400 0x5595f4a51080 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5595f553baa0 tx=0x5595f4aac780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5f10f1700 1 --2- 172.21.15.155:0/1360211998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x5595f55f4300 tx=0x5595f4aac8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c471409cbceb09d server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5eb8e6700 1 -- 172.21.15.155:0/1360211998 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f48214a0 con 0x5595f4769800 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5eb8e6700 1 -- 172.21.15.155:0/1360211998 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595f4a93c80 con 0x5595f4769800 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5eb8e6700 1 -- 172.21.15.155:0/1360211998 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f4821600 con 0x5595f4769800 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5f3147a80 1 -- 172.21.15.155:0/1360211998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 msgr2=0x5595f4a50b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/1360211998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x5595f55f4300 tx=0x5595f4aac8a0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5f3147a80 1 -- 172.21.15.155:0/1360211998 shutdown_connections 2024-04-19T23:47:22.094 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/1360211998 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5f3147a80 1 -- 172.21.15.155:0/1360211998 >> 172.21.15.155:0/1360211998 conn(0x5595f4768c00 msgr2=0x5595f4855800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5f3147a80 1 -- 172.21.15.155:0/1360211998 shutdown_connections 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.087+0000 7fc5f3147a80 1 -- 172.21.15.155:0/1360211998 wait complete. 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.088+0000 7fc5f3147a80 1 Processor -- start 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.088+0000 7fc5f3147a80 1 -- start start 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.088+0000 7fc5f3147a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.088+0000 7fc5f3147a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f47a4640 con 0x5595f4769800 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.088+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.088+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38586/0 (socket says 172.21.15.155:38586) 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.088+0000 7fc5f10f1700 1 -- 172.21.15.155:0/529858455 learned_addr learned my addr 172.21.15.155:0/529858455 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.088+0000 7fc5f10f1700 1 -- 172.21.15.155:0/529858455 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f4790ea0 con 0x5595f4769800 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.089+0000 7fc5f10f1700 1 --2- 172.21.15.155:0/529858455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x5595f4b02c00 tx=0x5595f4aaca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.089+0000 7fc5ea0e3700 1 -- 172.21.15.155:0/529858455 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f4821760 con 0x5595f4769800 2024-04-19T23:47:22.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.089+0000 7fc5ea0e3700 1 -- 172.21.15.155:0/529858455 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595f4809e00 con 0x5595f4769800 2024-04-19T23:47:22.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.089+0000 7fc5f3147a80 1 -- 172.21.15.155:0/529858455 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595f4790820 con 0x5595f4769800 2024-04-19T23:47:22.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.089+0000 7fc5ea0e3700 1 -- 172.21.15.155:0/529858455 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f48211e0 con 0x5595f4769800 2024-04-19T23:47:22.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.089+0000 7fc5f3147a80 1 -- 172.21.15.155:0/529858455 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595f47909c0 con 0x5595f4769800 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.089+0000 7fc5ea0e3700 1 -- 172.21.15.155:0/529858455 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5595f550adc0 con 0x5595f4769800 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5ea0e3700 1 --2- 172.21.15.155:0/529858455 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4b06c00 0x5595f4a51600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5ea0e3700 1 -- 172.21.15.155:0/529858455 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5595f47e3340 con 0x5595f4769800 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5f08f0700 1 --2- 172.21.15.155:0/529858455 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4b06c00 0x5595f4a51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5f3147a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5f3147a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5f3147a80 1 Processor -- start 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5f3147a80 1 -- start start 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5f08f0700 1 --2- 172.21.15.155:0/529858455 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4b06c00 0x5595f4a51600 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5595f4a4bf80 tx=0x5595f4aad860 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5f3147a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5f3147a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f47a48c0 con 0x5595f4b07000 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38596/0 (socket says 172.21.15.155:38596) 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.090+0000 7fc5f10f1700 1 -- 172.21.15.155:0/207934133 learned_addr learned my addr 172.21.15.155:0/207934133 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5f10f1700 1 -- 172.21.15.155:0/207934133 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f4790b60 con 0x5595f4b07000 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5f10f1700 1 --2- 172.21.15.155:0/207934133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x5595f4b18390 tx=0x5595f4aacf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93179213149254ea server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5d80bf700 1 -- 172.21.15.155:0/207934133 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f4821760 con 0x5595f4b07000 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5d80bf700 1 -- 172.21.15.155:0/207934133 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595f4809b00 con 0x5595f4b07000 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5d80bf700 1 -- 172.21.15.155:0/207934133 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f48211e0 con 0x5595f4b07000 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5f3147a80 1 -- 172.21.15.155:0/207934133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 msgr2=0x5595f4a51b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/207934133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x5595f4b18390 tx=0x5595f4aacf60 comp rx=0 tx=0).stop 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5f3147a80 1 -- 172.21.15.155:0/207934133 shutdown_connections 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/207934133 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5f3147a80 1 -- 172.21.15.155:0/207934133 >> 172.21.15.155:0/207934133 conn(0x5595f4769c00 msgr2=0x5595f4856000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5f3147a80 1 -- 172.21.15.155:0/207934133 shutdown_connections 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.091+0000 7fc5f3147a80 1 -- 172.21.15.155:0/207934133 wait complete. 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.092+0000 7fc5f3147a80 1 Processor -- start 2024-04-19T23:47:22.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.092+0000 7fc5f3147a80 1 -- start start 2024-04-19T23:47:22.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.092+0000 7fc5f3147a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.092+0000 7fc5f3147a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f47a4f00 con 0x5595f4b07000 2024-04-19T23:47:22.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.092+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.092+0000 7fc5f10f1700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38602/0 (socket says 172.21.15.155:38602) 2024-04-19T23:47:22.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.092+0000 7fc5f10f1700 1 -- 172.21.15.155:0/3732199246 learned_addr learned my addr 172.21.15.155:0/3732199246 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.092+0000 7fc5f10f1700 1 -- 172.21.15.155:0/3732199246 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f4790d00 con 0x5595f4b07000 2024-04-19T23:47:22.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.093+0000 7fc5f10f1700 1 --2- 172.21.15.155:0/3732199246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x5595f4b192f0 tx=0x5595f4aaccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.093+0000 7fc5d68bc700 1 -- 172.21.15.155:0/3732199246 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f48214a0 con 0x5595f4b07000 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.093+0000 7fc5d68bc700 1 -- 172.21.15.155:0/3732199246 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595f4809e00 con 0x5595f4b07000 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.093+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3732199246 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595f4790340 con 0x5595f4b07000 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.093+0000 7fc5d68bc700 1 -- 172.21.15.155:0/3732199246 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5595f4821600 con 0x5595f4b07000 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.093+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3732199246 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595f4b84000 con 0x5595f4b07000 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.093+0000 7fc5d68bc700 1 -- 172.21.15.155:0/3732199246 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x5595f550b080 con 0x5595f4b07000 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.094+0000 7fc5d48b8700 20 reqs_thread_entry: start 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.094+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5595f4b07800 0x5595f4a52100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.094+0000 7fc5d68bc700 1 --2- 172.21.15.155:0/3732199246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4bfa000 0x5595f4a52c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.094+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4b07c00 con 0x5595f4b07800 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.094+0000 7fc5d68bc700 1 -- 172.21.15.155:0/3732199246 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5595f47e3500 con 0x5595f4b07000 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.094+0000 7fc5f08f0700 1 --2- 172.21.15.155:0/3732199246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4bfa000 0x5595f4a52c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.094+0000 7fc5f18f2700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5595f4b07800 0x5595f4a52100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.094+0000 7fc5f08f0700 1 --2- 172.21.15.155:0/3732199246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4bfa000 0x5595f4a52c00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5595f4b193e0 tx=0x5595f4aad7a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.094+0000 7fc5f18f2700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5595f4b07800 0x5595f4a52100 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.094+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.094+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa400 con 0x5595f4b07800 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.095+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.095+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4b07800 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.095+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.095+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfac00 con 0x5595f4b07800 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.095+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:NOTICE: set zone's realm_id= 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.095+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5595f4bfb000 0x5595f4a52680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.095+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfb400 con 0x5595f4bfb000 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.095+0000 7fc5f10f1700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5595f4bfb000 0x5595f4a52680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.096+0000 7fc5f10f1700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5595f4bfb000 0x5595f4a52680 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.096+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04900 con 0x5595f4bfb000 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.096+0000 7fc5f10f1700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5595f4bfb400 0x5595f4a53180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.096+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa400 con 0x5595f4bfb400 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.096+0000 7fc5f08f0700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5595f4bfb400 0x5595f4a53180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.096+0000 7fc5f08f0700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5595f4bfb400 0x5595f4a53180 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.097+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04b40 con 0x5595f4bfb400 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.097+0000 7fc5f08f0700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5595f4bfa400 0x5595f4a53700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.097+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfbc00 con 0x5595f4bfa400 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.097+0000 7fc5f18f2700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5595f4bfa400 0x5595f4a53700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.097+0000 7fc5f18f2700 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5595f4bfa400 0x5595f4a53700 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.098+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4bfa400 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.098+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4b07800 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.098+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.098+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4b07800 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.098+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.098+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4b07800 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.098+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.098+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfa400 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.098+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4bfa400 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.098+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb400 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.099+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04b40 con 0x5595f4bfb400 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.099+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb000 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.099+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04900 con 0x5595f4bfb000 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.099+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4b07800 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.099+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.099+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfa400 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.099+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4bfa400 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.099+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4b07800 2024-04-19T23:47:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.100+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.100+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb400 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.100+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04b40 con 0x5595f4bfb400 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.100+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb000 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.100+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04900 con 0x5595f4bfb000 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.100+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb000 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.100+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04900 con 0x5595f4bfb000 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.100+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb400 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.100+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04b40 con 0x5595f4bfb400 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.100+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb000 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.101+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04900 con 0x5595f4bfb000 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.101+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb000 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.101+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04900 con 0x5595f4bfb000 2024-04-19T23:47:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.101+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4b07800 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.101+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.101+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4b07800 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.101+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.101+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfa400 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.102+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4bfa400 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.102+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb000 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.102+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04900 con 0x5595f4bfb000 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.102+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb400 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.102+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04b40 con 0x5595f4bfb400 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.102+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4b07800 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.102+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.102+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfa400 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.103+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4bfa400 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.103+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb000 2024-04-19T23:47:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.103+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04900 con 0x5595f4bfb000 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.103+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfa400 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.103+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4bfa400 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.103+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb400 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.103+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04b40 con 0x5595f4bfb400 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.103+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb000 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.104+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04900 con 0x5595f4bfb000 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.104+0000 7fc5f10f1700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfa400 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.104+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4bfa400 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.104+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4b07800 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.104+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(35 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.104+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4bfa800 con 0x5595f4bfb400 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.104+0000 7fc5f08f0700 1 -- 172.21.15.155:0/2765920032 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(36 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5595f4c04b40 con 0x5595f4bfb400 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.104+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4c2a000 con 0x5595f4b07800 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.105+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.105+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4c2a400 con 0x5595f4b07800 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.105+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.105+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [create,call version.set in=58b,writefull 0~1036 in=1036b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4c2a800 con 0x5595f4b07800 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.106+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [create,call,writefull 0~1036] v32'3 uv3 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.106+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4c2ac00 con 0x5595f4b07800 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.107+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'3 uv3 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.107+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5595f4c2b000 con 0x5595f4b07800 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.108+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'1 uv1 ondisk = 0) v8 ==== 199+0+0 (crc 0 0 0) 0x5595f4c04240 con 0x5595f4b07800 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/529858455 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4b06c00 msgr2=0x5595f4a51600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/529858455 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4b06c00 0x5595f4a51600 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5595f4a4bf80 tx=0x5595f4aad860 comp rx=0 tx=0).stop 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/529858455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 msgr2=0x5595f4a50b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/529858455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x5595f4b02c00 tx=0x5595f4aaca80 comp rx=0 tx=0).stop 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/529858455 shutdown_connections 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/529858455 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4b06c00 0x5595f4a51600 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/529858455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4769800 0x5595f4a50b00 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/529858455 >> 172.21.15.155:0/529858455 conn(0x5595f4768c00 msgr2=0x5595f4855800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/529858455 shutdown_connections 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/529858455 wait complete. 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3732199246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4bfa000 msgr2=0x5595f4a52c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/3732199246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4bfa000 0x5595f4a52c00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5595f4b193e0 tx=0x5595f4aad7a0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3732199246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 msgr2=0x5595f4a51b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/3732199246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x5595f4b192f0 tx=0x5595f4aaccc0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3732199246 shutdown_connections 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/3732199246 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4bfa000 0x5595f4a52c00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/3732199246 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4b07000 0x5595f4a51b80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3732199246 >> 172.21.15.155:0/3732199246 conn(0x5595f4769c00 msgr2=0x5595f4856000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3732199246 shutdown_connections 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/3732199246 wait complete. 2024-04-19T23:47:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5595f4bfa400 msgr2=0x5595f4a53700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x5595f4bfa400 0x5595f4a53700 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5595f4b07800 msgr2=0x5595f4a52100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x5595f4b07800 0x5595f4a52100 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5595f4bfb400 msgr2=0x5595f4a53180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5595f4bfb400 0x5595f4a53180 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5595f4bfb000 msgr2=0x5595f4a52680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.109+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5595f4bfb000 0x5595f4a52680 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.110+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4769400 msgr2=0x5595f4a51080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.110+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5595f4769400 0x5595f4a51080 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5595f553baa0 tx=0x5595f4aac780 comp rx=0 tx=0).stop 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.110+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 msgr2=0x5595f4a50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.110+0000 7fc5f3147a80 1 --2- 172.21.15.155:0/2765920032 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5595f4768800 0x5595f4a50580 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x5595f553b9b0 tx=0x5595f4859920 comp rx=0 tx=0).stop 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.110+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 reap_dead start 2024-04-19T23:47:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.110+0000 7fc5f18f2700 1 -- 172.21.15.155:0/2765920032 reap_dead start 2024-04-19T23:47:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.110+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 shutdown_connections 2024-04-19T23:47:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.110+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 >> 172.21.15.155:0/2765920032 conn(0x5595f4768400 msgr2=0x5595f4855000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.110+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 shutdown_connections 2024-04-19T23:47:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.110+0000 7fc5f3147a80 1 -- 172.21.15.155:0/2765920032 wait complete. 2024-04-19T23:47:22.126 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:47:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87", 2024-04-19T23:47:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "default", 2024-04-19T23:47:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: "domain_root": "default.rgw.meta:root", 2024-04-19T23:47:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: "control_pool": "default.rgw.control", 2024-04-19T23:47:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: "gc_pool": "default.rgw.log:gc", 2024-04-19T23:47:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: "lc_pool": "default.rgw.log:lc", 2024-04-19T23:47:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: "log_pool": "default.rgw.log", 2024-04-19T23:47:22.126 INFO:teuthology.orchestra.run.smithi155.stdout: "intent_log_pool": "default.rgw.log:intent", 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "usage_log_pool": "default.rgw.log:usage", 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "roles_pool": "default.rgw.meta:roles", 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "reshard_pool": "default.rgw.log:reshard", 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "user_email_pool": "default.rgw.meta:users.email", 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "otp_pool": "default.rgw.otp", 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "system_key": { 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "", 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "" 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.127 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_pools": [ 2024-04-19T23:47:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "default-placement", 2024-04-19T23:47:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: "val": { 2024-04-19T23:47:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": "default.rgw.buckets.index", 2024-04-19T23:47:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: "storage_classes": { 2024-04-19T23:47:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: "STANDARD": { 2024-04-19T23:47:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": "default.rgw.buckets.data" 2024-04-19T23:47:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.130 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "index_type": 0, 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "inline_data": true 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "new-placement", 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "val": { 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": ".rgw.buckets.index.2", 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "storage_classes": { 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "STANDARD": { 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": ".rgw.buckets.2" 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "index_type": 0, 2024-04-19T23:47:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: "inline_data": false 2024-04-19T23:47:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:47:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: "realm_id": "", 2024-04-19T23:47:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: "notif_pool": "default.rgw.log:notif" 2024-04-19T23:47:22.132 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:47:22.132 DEBUG:tasks.util.rgw: json result: {'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-04-19T23:47:22.132 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-04-19T23:47:22.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-04-19T23:47:22.133 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-04-19T23:47:22.209 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:47:22.210 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:47:22.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec9b2fa80 1 Processor -- start 2024-04-19T23:47:22.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec9b2fa80 1 -- start start 2024-04-19T23:47:22.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec9b2fa80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x561949094c00 0x56194937c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec9b2fa80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5619493bf500 con 0x561949094800 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec9b2fa80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x561949136a00 con 0x561949094c00 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec7ad9700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x561949094800 0x561949180800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:47702/0 (socket says 172.21.15.155:47702) 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec7ad9700 1 -- 172.21.15.155:0/1023395835 learned_addr learned my addr 172.21.15.155:0/1023395835 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec72d8700 1 --2- 172.21.15.155:0/1023395835 >> v2:172.21.15.76:3300/0 conn(0x561949094c00 0x56194937c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec6ad7700 1 -- 172.21.15.155:0/1023395835 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931727479 0 0) 0x561949e62000 con 0x561949094800 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec6ad7700 1 -- 172.21.15.155:0/1023395835 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5619493bf680 con 0x561949094800 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec72d8700 1 -- 172.21.15.155:0/1023395835 >> v1:172.21.15.76:6789/0 conn(0x561949094800 legacy=0x561949180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.210+0000 7faec72d8700 1 -- 172.21.15.155:0/1023395835 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619490bdd40 con 0x561949094c00 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.211+0000 7faec72d8700 1 --2- 172.21.15.155:0/1023395835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094c00 0x56194937c580 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x561949377890 tx=0x561949185980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7888ad2ac820d350 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.211+0000 7faec6ad7700 1 -- 172.21.15.155:0/1023395835 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d4a0 con 0x561949094c00 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.211+0000 7faec6ad7700 1 -- 172.21.15.155:0/1023395835 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619493bf680 con 0x561949094c00 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.211+0000 7faec6ad7700 1 -- 172.21.15.155:0/1023395835 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d600 con 0x561949094c00 2024-04-19T23:47:22.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.211+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1023395835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094c00 msgr2=0x56194937c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.211+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/1023395835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094c00 0x56194937c580 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x561949377890 tx=0x561949185980 comp rx=0 tx=0).stop 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.211+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1023395835 shutdown_connections 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.211+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/1023395835 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094c00 0x56194937c580 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.211+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1023395835 >> 172.21.15.155:0/1023395835 conn(0x561949094400 msgr2=0x561949180000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.211+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1023395835 shutdown_connections 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.211+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1023395835 wait complete. 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.212+0000 7faec9b2fa80 1 Processor -- start 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.212+0000 7faec9b2fa80 1 -- start start 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.212+0000 7faec9b2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.212+0000 7faec9b2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561949136500 con 0x561949094800 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.212+0000 7faec7ad9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.212+0000 7faec7ad9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38612/0 (socket says 172.21.15.155:38612) 2024-04-19T23:47:22.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.212+0000 7faec7ad9700 1 -- 172.21.15.155:0/2848790656 learned_addr learned my addr 172.21.15.155:0/2848790656 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.212+0000 7faec7ad9700 1 -- 172.21.15.155:0/2848790656 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619490bdba0 con 0x561949094800 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec7ad9700 1 --2- 172.21.15.155:0/2848790656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x561949e65770 tx=0x561949185b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1338777bf3775336 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec62d6700 1 -- 172.21.15.155:0/2848790656 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d4a0 con 0x561949094800 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec62d6700 1 -- 172.21.15.155:0/2848790656 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619493bfb00 con 0x561949094800 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec62d6700 1 -- 172.21.15.155:0/2848790656 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d600 con 0x561949094800 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec9b2fa80 1 -- 172.21.15.155:0/2848790656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 msgr2=0x56194937c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/2848790656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x561949e65770 tx=0x561949185b60 comp rx=0 tx=0).stop 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec9b2fa80 1 -- 172.21.15.155:0/2848790656 shutdown_connections 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/2848790656 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec9b2fa80 1 -- 172.21.15.155:0/2848790656 >> 172.21.15.155:0/2848790656 conn(0x561949094400 msgr2=0x561949181000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec9b2fa80 1 -- 172.21.15.155:0/2848790656 shutdown_connections 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec9b2fa80 1 -- 172.21.15.155:0/2848790656 wait complete. 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec9b2fa80 1 Processor -- start 2024-04-19T23:47:22.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.213+0000 7faec9b2fa80 1 -- start start 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec9b2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec9b2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619491363c0 con 0x561949094800 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec7ad9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec7ad9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38628/0 (socket says 172.21.15.155:38628) 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec7ad9700 1 -- 172.21.15.155:0/4111584134 learned_addr learned my addr 172.21.15.155:0/4111584134 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec7ad9700 1 -- 172.21.15.155:0/4111584134 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619490bda00 con 0x561949094800 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec7ad9700 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x561949e65e30 tx=0x561949185920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec4ad3700 1 -- 172.21.15.155:0/4111584134 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d8c0 con 0x561949094800 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec4ad3700 1 -- 172.21.15.155:0/4111584134 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561949135c80 con 0x561949094800 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec4ad3700 1 -- 172.21.15.155:0/4111584134 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d4a0 con 0x561949094800 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619490bd860 con 0x561949094800 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.214+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619490bd6c0 con 0x561949094800 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec9b2fa80 1 Processor -- start 2024-04-19T23:47:22.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec9b2fa80 1 -- start start 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec4ad3700 1 -- 172.21.15.155:0/4111584134 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561949e36b00 con 0x561949094800 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec9b2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec9b2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x561949136000 con 0x561949095400 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec82da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec4ad3700 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941c000 0x56194937d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec82da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38632/0 (socket says 172.21.15.155:38632) 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec82da700 1 -- 172.21.15.155:0/1285154237 learned_addr learned my addr 172.21.15.155:0/1285154237 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec4ad3700 1 -- 172.21.15.155:0/4111584134 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x56194910f180 con 0x561949094800 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec7ad9700 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941c000 0x56194937d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.215+0000 7faec82da700 1 -- 172.21.15.155:0/1285154237 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619490bc000 con 0x561949095400 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec7ad9700 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941c000 0x56194937d080 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x561949f22f00 tx=0x5619493e0240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec82da700 1 --2- 172.21.15.155:0/1285154237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x561949422030 tx=0x5619493e0a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a8efead39d6589 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec22ce700 1 -- 172.21.15.155:0/1285154237 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d8c0 con 0x561949095400 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec22ce700 1 -- 172.21.15.155:0/1285154237 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619493be480 con 0x561949095400 2024-04-19T23:47:22.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec22ce700 1 -- 172.21.15.155:0/1285154237 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d4a0 con 0x561949095400 2024-04-19T23:47:22.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1285154237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 msgr2=0x56194937cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/1285154237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x561949422030 tx=0x5619493e0a20 comp rx=0 tx=0).stop 2024-04-19T23:47:22.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1285154237 shutdown_connections 2024-04-19T23:47:22.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/1285154237 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1285154237 >> 172.21.15.155:0/1285154237 conn(0x561949094c00 msgr2=0x561949181800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1285154237 shutdown_connections 2024-04-19T23:47:22.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.216+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1285154237 wait complete. 2024-04-19T23:47:22.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.217+0000 7faec9b2fa80 1 Processor -- start 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.217+0000 7faec9b2fa80 1 -- start start 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.217+0000 7faec9b2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.217+0000 7faec9b2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619490d0640 con 0x561949095400 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.217+0000 7faec82da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.217+0000 7faec82da700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38634/0 (socket says 172.21.15.155:38634) 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.217+0000 7faec82da700 1 -- 172.21.15.155:0/1161081027 learned_addr learned my addr 172.21.15.155:0/1161081027 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.217+0000 7faec82da700 1 -- 172.21.15.155:0/1161081027 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619490bcea0 con 0x561949095400 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.217+0000 7faec82da700 1 --2- 172.21.15.155:0/1161081027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x561949422cc0 tx=0x5619493e0840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.218+0000 7faec0acb700 1 -- 172.21.15.155:0/1161081027 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914db80 con 0x561949095400 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.218+0000 7faec0acb700 1 -- 172.21.15.155:0/1161081027 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619493be180 con 0x561949095400 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.218+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1161081027 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619490bc820 con 0x561949095400 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.218+0000 7faec0acb700 1 -- 172.21.15.155:0/1161081027 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d8c0 con 0x561949095400 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.218+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1161081027 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619490bc9c0 con 0x561949095400 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec0acb700 1 -- 172.21.15.155:0/1161081027 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561949e36dc0 con 0x561949095400 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec9b2fa80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:47:22.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec9b2fa80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec9b2fa80 1 Processor -- start 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec0acb700 1 --2- 172.21.15.155:0/1161081027 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941cc00 0x56194937d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec0acb700 1 -- 172.21.15.155:0/1161081027 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x56194910f340 con 0x561949095400 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec9b2fa80 1 -- start start 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec82da700 1 --2- 172.21.15.155:0/1161081027 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941cc00 0x56194937d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec9b2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095c00 0x56194937db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec9b2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619490d08c0 con 0x561949095c00 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec7ad9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095c00 0x56194937db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec7ad9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095c00 0x56194937db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38640/0 (socket says 172.21.15.155:38640) 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec7ad9700 1 -- 172.21.15.155:0/4176473125 learned_addr learned my addr 172.21.15.155:0/4176473125 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.219+0000 7faec82da700 1 --2- 172.21.15.155:0/1161081027 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941cc00 0x56194937d600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x561949474450 tx=0x5619493e13e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.220+0000 7faec7ad9700 1 -- 172.21.15.155:0/4176473125 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619490bcb60 con 0x561949095c00 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.220+0000 7faec7ad9700 1 --2- 172.21.15.155:0/4176473125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095c00 0x56194937db80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x561949422960 tx=0x5619493e0d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f315a58a59ae71 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.220+0000 7faeaeaa7700 1 -- 172.21.15.155:0/4176473125 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d600 con 0x561949095c00 2024-04-19T23:47:22.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.220+0000 7faeaeaa7700 1 -- 172.21.15.155:0/4176473125 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561949135e00 con 0x561949095c00 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.220+0000 7faeaeaa7700 1 -- 172.21.15.155:0/4176473125 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914da20 con 0x561949095c00 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4176473125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095c00 msgr2=0x56194937db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/4176473125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095c00 0x56194937db80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x561949422960 tx=0x5619493e0d20 comp rx=0 tx=0).stop 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4176473125 shutdown_connections 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/4176473125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095c00 0x56194937db80 secure :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0x561949422960 tx=0x5619493e0d20 comp rx=0 tx=0).stop 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4176473125 >> 172.21.15.155:0/4176473125 conn(0x561949095800 msgr2=0x561949182000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4176473125 shutdown_connections 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4176473125 wait complete. 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec9b2fa80 1 Processor -- start 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec9b2fa80 1 -- start start 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec9b2fa80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56194941d000 0x56194937e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec9b2fa80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619490d0f00 con 0x56194941d000 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec7ad9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56194941d000 0x56194937e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec7ad9700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56194941d000 0x56194937e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38652/0 (socket says 172.21.15.155:38652) 2024-04-19T23:47:22.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.221+0000 7faec7ad9700 1 -- 172.21.15.155:0/3743733245 learned_addr learned my addr 172.21.15.155:0/3743733245 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.222+0000 7faec7ad9700 1 -- 172.21.15.155:0/3743733245 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619490bcd00 con 0x56194941d000 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.222+0000 7faec7ad9700 1 --2- 172.21.15.155:0/3743733245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56194941d000 0x56194937e100 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x561949475dd0 tx=0x5619493e01e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.222+0000 7faead2a4700 1 -- 172.21.15.155:0/3743733245 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d1e0 con 0x56194941d000 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.222+0000 7faead2a4700 1 -- 172.21.15.155:0/3743733245 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619493be180 con 0x56194941d000 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.222+0000 7faec9b2fa80 1 -- 172.21.15.155:0/3743733245 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619490bc340 con 0x56194941d000 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.222+0000 7faead2a4700 1 -- 172.21.15.155:0/3743733245 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56194914d600 con 0x56194941d000 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.222+0000 7faec9b2fa80 1 -- 172.21.15.155:0/3743733245 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619494fa000 con 0x56194941d000 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.223+0000 7faead2a4700 1 -- 172.21.15.155:0/3743733245 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x561949e37b80 con 0x56194941d000 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.223+0000 7faead2a4700 1 --2- 172.21.15.155:0/3743733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561949562000 0x56194937ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.223+0000 7faead2a4700 1 -- 172.21.15.155:0/3743733245 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x56194910f500 con 0x56194941d000 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.223+0000 7faec72d8700 1 --2- 172.21.15.155:0/3743733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561949562000 0x56194937ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.223+0000 7faeab2a0700 20 reqs_thread_entry: start 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.223+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56194941d800 0x56194937e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.223+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56194941dc00 con 0x56194941d800 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.223+0000 7faec82da700 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56194941d800 0x56194937e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.223+0000 7faec72d8700 1 --2- 172.21.15.155:0/3743733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561949562000 0x56194937ec00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x561949377890 tx=0x561949185800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.224+0000 7faec82da700 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56194941d800 0x56194937e680 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.224+0000 7faec82da700 1 -- 172.21.15.155:0/4111584134 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56194956a240 con 0x56194941d800 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.224+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561949562400 con 0x56194941d800 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.224+0000 7faec82da700 1 -- 172.21.15.155:0/4111584134 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56194956a240 con 0x56194941d800 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.224+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561949562800 con 0x56194941d800 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.225+0000 7faec82da700 1 -- 172.21.15.155:0/4111584134 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [call out=48b,read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x56194956a240 con 0x56194941d800 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.225+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1161081027 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941cc00 msgr2=0x56194937d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.225+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/1161081027 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941cc00 0x56194937d600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x561949474450 tx=0x5619493e13e0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.225+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1161081027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 msgr2=0x56194937cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.225+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/1161081027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x561949422cc0 tx=0x5619493e0840 comp rx=0 tx=0).stop 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.225+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1161081027 shutdown_connections 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.225+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/1161081027 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941cc00 0x56194937d600 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.225+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/1161081027 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949095400 0x56194937cb00 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.225+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1161081027 >> 172.21.15.155:0/1161081027 conn(0x561949094c00 msgr2=0x561949181800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.225+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1161081027 shutdown_connections 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.225+0000 7faec9b2fa80 1 -- 172.21.15.155:0/1161081027 wait complete. 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/3743733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561949562000 msgr2=0x56194937ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/3743733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561949562000 0x56194937ec00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x561949377890 tx=0x561949185800 comp rx=0 tx=0).stop 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/3743733245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56194941d000 msgr2=0x56194937e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/3743733245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56194941d000 0x56194937e100 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x561949475dd0 tx=0x5619493e01e0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/3743733245 shutdown_connections 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/3743733245 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x561949562000 0x56194937ec00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/3743733245 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x56194941d000 0x56194937e100 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/3743733245 >> 172.21.15.155:0/3743733245 conn(0x561949095800 msgr2=0x561949182000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/3743733245 shutdown_connections 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/3743733245 wait complete. 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56194941d800 msgr2=0x56194937e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56194941d800 0x56194937e680 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941c000 msgr2=0x56194937d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941c000 0x56194937d080 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x561949f22f00 tx=0x5619493e0240 comp rx=0 tx=0).stop 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 msgr2=0x56194937c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x561949e65e30 tx=0x561949185920 comp rx=0 tx=0).stop 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 shutdown_connections 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x56194941d800 0x56194937e680 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x561949094800 0x56194937c580 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 --2- 172.21.15.155:0/4111584134 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x56194941c000 0x56194937d080 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 >> 172.21.15.155:0/4111584134 conn(0x561949094400 msgr2=0x561949181000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 shutdown_connections 2024-04-19T23:47:22.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.226+0000 7faec9b2fa80 1 -- 172.21.15.155:0/4111584134 wait complete. 2024-04-19T23:47:22.238 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:47:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87", 2024-04-19T23:47:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "default", 2024-04-19T23:47:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: "domain_root": "default.rgw.meta:root", 2024-04-19T23:47:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: "control_pool": "default.rgw.control", 2024-04-19T23:47:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: "gc_pool": "default.rgw.log:gc", 2024-04-19T23:47:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: "lc_pool": "default.rgw.log:lc", 2024-04-19T23:47:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: "log_pool": "default.rgw.log", 2024-04-19T23:47:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: "intent_log_pool": "default.rgw.log:intent", 2024-04-19T23:47:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: "usage_log_pool": "default.rgw.log:usage", 2024-04-19T23:47:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: "roles_pool": "default.rgw.meta:roles", 2024-04-19T23:47:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: "reshard_pool": "default.rgw.log:reshard", 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "user_email_pool": "default.rgw.meta:users.email", 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "otp_pool": "default.rgw.otp", 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "system_key": { 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "", 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "" 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_pools": [ 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "default-placement", 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "val": { 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": "default.rgw.buckets.index", 2024-04-19T23:47:22.240 INFO:teuthology.orchestra.run.smithi155.stdout: "storage_classes": { 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: "STANDARD": { 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": "default.rgw.buckets.data" 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: "index_type": 0, 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: "inline_data": true 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "new-placement", 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: "val": { 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": ".rgw.buckets.index.2", 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: "storage_classes": { 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: "STANDARD": { 2024-04-19T23:47:22.241 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": ".rgw.buckets.2" 2024-04-19T23:47:22.242 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.242 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.242 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-04-19T23:47:22.242 INFO:teuthology.orchestra.run.smithi155.stdout: "index_type": 0, 2024-04-19T23:47:22.242 INFO:teuthology.orchestra.run.smithi155.stdout: "inline_data": false 2024-04-19T23:47:22.242 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.242 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.242 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:47:22.242 INFO:teuthology.orchestra.run.smithi155.stdout: "realm_id": "", 2024-04-19T23:47:22.242 INFO:teuthology.orchestra.run.smithi155.stdout: "notif_pool": "default.rgw.log:notif" 2024-04-19T23:47:22.242 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:47:22.243 DEBUG:tasks.util.rgw: json result: {'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-04-19T23:47:22.243 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-19T23:47:22.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-19T23:47:22.243 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-19T23:47:22.327 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:47:22.327 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.327+0000 7f787d0d1a80 1 Processor -- start 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.327+0000 7f787d0d1a80 1 -- start start 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.327+0000 7f787d0d1a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5584247e0c00 0x558424ac8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.327+0000 7f787d0d1a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558424b0b500 con 0x5584247e0800 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.327+0000 7f787d0d1a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x558424882a00 con 0x5584247e0c00 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.328+0000 7f787a87a700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x5584247e0c00 0x558424ac8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.328+0000 7f787b07b700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x5584247e0800 0x5584248cc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:47716/0 (socket says 172.21.15.155:47716) 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.328+0000 7f787b07b700 1 -- 172.21.15.155:0/817717203 learned_addr learned my addr 172.21.15.155:0/817717203 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.328+0000 7f787a079700 1 -- 172.21.15.155:0/817717203 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661340946 0 0) 0x5584255ae000 con 0x5584247e0800 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.328+0000 7f787a079700 1 -- 172.21.15.155:0/817717203 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x558424b0b680 con 0x5584247e0800 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.328+0000 7f787a87a700 1 -- 172.21.15.155:0/817717203 >> v1:172.21.15.76:6789/0 conn(0x5584247e0800 legacy=0x5584248cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.328+0000 7f787a87a700 1 -- 172.21.15.155:0/817717203 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558424809d40 con 0x5584247e0c00 2024-04-19T23:47:22.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.328+0000 7f787a87a700 1 --2- 172.21.15.155:0/817717203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0c00 0x558424ac8580 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x558424ac3890 tx=0x5584248d1980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73fe784cbf202e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.328+0000 7f787a079700 1 -- 172.21.15.155:0/817717203 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5584248994a0 con 0x5584247e0c00 2024-04-19T23:47:22.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.328+0000 7f787a079700 1 -- 172.21.15.155:0/817717203 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558424b0b500 con 0x5584247e0c00 2024-04-19T23:47:22.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.328+0000 7f787a079700 1 -- 172.21.15.155:0/817717203 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558424899600 con 0x5584247e0c00 2024-04-19T23:47:22.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.329+0000 7f787d0d1a80 1 -- 172.21.15.155:0/817717203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0c00 msgr2=0x558424ac8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.329+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/817717203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0c00 0x558424ac8580 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x558424ac3890 tx=0x5584248d1980 comp rx=0 tx=0).stop 2024-04-19T23:47:22.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.329+0000 7f787d0d1a80 1 -- 172.21.15.155:0/817717203 shutdown_connections 2024-04-19T23:47:22.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.329+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/817717203 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0c00 0x558424ac8580 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.329+0000 7f787d0d1a80 1 -- 172.21.15.155:0/817717203 >> 172.21.15.155:0/817717203 conn(0x5584247e0400 msgr2=0x5584248cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.329+0000 7f787d0d1a80 1 -- 172.21.15.155:0/817717203 shutdown_connections 2024-04-19T23:47:22.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.329+0000 7f787d0d1a80 1 -- 172.21.15.155:0/817717203 wait complete. 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.329+0000 7f787d0d1a80 1 Processor -- start 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.329+0000 7f787d0d1a80 1 -- start start 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.329+0000 7f787d0d1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.329+0000 7f787d0d1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558424882500 con 0x5584247e0800 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.330+0000 7f787b07b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.330+0000 7f787b07b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38658/0 (socket says 172.21.15.155:38658) 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.330+0000 7f787b07b700 1 -- 172.21.15.155:0/222488888 learned_addr learned my addr 172.21.15.155:0/222488888 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.330+0000 7f787b07b700 1 -- 172.21.15.155:0/222488888 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558424809ba0 con 0x5584247e0800 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.330+0000 7f787b07b700 1 --2- 172.21.15.155:0/222488888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x5584255b1770 tx=0x5584248d1b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d19b707b21976d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.330+0000 7f7879878700 1 -- 172.21.15.155:0/222488888 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5584248994a0 con 0x5584247e0800 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.330+0000 7f7879878700 1 -- 172.21.15.155:0/222488888 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558424b0bb00 con 0x5584247e0800 2024-04-19T23:47:22.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.330+0000 7f7879878700 1 -- 172.21.15.155:0/222488888 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558424899600 con 0x5584247e0800 2024-04-19T23:47:22.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.331+0000 7f787d0d1a80 1 -- 172.21.15.155:0/222488888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 msgr2=0x558424ac8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.331+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/222488888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x5584255b1770 tx=0x5584248d1b60 comp rx=0 tx=0).stop 2024-04-19T23:47:22.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.331+0000 7f787d0d1a80 1 -- 172.21.15.155:0/222488888 shutdown_connections 2024-04-19T23:47:22.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.331+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/222488888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.331+0000 7f787d0d1a80 1 -- 172.21.15.155:0/222488888 >> 172.21.15.155:0/222488888 conn(0x5584247e0400 msgr2=0x5584248cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.331+0000 7f787d0d1a80 1 -- 172.21.15.155:0/222488888 shutdown_connections 2024-04-19T23:47:22.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.331+0000 7f787d0d1a80 1 -- 172.21.15.155:0/222488888 wait complete. 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.331+0000 7f787d0d1a80 1 Processor -- start 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.331+0000 7f787d0d1a80 1 -- start start 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.331+0000 7f787d0d1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.331+0000 7f787d0d1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584248823c0 con 0x5584247e0800 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.332+0000 7f787b07b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.332+0000 7f787b07b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38660/0 (socket says 172.21.15.155:38660) 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.332+0000 7f787b07b700 1 -- 172.21.15.155:0/218198869 learned_addr learned my addr 172.21.15.155:0/218198869 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.332+0000 7f787b07b700 1 -- 172.21.15.155:0/218198869 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558424809a00 con 0x5584247e0800 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.332+0000 7f787b07b700 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x5584255b1e30 tx=0x5584248d1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.332+0000 7f7878075700 1 -- 172.21.15.155:0/218198869 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5584248998c0 con 0x5584247e0800 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.332+0000 7f7878075700 1 -- 172.21.15.155:0/218198869 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558424881c80 con 0x5584247e0800 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.332+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558424809860 con 0x5584247e0800 2024-04-19T23:47:22.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.332+0000 7f7878075700 1 -- 172.21.15.155:0/218198869 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5584248994a0 con 0x5584247e0800 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.332+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584248096c0 con 0x5584247e0800 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f787d0d1a80 1 Processor -- start 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f787d0d1a80 1 -- start start 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f7878075700 1 -- 172.21.15.155:0/218198869 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558425582b00 con 0x5584247e0800 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f787d0d1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f787d0d1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x558424882000 con 0x5584247e1400 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f7878075700 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62000 0x558424ac9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f7878075700 1 -- 172.21.15.155:0/218198869 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55842485b180 con 0x5584247e0800 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f787b07b700 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62000 0x558424ac9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f787b87c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f787b87c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38664/0 (socket says 172.21.15.155:38664) 2024-04-19T23:47:22.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f787b87c700 1 -- 172.21.15.155:0/1960414090 learned_addr learned my addr 172.21.15.155:0/1960414090 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f787b87c700 1 -- 172.21.15.155:0/1960414090 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558424808000 con 0x5584247e1400 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f787b07b700 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62000 0x558424ac9080 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55842566ef00 tx=0x558424b2a240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.333+0000 7f787b87c700 1 --2- 172.21.15.155:0/1960414090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x55842566e360 tx=0x558424b2ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41690249a4b1df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f7875870700 1 -- 172.21.15.155:0/1960414090 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5584248998c0 con 0x5584247e1400 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f7875870700 1 -- 172.21.15.155:0/1960414090 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558424b0a480 con 0x5584247e1400 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f7875870700 1 -- 172.21.15.155:0/1960414090 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5584248994a0 con 0x5584247e1400 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1960414090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 msgr2=0x558424ac8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/1960414090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x55842566e360 tx=0x558424b2ad20 comp rx=0 tx=0).stop 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1960414090 shutdown_connections 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/1960414090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1960414090 >> 172.21.15.155:0/1960414090 conn(0x5584247e0c00 msgr2=0x5584248cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1960414090 shutdown_connections 2024-04-19T23:47:22.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1960414090 wait complete. 2024-04-19T23:47:22.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f787d0d1a80 1 Processor -- start 2024-04-19T23:47:22.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f787d0d1a80 1 -- start start 2024-04-19T23:47:22.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f787d0d1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.334+0000 7f787d0d1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55842481c640 con 0x5584247e1400 2024-04-19T23:47:22.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.335+0000 7f787b87c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.335+0000 7f787b87c700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38670/0 (socket says 172.21.15.155:38670) 2024-04-19T23:47:22.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.335+0000 7f787b87c700 1 -- 172.21.15.155:0/1811009255 learned_addr learned my addr 172.21.15.155:0/1811009255 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.335+0000 7f787b87c700 1 -- 172.21.15.155:0/1811009255 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558424808ea0 con 0x5584247e1400 2024-04-19T23:47:22.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.335+0000 7f787b87c700 1 --2- 172.21.15.155:0/1811009255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x55842566ff20 tx=0x558424b2a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.335+0000 7f787406d700 1 -- 172.21.15.155:0/1811009255 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558424899b80 con 0x5584247e1400 2024-04-19T23:47:22.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.335+0000 7f787406d700 1 -- 172.21.15.155:0/1811009255 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558424b0a180 con 0x5584247e1400 2024-04-19T23:47:22.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.335+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1811009255 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558424808820 con 0x5584247e1400 2024-04-19T23:47:22.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.335+0000 7f787406d700 1 -- 172.21.15.155:0/1811009255 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5584248998c0 con 0x5584247e1400 2024-04-19T23:47:22.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.335+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1811009255 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584248089c0 con 0x5584247e1400 2024-04-19T23:47:22.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.336+0000 7f787406d700 1 -- 172.21.15.155:0/1811009255 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558425582dc0 con 0x5584247e1400 2024-04-19T23:47:22.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.336+0000 7f787406d700 1 --2- 172.21.15.155:0/1811009255 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62c00 0x558424ac9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.336+0000 7f787406d700 1 -- 172.21.15.155:0/1811009255 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55842485b340 con 0x5584247e1400 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.336+0000 7f787d0d1a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.336+0000 7f787d0d1a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.336+0000 7f787a87a700 1 --2- 172.21.15.155:0/1811009255 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62c00 0x558424ac9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.336+0000 7f787d0d1a80 1 Processor -- start 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.336+0000 7f787d0d1a80 1 -- start start 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.337+0000 7f787d0d1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.337+0000 7f787d0d1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55842481c8c0 con 0x5584247e1c00 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.337+0000 7f787a87a700 1 --2- 172.21.15.155:0/1811009255 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62c00 0x558424ac9600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x558424ac3890 tx=0x5584248d1800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.337+0000 7f787b07b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.337+0000 7f787b07b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38686/0 (socket says 172.21.15.155:38686) 2024-04-19T23:47:22.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.337+0000 7f787b07b700 1 -- 172.21.15.155:0/248934153 learned_addr learned my addr 172.21.15.155:0/248934153 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.337+0000 7f787b07b700 1 -- 172.21.15.155:0/248934153 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558424808b60 con 0x5584247e1c00 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.337+0000 7f787b07b700 1 --2- 172.21.15.155:0/248934153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x55842566e1e0 tx=0x558424b2ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a88aa7c5abfbcd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.337+0000 7f7862049700 1 -- 172.21.15.155:0/248934153 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558424899600 con 0x5584247e1c00 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.337+0000 7f7862049700 1 -- 172.21.15.155:0/248934153 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558424881e00 con 0x5584247e1c00 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.337+0000 7f7862049700 1 -- 172.21.15.155:0/248934153 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558424899a20 con 0x5584247e1c00 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787d0d1a80 1 -- 172.21.15.155:0/248934153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 msgr2=0x558424ac9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/248934153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x55842566e1e0 tx=0x558424b2ac00 comp rx=0 tx=0).stop 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787d0d1a80 1 -- 172.21.15.155:0/248934153 shutdown_connections 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/248934153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787d0d1a80 1 -- 172.21.15.155:0/248934153 >> 172.21.15.155:0/248934153 conn(0x5584247e1800 msgr2=0x5584248ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787d0d1a80 1 -- 172.21.15.155:0/248934153 shutdown_connections 2024-04-19T23:47:22.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787d0d1a80 1 -- 172.21.15.155:0/248934153 wait complete. 2024-04-19T23:47:22.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787d0d1a80 1 Processor -- start 2024-04-19T23:47:22.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787d0d1a80 1 -- start start 2024-04-19T23:47:22.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787d0d1a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787d0d1a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55842481cf00 con 0x5584247e1c00 2024-04-19T23:47:22.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787b07b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787b07b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38690/0 (socket says 172.21.15.155:38690) 2024-04-19T23:47:22.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.338+0000 7f787b07b700 1 -- 172.21.15.155:0/2850810463 learned_addr learned my addr 172.21.15.155:0/2850810463 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.339+0000 7f787b07b700 1 -- 172.21.15.155:0/2850810463 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558424808d00 con 0x5584247e1c00 2024-04-19T23:47:22.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.339+0000 7f787b07b700 1 --2- 172.21.15.155:0/2850810463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x558424b7adb0 tx=0x558424b2a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.339+0000 7f7860846700 1 -- 172.21.15.155:0/2850810463 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558424899600 con 0x5584247e1c00 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.339+0000 7f7860846700 1 -- 172.21.15.155:0/2850810463 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558424b0a180 con 0x5584247e1c00 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.339+0000 7f787d0d1a80 1 -- 172.21.15.155:0/2850810463 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558424808340 con 0x5584247e1c00 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.339+0000 7f7860846700 1 -- 172.21.15.155:0/2850810463 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558424899a20 con 0x5584247e1c00 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.339+0000 7f787d0d1a80 1 -- 172.21.15.155:0/2850810463 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558424c32000 con 0x5584247e1c00 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.340+0000 7f7860846700 1 -- 172.21.15.155:0/2850810463 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x558425583b80 con 0x5584247e1c00 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.340+0000 7f7860846700 1 --2- 172.21.15.155:0/2850810463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424c90000 0x558424acac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.340+0000 7f7860846700 1 -- 172.21.15.155:0/2850810463 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55842485b500 con 0x5584247e1c00 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.340+0000 7f787a87a700 1 --2- 172.21.15.155:0/2850810463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424c90000 0x558424acac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.340+0000 7f785e842700 20 reqs_thread_entry: start 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.340+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558424b63c00 0x558424aca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.340+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558424c90400 con 0x558424b63c00 2024-04-19T23:47:22.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.340+0000 7f787a87a700 1 --2- 172.21.15.155:0/2850810463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424c90000 0x558424acac00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x558424b7b530 tx=0x5584248d1860 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.340+0000 7f787b87c700 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558424b63c00 0x558424aca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.341+0000 7f787b87c700 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558424b63c00 0x558424aca100 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.341+0000 7f787b87c700 1 -- 172.21.15.155:0/218198869 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x558424c9a240 con 0x558424b63c00 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.341+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558424c90800 con 0x558424b63c00 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.341+0000 7f787b87c700 1 -- 172.21.15.155:0/218198869 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [call out=48b,read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x558424c9a240 con 0x558424b63c00 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.341+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558424c90c00 con 0x558424b63c00 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.342+0000 7f787b87c700 1 -- 172.21.15.155:0/218198869 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [stat,call,call,writefull 0~874] v32'4 uv4 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x558424c9a240 con 0x558424b63c00 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1811009255 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62c00 msgr2=0x558424ac9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/1811009255 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62c00 0x558424ac9600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x558424ac3890 tx=0x5584248d1800 comp rx=0 tx=0).stop 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1811009255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 msgr2=0x558424ac8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/1811009255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x55842566ff20 tx=0x558424b2a900 comp rx=0 tx=0).stop 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1811009255 shutdown_connections 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/1811009255 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62c00 0x558424ac9600 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/1811009255 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1400 0x558424ac8b00 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1811009255 >> 172.21.15.155:0/1811009255 conn(0x5584247e0c00 msgr2=0x5584248cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1811009255 shutdown_connections 2024-04-19T23:47:22.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/1811009255 wait complete. 2024-04-19T23:47:22.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/2850810463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424c90000 msgr2=0x558424acac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/2850810463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424c90000 0x558424acac00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x558424b7b530 tx=0x5584248d1860 comp rx=0 tx=0).stop 2024-04-19T23:47:22.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/2850810463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 msgr2=0x558424ac9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/2850810463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x558424b7adb0 tx=0x558424b2a1e0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/2850810463 shutdown_connections 2024-04-19T23:47:22.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/2850810463 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424c90000 0x558424acac00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/2850810463 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e1c00 0x558424ac9b80 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/2850810463 >> 172.21.15.155:0/2850810463 conn(0x5584247e1800 msgr2=0x5584248ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/2850810463 shutdown_connections 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.343+0000 7f787d0d1a80 1 -- 172.21.15.155:0/2850810463 wait complete. 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558424b63c00 msgr2=0x558424aca100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558424b63c00 0x558424aca100 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62000 msgr2=0x558424ac9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62000 0x558424ac9080 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55842566ef00 tx=0x558424b2a240 comp rx=0 tx=0).stop 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 msgr2=0x558424ac8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x5584255b1e30 tx=0x5584248d1920 comp rx=0 tx=0).stop 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 shutdown_connections 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x558424b63c00 0x558424aca100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5584247e0800 0x558424ac8580 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 --2- 172.21.15.155:0/218198869 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x558424b62000 0x558424ac9080 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 >> 172.21.15.155:0/218198869 conn(0x5584247e0400 msgr2=0x5584248cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 shutdown_connections 2024-04-19T23:47:22.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.344+0000 7f787d0d1a80 1 -- 172.21.15.155:0/218198869 wait complete. 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87", 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "default", 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "domain_root": "default.rgw.meta:root", 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "control_pool": "default.rgw.control", 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "gc_pool": "default.rgw.log:gc", 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "lc_pool": "default.rgw.log:lc", 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "log_pool": "default.rgw.log", 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "intent_log_pool": "default.rgw.log:intent", 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "usage_log_pool": "default.rgw.log:usage", 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "roles_pool": "default.rgw.meta:roles", 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "reshard_pool": "default.rgw.log:reshard", 2024-04-19T23:47:22.364 INFO:teuthology.orchestra.run.smithi155.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: "user_email_pool": "default.rgw.meta:users.email", 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: "otp_pool": "default.rgw.otp", 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: "system_key": { 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "", 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "" 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_pools": [ 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: "key": "default-placement", 2024-04-19T23:47:22.365 INFO:teuthology.orchestra.run.smithi155.stdout: "val": { 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: "index_pool": "default.rgw.buckets.index", 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: "storage_classes": { 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: "STANDARD": { 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: "data_pool": "default.rgw.buckets.data" 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: "index_type": 0, 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: "inline_data": true 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: "realm_id": "", 2024-04-19T23:47:22.366 INFO:teuthology.orchestra.run.smithi155.stdout: "notif_pool": "default.rgw.log:notif" 2024-04-19T23:47:22.367 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:47:22.367 DEBUG:tasks.util.rgw: json result: {'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-04-19T23:47:22.367 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-04-19T23:47:22.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-04-19T23:47:22.367 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-04-19T23:47:22.411 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:47:22.411 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:47:22.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.411+0000 7fe75a431a80 1 Processor -- start 2024-04-19T23:47:22.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.411+0000 7fe75a431a80 1 -- start start 2024-04-19T23:47:22.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.411+0000 7fe75a431a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55d4bc520800 0x55d4bc808580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.411+0000 7fe75a431a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d4bc84b500 con 0x55d4bc520c00 2024-04-19T23:47:22.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.411+0000 7fe75a431a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d4bc5c2a00 con 0x55d4bc520800 2024-04-19T23:47:22.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.412+0000 7fe7583db700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x55d4bc520800 0x55d4bc808580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.412+0000 7fe757bda700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x55d4bc520c00 0x55d4bc60c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:47732/0 (socket says 172.21.15.155:47732) 2024-04-19T23:47:22.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.412+0000 7fe757bda700 1 -- 172.21.15.155:0/4267984774 learned_addr learned my addr 172.21.15.155:0/4267984774 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:47:22.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.412+0000 7fe7583db700 1 -- 172.21.15.155:0/4267984774 >> v1:172.21.15.76:6789/0 conn(0x55d4bc520c00 legacy=0x55d4bc60c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.412+0000 7fe7583db700 1 -- 172.21.15.155:0/4267984774 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4bc549d40 con 0x55d4bc520800 2024-04-19T23:47:22.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.412+0000 7fe7573d9700 1 -- 172.21.15.155:0/4267984774 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320362577 0 0) 0x55d4bd2ee000 con 0x55d4bc520c00 2024-04-19T23:47:22.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.412+0000 7fe7583db700 1 --2- 172.21.15.155:0/4267984774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x55d4bc8039e0 tx=0x55d4bc611920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc1949628ff5dc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.412+0000 7fe7573d9700 1 -- 172.21.15.155:0/4267984774 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d94a0 con 0x55d4bc520800 2024-04-19T23:47:22.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.412+0000 7fe7573d9700 1 -- 172.21.15.155:0/4267984774 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4bc84b800 con 0x55d4bc520800 2024-04-19T23:47:22.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.412+0000 7fe7573d9700 1 -- 172.21.15.155:0/4267984774 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d9600 con 0x55d4bc520800 2024-04-19T23:47:22.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.413+0000 7fe75a431a80 1 -- 172.21.15.155:0/4267984774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 msgr2=0x55d4bc808580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.413+0000 7fe75a431a80 1 --2- 172.21.15.155:0/4267984774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x55d4bc8039e0 tx=0x55d4bc611920 comp rx=0 tx=0).stop 2024-04-19T23:47:22.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.413+0000 7fe75a431a80 1 -- 172.21.15.155:0/4267984774 shutdown_connections 2024-04-19T23:47:22.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.413+0000 7fe75a431a80 1 --2- 172.21.15.155:0/4267984774 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.413+0000 7fe75a431a80 1 -- 172.21.15.155:0/4267984774 >> 172.21.15.155:0/4267984774 conn(0x55d4bc520400 msgr2=0x55d4bc60c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.413+0000 7fe75a431a80 1 -- 172.21.15.155:0/4267984774 shutdown_connections 2024-04-19T23:47:22.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.413+0000 7fe75a431a80 1 -- 172.21.15.155:0/4267984774 wait complete. 2024-04-19T23:47:22.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.413+0000 7fe75a431a80 1 Processor -- start 2024-04-19T23:47:22.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.413+0000 7fe75a431a80 1 -- start start 2024-04-19T23:47:22.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.413+0000 7fe75a431a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.414+0000 7fe75a431a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bc5c2500 con 0x55d4bc520800 2024-04-19T23:47:22.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.414+0000 7fe7583db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.414+0000 7fe7583db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38720/0 (socket says 172.21.15.155:38720) 2024-04-19T23:47:22.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.414+0000 7fe7583db700 1 -- 172.21.15.155:0/460639993 learned_addr learned my addr 172.21.15.155:0/460639993 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.414+0000 7fe7583db700 1 -- 172.21.15.155:0/460639993 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4bc549ba0 con 0x55d4bc520800 2024-04-19T23:47:22.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.414+0000 7fe7583db700 1 --2- 172.21.15.155:0/460639993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55d4bd2f1800 tx=0x55d4bc611800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e051f41cc9f1cf server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.414+0000 7fe756bd8700 1 -- 172.21.15.155:0/460639993 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d9760 con 0x55d4bc520800 2024-04-19T23:47:22.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.414+0000 7fe756bd8700 1 -- 172.21.15.155:0/460639993 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4bc84bb00 con 0x55d4bc520800 2024-04-19T23:47:22.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.414+0000 7fe756bd8700 1 -- 172.21.15.155:0/460639993 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d94a0 con 0x55d4bc520800 2024-04-19T23:47:22.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe75a431a80 1 -- 172.21.15.155:0/460639993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 msgr2=0x55d4bc808580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe75a431a80 1 --2- 172.21.15.155:0/460639993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55d4bd2f1800 tx=0x55d4bc611800 comp rx=0 tx=0).stop 2024-04-19T23:47:22.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe75a431a80 1 -- 172.21.15.155:0/460639993 shutdown_connections 2024-04-19T23:47:22.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe75a431a80 1 --2- 172.21.15.155:0/460639993 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe75a431a80 1 -- 172.21.15.155:0/460639993 >> 172.21.15.155:0/460639993 conn(0x55d4bc520400 msgr2=0x55d4bc60d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe75a431a80 1 -- 172.21.15.155:0/460639993 shutdown_connections 2024-04-19T23:47:22.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe75a431a80 1 -- 172.21.15.155:0/460639993 wait complete. 2024-04-19T23:47:22.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe75a431a80 1 Processor -- start 2024-04-19T23:47:22.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe75a431a80 1 -- start start 2024-04-19T23:47:22.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe75a431a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe75a431a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bc5c23c0 con 0x55d4bc520800 2024-04-19T23:47:22.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe7583db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe7583db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38722/0 (socket says 172.21.15.155:38722) 2024-04-19T23:47:22.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.415+0000 7fe7583db700 1 -- 172.21.15.155:0/3754248824 learned_addr learned my addr 172.21.15.155:0/3754248824 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.416+0000 7fe7583db700 1 -- 172.21.15.155:0/3754248824 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4bc549a00 con 0x55d4bc520800 2024-04-19T23:47:22.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.416+0000 7fe7583db700 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x55d4bd2f1ec0 tx=0x55d4bc611920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.416+0000 7fe7553d5700 1 -- 172.21.15.155:0/3754248824 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d9600 con 0x55d4bc520800 2024-04-19T23:47:22.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.416+0000 7fe7553d5700 1 -- 172.21.15.155:0/3754248824 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4bc84bc80 con 0x55d4bc520800 2024-04-19T23:47:22.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.416+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4bc549860 con 0x55d4bc520800 2024-04-19T23:47:22.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.416+0000 7fe7553d5700 1 -- 172.21.15.155:0/3754248824 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d98c0 con 0x55d4bc520800 2024-04-19T23:47:22.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.416+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4bc5496c0 con 0x55d4bc520800 2024-04-19T23:47:22.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.416+0000 7fe75a431a80 1 Processor -- start 2024-04-19T23:47:22.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.416+0000 7fe75a431a80 1 -- start start 2024-04-19T23:47:22.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe75a431a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe75a431a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bc5c2000 con 0x55d4bc521400 2024-04-19T23:47:22.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe758bdc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe7553d5700 1 -- 172.21.15.155:0/3754248824 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d4bd2c2b00 con 0x55d4bc520800 2024-04-19T23:47:22.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe758bdc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38724/0 (socket says 172.21.15.155:38724) 2024-04-19T23:47:22.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe758bdc700 1 -- 172.21.15.155:0/2130365257 learned_addr learned my addr 172.21.15.155:0/2130365257 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe7553d5700 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0000 0x55d4bc809080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe7553d5700 1 -- 172.21.15.155:0/3754248824 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d4bc59b180 con 0x55d4bc520800 2024-04-19T23:47:22.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe7583db700 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0000 0x55d4bc809080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe758bdc700 1 -- 172.21.15.155:0/2130365257 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4bc548000 con 0x55d4bc521400 2024-04-19T23:47:22.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe758bdc700 1 --2- 172.21.15.155:0/2130365257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x55d4bd39d290 tx=0x55d4bc870720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422aa741f3ec27e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe7583db700 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0000 0x55d4bc809080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55d4bd39d020 tx=0x55d4bc8708a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe752bd0700 1 -- 172.21.15.155:0/2130365257 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d9600 con 0x55d4bc521400 2024-04-19T23:47:22.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe752bd0700 1 -- 172.21.15.155:0/2130365257 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4bc5c1c80 con 0x55d4bc521400 2024-04-19T23:47:22.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.417+0000 7fe752bd0700 1 -- 172.21.15.155:0/2130365257 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d98c0 con 0x55d4bc521400 2024-04-19T23:47:22.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe75a431a80 1 -- 172.21.15.155:0/2130365257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 msgr2=0x55d4bc808b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe75a431a80 1 --2- 172.21.15.155:0/2130365257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x55d4bd39d290 tx=0x55d4bc870720 comp rx=0 tx=0).stop 2024-04-19T23:47:22.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe75a431a80 1 -- 172.21.15.155:0/2130365257 shutdown_connections 2024-04-19T23:47:22.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe75a431a80 1 --2- 172.21.15.155:0/2130365257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe75a431a80 1 -- 172.21.15.155:0/2130365257 >> 172.21.15.155:0/2130365257 conn(0x55d4bc520c00 msgr2=0x55d4bc60d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe75a431a80 1 -- 172.21.15.155:0/2130365257 shutdown_connections 2024-04-19T23:47:22.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe75a431a80 1 -- 172.21.15.155:0/2130365257 wait complete. 2024-04-19T23:47:22.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe75a431a80 1 Processor -- start 2024-04-19T23:47:22.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe75a431a80 1 -- start start 2024-04-19T23:47:22.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe75a431a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe75a431a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bc55c640 con 0x55d4bc521400 2024-04-19T23:47:22.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.418+0000 7fe758bdc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.419+0000 7fe758bdc700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38740/0 (socket says 172.21.15.155:38740) 2024-04-19T23:47:22.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.419+0000 7fe758bdc700 1 -- 172.21.15.155:0/2403791217 learned_addr learned my addr 172.21.15.155:0/2403791217 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.419+0000 7fe758bdc700 1 -- 172.21.15.155:0/2403791217 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4bc548ea0 con 0x55d4bc521400 2024-04-19T23:47:22.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.419+0000 7fe758bdc700 1 --2- 172.21.15.155:0/2403791217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x55d4bd39c210 tx=0x55d4bc8703c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.419+0000 7fe7513cd700 1 -- 172.21.15.155:0/2403791217 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d9760 con 0x55d4bc521400 2024-04-19T23:47:22.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.419+0000 7fe7513cd700 1 -- 172.21.15.155:0/2403791217 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4bc5c1b00 con 0x55d4bc521400 2024-04-19T23:47:22.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.419+0000 7fe75a431a80 1 -- 172.21.15.155:0/2403791217 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4bc548820 con 0x55d4bc521400 2024-04-19T23:47:22.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.419+0000 7fe7513cd700 1 -- 172.21.15.155:0/2403791217 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d9600 con 0x55d4bc521400 2024-04-19T23:47:22.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.419+0000 7fe75a431a80 1 -- 172.21.15.155:0/2403791217 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4bc5489c0 con 0x55d4bc521400 2024-04-19T23:47:22.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.420+0000 7fe75a431a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:47:22.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.420+0000 7fe75a431a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:47:22.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.420+0000 7fe7513cd700 1 -- 172.21.15.155:0/2403791217 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d4bd2c2dc0 con 0x55d4bc521400 2024-04-19T23:47:22.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.420+0000 7fe75a431a80 1 Processor -- start 2024-04-19T23:47:22.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.420+0000 7fe75a431a80 1 -- start start 2024-04-19T23:47:22.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.420+0000 7fe7513cd700 1 --2- 172.21.15.155:0/2403791217 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0c00 0x55d4bc809600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.420+0000 7fe7513cd700 1 -- 172.21.15.155:0/2403791217 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d4bc59b340 con 0x55d4bc521400 2024-04-19T23:47:22.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.420+0000 7fe758bdc700 1 --2- 172.21.15.155:0/2403791217 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0c00 0x55d4bc809600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.420+0000 7fe75a431a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.420+0000 7fe75a431a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bc55c8c0 con 0x55d4bc521c00 2024-04-19T23:47:22.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.421+0000 7fe7583db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.421+0000 7fe7583db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38748/0 (socket says 172.21.15.155:38748) 2024-04-19T23:47:22.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.421+0000 7fe7583db700 1 -- 172.21.15.155:0/1549707474 learned_addr learned my addr 172.21.15.155:0/1549707474 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.421+0000 7fe758bdc700 1 --2- 172.21.15.155:0/2403791217 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0c00 0x55d4bc809600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55d4bc900930 tx=0x55d4bc871140 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.421+0000 7fe7583db700 1 -- 172.21.15.155:0/1549707474 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4bc548b60 con 0x55d4bc521c00 2024-04-19T23:47:22.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.421+0000 7fe7583db700 1 --2- 172.21.15.155:0/1549707474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x55d4bd39d1a0 tx=0x55d4bc870a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21af389066ce89b server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.421+0000 7fe73f3a9700 1 -- 172.21.15.155:0/1549707474 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d9760 con 0x55d4bc521c00 2024-04-19T23:47:22.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.421+0000 7fe73f3a9700 1 -- 172.21.15.155:0/1549707474 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4bc5c1b00 con 0x55d4bc521c00 2024-04-19T23:47:22.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.421+0000 7fe73f3a9700 1 -- 172.21.15.155:0/1549707474 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d9600 con 0x55d4bc521c00 2024-04-19T23:47:22.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.422+0000 7fe75a431a80 1 -- 172.21.15.155:0/1549707474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 msgr2=0x55d4bc809b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.422+0000 7fe75a431a80 1 --2- 172.21.15.155:0/1549707474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x55d4bd39d1a0 tx=0x55d4bc870a20 comp rx=0 tx=0).stop 2024-04-19T23:47:22.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.422+0000 7fe75a431a80 1 -- 172.21.15.155:0/1549707474 shutdown_connections 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.422+0000 7fe75a431a80 1 --2- 172.21.15.155:0/1549707474 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.422+0000 7fe75a431a80 1 -- 172.21.15.155:0/1549707474 >> 172.21.15.155:0/1549707474 conn(0x55d4bc521800 msgr2=0x55d4bc60e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.422+0000 7fe75a431a80 1 -- 172.21.15.155:0/1549707474 shutdown_connections 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.422+0000 7fe75a431a80 1 -- 172.21.15.155:0/1549707474 wait complete. 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.422+0000 7fe75a431a80 1 Processor -- start 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.422+0000 7fe75a431a80 1 -- start start 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe75a431a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe75a431a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bc55cf00 con 0x55d4bc521c00 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe7583db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe7583db700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38760/0 (socket says 172.21.15.155:38760) 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe7583db700 1 -- 172.21.15.155:0/953946073 learned_addr learned my addr 172.21.15.155:0/953946073 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe7583db700 1 -- 172.21.15.155:0/953946073 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4bc548d00 con 0x55d4bc521c00 2024-04-19T23:47:22.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe7583db700 1 --2- 172.21.15.155:0/953946073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x55d4bc8ab530 tx=0x55d4bc870b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe73dba6700 1 -- 172.21.15.155:0/953946073 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d9a20 con 0x55d4bc521c00 2024-04-19T23:47:22.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe73dba6700 1 -- 172.21.15.155:0/953946073 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4bc960000 con 0x55d4bc521c00 2024-04-19T23:47:22.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe75a431a80 1 -- 172.21.15.155:0/953946073 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4bc548340 con 0x55d4bc521c00 2024-04-19T23:47:22.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe73dba6700 1 -- 172.21.15.155:0/953946073 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d4bc5d9b80 con 0x55d4bc521c00 2024-04-19T23:47:22.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.423+0000 7fe75a431a80 1 -- 172.21.15.155:0/953946073 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4bc968000 con 0x55d4bc521c00 2024-04-19T23:47:22.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.424+0000 7fe73dba6700 1 -- 172.21.15.155:0/953946073 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55d4bd2c3b80 con 0x55d4bc521c00 2024-04-19T23:47:22.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.424+0000 7fe73dba6700 1 --2- 172.21.15.155:0/953946073 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc9c2000 0x55d4bc80ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.424+0000 7fe73dba6700 1 -- 172.21.15.155:0/953946073 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x55d4bc59b500 con 0x55d4bc521c00 2024-04-19T23:47:22.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.424+0000 7fe757bda700 1 --2- 172.21.15.155:0/953946073 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc9c2000 0x55d4bc80ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.425+0000 7fe757bda700 1 --2- 172.21.15.155:0/953946073 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc9c2000 0x55d4bc80ac00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55d4bd2f0030 tx=0x55d4bc984780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.425+0000 7fe73bba2700 20 reqs_thread_entry: start 2024-04-19T23:47:22.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.425+0000 7fe75a431a80 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d4bc8b1c00 0x55d4bc80a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.425+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4bc9c2400 con 0x55d4bc8b1c00 2024-04-19T23:47:22.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.425+0000 7fe758bdc700 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d4bc8b1c00 0x55d4bc80a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.425+0000 7fe758bdc700 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d4bc8b1c00 0x55d4bc80a100 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.426+0000 7fe758bdc700 1 -- 172.21.15.155:0/3754248824 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d4bc9cc240 con 0x55d4bc8b1c00 2024-04-19T23:47:22.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.426+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4bc9c2800 con 0x55d4bc8b1c00 2024-04-19T23:47:22.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.426+0000 7fe758bdc700 1 -- 172.21.15.155:0/3754248824 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55d4bc9cc240 con 0x55d4bc8b1c00 2024-04-19T23:47:22.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.426+0000 7fe75a431a80 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d4bc9c2c00 0x55d4bc80a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.426+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:3 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d4bc9c3000 con 0x55d4bc9c2c00 2024-04-19T23:47:22.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.426+0000 7fe7583db700 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d4bc9c2c00 0x55d4bc80a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.426+0000 7fe7583db700 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d4bc9c2c00 0x55d4bc80a680 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe7583db700 1 -- 172.21.15.155:0/3754248824 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(3 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [call out=24b,read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+444 (crc 0 0 0) 0x55d4bc9cc900 con 0x55d4bc9c2c00 2024-04-19T23:47:22.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 -- 172.21.15.155:0/2403791217 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0c00 msgr2=0x55d4bc809600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 --2- 172.21.15.155:0/2403791217 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0c00 0x55d4bc809600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55d4bc900930 tx=0x55d4bc871140 comp rx=0 tx=0).stop 2024-04-19T23:47:22.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 -- 172.21.15.155:0/2403791217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 msgr2=0x55d4bc808b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 --2- 172.21.15.155:0/2403791217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x55d4bd39c210 tx=0x55d4bc8703c0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 -- 172.21.15.155:0/2403791217 shutdown_connections 2024-04-19T23:47:22.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 --2- 172.21.15.155:0/2403791217 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0c00 0x55d4bc809600 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 --2- 172.21.15.155:0/2403791217 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521400 0x55d4bc808b00 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 -- 172.21.15.155:0/2403791217 >> 172.21.15.155:0/2403791217 conn(0x55d4bc520c00 msgr2=0x55d4bc60d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 -- 172.21.15.155:0/2403791217 shutdown_connections 2024-04-19T23:47:22.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 -- 172.21.15.155:0/2403791217 wait complete. 2024-04-19T23:47:22.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 -- 172.21.15.155:0/953946073 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc9c2000 msgr2=0x55d4bc80ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 --2- 172.21.15.155:0/953946073 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc9c2000 0x55d4bc80ac00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55d4bd2f0030 tx=0x55d4bc984780 comp rx=0 tx=0).stop 2024-04-19T23:47:22.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 -- 172.21.15.155:0/953946073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 msgr2=0x55d4bc809b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.427+0000 7fe75a431a80 1 --2- 172.21.15.155:0/953946073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x55d4bc8ab530 tx=0x55d4bc870b40 comp rx=0 tx=0).stop 2024-04-19T23:47:22.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/953946073 shutdown_connections 2024-04-19T23:47:22.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 --2- 172.21.15.155:0/953946073 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc9c2000 0x55d4bc80ac00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 --2- 172.21.15.155:0/953946073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc521c00 0x55d4bc809b80 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/953946073 >> 172.21.15.155:0/953946073 conn(0x55d4bc521800 msgr2=0x55d4bc60e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/953946073 shutdown_connections 2024-04-19T23:47:22.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/953946073 wait complete. 2024-04-19T23:47:22.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d4bc8b1c00 msgr2=0x55d4bc80a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d4bc8b1c00 0x55d4bc80a100 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d4bc9c2c00 msgr2=0x55d4bc80a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.461 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d4bc9c2c00 0x55d4bc80a680 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0000 msgr2=0x55d4bc809080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0000 0x55d4bc809080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55d4bd39d020 tx=0x55d4bc8708a0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 msgr2=0x55d4bc808580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x55d4bd2f1ec0 tx=0x55d4bc611920 comp rx=0 tx=0).stop 2024-04-19T23:47:22.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 shutdown_connections 2024-04-19T23:47:22.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x55d4bc9c2c00 0x55d4bc80a680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x55d4bc8b1c00 0x55d4bc80a100 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55d4bc520800 0x55d4bc808580 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 --2- 172.21.15.155:0/3754248824 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x55d4bc8b0000 0x55d4bc809080 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 >> 172.21.15.155:0/3754248824 conn(0x55d4bc520400 msgr2=0x55d4bc60d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 shutdown_connections 2024-04-19T23:47:22.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.428+0000 7fe75a431a80 1 -- 172.21.15.155:0/3754248824 wait complete. 2024-04-19T23:47:22.465 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:47:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "415e25ff-1f45-4d94-b7a7-66fe1b576744", 2024-04-19T23:47:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "default", 2024-04-19T23:47:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "api_name": "default", 2024-04-19T23:47:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "is_master": true, 2024-04-19T23:47:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "endpoints": [], 2024-04-19T23:47:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "hostnames": [], 2024-04-19T23:47:22.465 INFO:teuthology.orchestra.run.smithi155.stdout: "hostnames_s3website": [], 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "master_zone": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87", 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "zones": [ 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "id": "1dce6cf8-e9c2-4b48-9dab-6870e4058a87", 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "default", 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "endpoints": [], 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "log_meta": false, 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "log_data": false, 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_index_max_shards": 11, 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "read_only": false, 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "tier_type": "", 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "sync_from_all": true, 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "sync_from": [], 2024-04-19T23:47:22.466 INFO:teuthology.orchestra.run.smithi155.stdout: "redirect_zone": "", 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "supported_features": [ 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "compress-encrypted", 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "resharding" 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_targets": [ 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "name": "default-placement", 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "tags": [], 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "storage_classes": [ 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: "STANDARD" 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.467 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:47:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "default-placement", 2024-04-19T23:47:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "realm_id": "", 2024-04-19T23:47:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "sync_policy": { 2024-04-19T23:47:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "groups": [] 2024-04-19T23:47:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled_features": [ 2024-04-19T23:47:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: "resharding" 2024-04-19T23:47:22.468 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-04-19T23:47:22.468 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:47:22.468 DEBUG:tasks.util.rgw: json result: {'id': '415e25ff-1f45-4d94-b7a7-66fe1b576744', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87', 'zones': [{'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['compress-encrypted', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['resharding']} 2024-04-19T23:47:22.471 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-04-19T23:47:22.487 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-19T23:47:22.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-19T23:47:22.488 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-04-19T23:47:22.604 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setuser ceph since I am not root 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:ignoring --setgroup ceph since I am not root 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.560+0000 7f4dc2242a80 1 Processor -- start 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.560+0000 7f4dc2242a80 1 -- start start 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.560+0000 7f4dc2242a80 1 --2- >> v2:172.21.15.76:3300/0 conn(0x559109530c00 0x559109818580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.560+0000 7f4dc2242a80 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55910985b500 con 0x559109530800 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.560+0000 7f4dc2242a80 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x5591095d2a00 con 0x559109530c00 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.561+0000 7f4dbf9eb700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x559109530c00 0x559109818580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.561+0000 7f4dc01ec700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x559109530800 0x55910961c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.155:47734/0 (socket says 172.21.15.155:47734) 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.561+0000 7f4dc01ec700 1 -- 172.21.15.155:0/4012120440 learned_addr learned my addr 172.21.15.155:0/4012120440 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.561+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/4012120440 >> v1:172.21.15.76:6789/0 conn(0x559109530800 legacy=0x55910961c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.561+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/4012120440 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559109559d40 con 0x559109530c00 2024-04-19T23:47:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.561+0000 7f4dbf1ea700 1 -- 172.21.15.155:0/4012120440 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793761072 0 0) 0x55910a2fe000 con 0x559109530800 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.561+0000 7f4dbf9eb700 1 --2- 172.21.15.155:0/4012120440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530c00 0x559109818580 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x559109813890 tx=0x559109621920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fb5ac59a1f0ba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.561+0000 7f4dbf1ea700 1 -- 172.21.15.155:0/4012120440 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591095e94a0 con 0x559109530c00 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.561+0000 7f4dbf1ea700 1 -- 172.21.15.155:0/4012120440 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55910985b800 con 0x559109530c00 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.561+0000 7f4dbf1ea700 1 -- 172.21.15.155:0/4012120440 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591095e9600 con 0x559109530c00 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.562+0000 7f4dc2242a80 1 -- 172.21.15.155:0/4012120440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530c00 msgr2=0x559109818580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.562+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/4012120440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530c00 0x559109818580 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x559109813890 tx=0x559109621920 comp rx=0 tx=0).stop 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.562+0000 7f4dc2242a80 1 -- 172.21.15.155:0/4012120440 shutdown_connections 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.562+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/4012120440 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530c00 0x559109818580 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.562+0000 7f4dc2242a80 1 -- 172.21.15.155:0/4012120440 >> 172.21.15.155:0/4012120440 conn(0x559109530400 msgr2=0x55910961c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.562+0000 7f4dc2242a80 1 -- 172.21.15.155:0/4012120440 shutdown_connections 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.562+0000 7f4dc2242a80 1 -- 172.21.15.155:0/4012120440 wait complete. 2024-04-19T23:47:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.562+0000 7f4dc2242a80 1 Processor -- start 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.562+0000 7f4dc2242a80 1 -- start start 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.562+0000 7f4dc2242a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.562+0000 7f4dc2242a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591095d2500 con 0x559109530800 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.563+0000 7f4dc01ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.563+0000 7f4dc01ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38778/0 (socket says 172.21.15.155:38778) 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.563+0000 7f4dc01ec700 1 -- 172.21.15.155:0/1421190339 learned_addr learned my addr 172.21.15.155:0/1421190339 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.563+0000 7f4dc01ec700 1 -- 172.21.15.155:0/1421190339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559109559ba0 con 0x559109530800 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.563+0000 7f4dc01ec700 1 --2- 172.21.15.155:0/1421190339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55910a301d70 tx=0x559109621b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e70925e27898a server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.563+0000 7f4dbe9e9700 1 -- 172.21.15.155:0/1421190339 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591095e94a0 con 0x559109530800 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.563+0000 7f4dbe9e9700 1 -- 172.21.15.155:0/1421190339 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55910985bb00 con 0x559109530800 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.563+0000 7f4dbe9e9700 1 -- 172.21.15.155:0/1421190339 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591095e9600 con 0x559109530800 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.563+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1421190339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 msgr2=0x559109818580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.563+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/1421190339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55910a301d70 tx=0x559109621b60 comp rx=0 tx=0).stop 2024-04-19T23:47:22.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.563+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1421190339 shutdown_connections 2024-04-19T23:47:22.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/1421190339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1421190339 >> 172.21.15.155:0/1421190339 conn(0x559109530400 msgr2=0x55910961d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1421190339 shutdown_connections 2024-04-19T23:47:22.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1421190339 wait complete. 2024-04-19T23:47:22.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc2242a80 1 Processor -- start 2024-04-19T23:47:22.608 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc2242a80 1 -- start start 2024-04-19T23:47:22.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc2242a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc2242a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591095d23c0 con 0x559109530800 2024-04-19T23:47:22.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc01ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc01ec700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38788/0 (socket says 172.21.15.155:38788) 2024-04-19T23:47:22.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc01ec700 1 -- 172.21.15.155:0/1050877249 learned_addr learned my addr 172.21.15.155:0/1050877249 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.564+0000 7f4dc01ec700 1 -- 172.21.15.155:0/1050877249 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559109559a00 con 0x559109530800 2024-04-19T23:47:22.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dc01ec700 1 --2- 172.21.15.155:0/1050877249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55910a301e00 tx=0x559109621a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.609 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dbd1e6700 1 -- 172.21.15.155:0/1050877249 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591095e98c0 con 0x559109530800 2024-04-19T23:47:22.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dbd1e6700 1 -- 172.21.15.155:0/1050877249 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5591095d1c80 con 0x559109530800 2024-04-19T23:47:22.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1050877249 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559109559860 con 0x559109530800 2024-04-19T23:47:22.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dbd1e6700 1 -- 172.21.15.155:0/1050877249 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591095e94a0 con 0x559109530800 2024-04-19T23:47:22.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1050877249 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591095596c0 con 0x559109530800 2024-04-19T23:47:22.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dc2242a80 1 Processor -- start 2024-04-19T23:47:22.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dc2242a80 1 -- start start 2024-04-19T23:47:22.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dbd1e6700 1 -- 172.21.15.155:0/1050877249 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55910a2d2b00 con 0x559109530800 2024-04-19T23:47:22.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dc2242a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 0x559109818b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dc2242a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55910956c640 con 0x559109531400 2024-04-19T23:47:22.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.565+0000 7f4dbd1e6700 1 --2- 172.21.15.155:0/1050877249 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5591098b6000 0x559109819080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.610 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dbd1e6700 1 -- 172.21.15.155:0/1050877249 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5591095ab180 con 0x559109530800 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dc09ed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 0x559109818b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dc09ed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 0x559109818b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38804/0 (socket says 172.21.15.155:38804) 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dc09ed700 1 -- 172.21.15.155:0/3880212010 learned_addr learned my addr 172.21.15.155:0/3880212010 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dc01ec700 1 --2- 172.21.15.155:0/1050877249 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5591098b6000 0x559109819080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dc09ed700 1 -- 172.21.15.155:0/3880212010 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559109558000 con 0x559109531400 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dc01ec700 1 --2- 172.21.15.155:0/1050877249 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5591098b6000 0x559109819080 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55910a3c2f00 tx=0x55910987c240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dc09ed700 1 --2- 172.21.15.155:0/3880212010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 0x559109818b00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55910a3c2870 tx=0x55910987cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b6d57994193966 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dba9e1700 1 -- 172.21.15.155:0/3880212010 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591095e98c0 con 0x559109531400 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dba9e1700 1 -- 172.21.15.155:0/3880212010 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55910985a300 con 0x559109531400 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dba9e1700 1 -- 172.21.15.155:0/3880212010 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591095e94a0 con 0x559109531400 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dc2242a80 1 -- 172.21.15.155:0/3880212010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 msgr2=0x559109818b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.566+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/3880212010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 0x559109818b00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55910a3c2870 tx=0x55910987cd20 comp rx=0 tx=0).stop 2024-04-19T23:47:22.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc2242a80 1 -- 172.21.15.155:0/3880212010 shutdown_connections 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/3880212010 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 0x559109818b00 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc2242a80 1 -- 172.21.15.155:0/3880212010 >> 172.21.15.155:0/3880212010 conn(0x559109530c00 msgr2=0x55910961d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc2242a80 1 -- 172.21.15.155:0/3880212010 shutdown_connections 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc2242a80 1 -- 172.21.15.155:0/3880212010 wait complete. 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc2242a80 1 Processor -- start 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc2242a80 1 -- start start 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc2242a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 0x559109818b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc2242a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55910956c8c0 con 0x559109531400 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc09ed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 0x559109818b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc09ed700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 0x559109818b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38816/0 (socket says 172.21.15.155:38816) 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 learned_addr learned my addr 172.21.15.155:0/2005370965 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.567+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559109558ea0 con 0x559109531400 2024-04-19T23:47:22.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.568+0000 7f4dc09ed700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 0x559109818b00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x55910a3c23f0 tx=0x55910987c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.568+0000 7f4db91de700 1 -- 172.21.15.155:0/2005370965 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591095e9b80 con 0x559109531400 2024-04-19T23:47:22.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.568+0000 7f4db91de700 1 -- 172.21.15.155:0/2005370965 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5591095d1c80 con 0x559109531400 2024-04-19T23:47:22.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.568+0000 7f4db91de700 1 -- 172.21.15.155:0/2005370965 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591095e98c0 con 0x559109531400 2024-04-19T23:47:22.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.568+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559109558820 con 0x559109531400 2024-04-19T23:47:22.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.568+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591095589c0 con 0x559109531400 2024-04-19T23:47:22.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.568+0000 7f4db91de700 1 -- 172.21.15.155:0/2005370965 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55910a2d2dc0 con 0x559109531400 2024-04-19T23:47:22.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4db91de700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5591098b6c00 0x559109819600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4db91de700 1 -- 172.21.15.155:0/2005370965 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5591095ab340 con 0x559109531400 2024-04-19T23:47:22.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4dbf9eb700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5591098b6c00 0x559109819600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559109531800 0x559109819b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109531c00 con 0x559109531800 2024-04-19T23:47:22.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4dc09ed700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559109531800 0x559109819b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4dbf9eb700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5591098b6c00 0x559109819600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x559109813890 tx=0x559109621800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4dc09ed700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559109531800 0x559109819b80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4dc2242a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:22.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.569+0000 7f4dc2242a80 20 realm 2024-04-19T23:47:22.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591098b7000 con 0x559109531800 2024-04-19T23:47:22.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591098b7400 con 0x559109531800 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591098b7800 con 0x559109531800 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.570+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:5 5.18 5:1abdf84e:::zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591098b7c00 con 0x559109531800 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.571+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 5 ==== osd_op_reply(5 zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 [read 0~874 out=874b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.571+0000 7f4dc2242a80 20 rados_obj.operate() r=0 bl.length=874 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.571+0000 7f4dc2242a80 20 searching for the correct realm 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.571+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5591098b7000 0x55910981a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.571+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591098b7400 con 0x5591098b7000 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.571+0000 7f4dc01ec700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5591098b7000 0x55910981a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.571+0000 7f4dc01ec700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5591098b7000 0x55910981a100 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.571+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.572+0000 7f4dc01ec700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5591098b7400 0x55910981ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.572+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a000 con 0x5591098b7400 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.572+0000 7f4dbf9eb700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5591098b7400 0x55910981ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.572+0000 7f4dbf9eb700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5591098b7400 0x55910981ac00 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.572+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.572+0000 7f4dbf9eb700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55910997a000 0x55910981b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.572+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x55910997a000 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.572+0000 7f4dc09ed700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55910997a000 0x55910981b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.573+0000 7f4dc09ed700 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55910997a000 0x55910981b180 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.573+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.573+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x559109531800 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.573+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.573+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x559109531800 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.574+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.574+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x559109531800 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.574+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 8 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.574+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x55910997a000 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.574+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.574+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7400 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.574+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.574+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7000 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.574+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.574+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x559109531800 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.575+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 9 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.575+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x55910997a000 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.575+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.575+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x559109531800 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.575+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 10 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.575+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7400 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.575+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.575+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7000 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.576+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.576+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7000 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.576+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.576+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7400 2024-04-19T23:47:22.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.576+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.576+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7000 2024-04-19T23:47:22.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.576+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.576+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7000 2024-04-19T23:47:22.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.576+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.576+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x559109531800 2024-04-19T23:47:22.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.577+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.577+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x559109531800 2024-04-19T23:47:22.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.577+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.577+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x55910997a000 2024-04-19T23:47:22.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.577+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.577+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7000 2024-04-19T23:47:22.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.577+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.577+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7400 2024-04-19T23:47:22.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.578+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.578+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x559109531800 2024-04-19T23:47:22.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.578+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.578+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x55910997a000 2024-04-19T23:47:22.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.578+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.578+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7000 2024-04-19T23:47:22.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.578+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.578+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x55910997a000 2024-04-19T23:47:22.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.579+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.579+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7400 2024-04-19T23:47:22.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.579+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.579+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7000 2024-04-19T23:47:22.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.579+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.579+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x55910997a000 2024-04-19T23:47:22.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.579+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.579+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x559109531800 2024-04-19T23:47:22.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 14 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7400 2024-04-19T23:47:22.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 20 RGWRados::pool_iterate: got zone_info.1dce6cf8-e9c2-4b48-9dab-6870e4058a87 2024-04-19T23:47:22.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 20 RGWRados::pool_iterate: got default.zone. 2024-04-19T23:47:22.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 20 RGWRados::pool_iterate: got zone_names.default 2024-04-19T23:47:22.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-19T23:47:22.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 20 RGWRados::pool_iterate: got zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 2024-04-19T23:47:22.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109531c00 con 0x559109531800 2024-04-19T23:47:22.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:22.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997ac00 con 0x559109531800 2024-04-19T23:47:22.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 20 rados_obj.operate() r=0 bl.length=46 2024-04-19T23:47:22.625 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.580+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:40 5.1f 5:f8e50932:::zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997b000 con 0x5591098b7400 2024-04-19T23:47:22.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 8 ==== osd_op_reply(40 zonegroup_info.415e25ff-1f45-4d94-b7a7-66fe1b576744 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 20 rados_obj.operate() r=0 bl.length=420 2024-04-19T23:47:22.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 20 zone default found 2024-04-19T23:47:22.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 4 Realm: () 2024-04-19T23:47:22.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 4 ZoneGroup: default (415e25ff-1f45-4d94-b7a7-66fe1b576744) 2024-04-19T23:47:22.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 4 Zone: default (1dce6cf8-e9c2-4b48-9dab-6870e4058a87) 2024-04-19T23:47:22.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-19T23:47:22.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 20 zonegroup default 2024-04-19T23:47:22.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997b400 con 0x55910997a000 2024-04-19T23:47:22.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:22.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997b800 con 0x5591098b7000 2024-04-19T23:47:22.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:22.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.581+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997bc00 con 0x5591098b7000 2024-04-19T23:47:22.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.582+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.582+0000 7f4dc2242a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:22.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.582+0000 7f4dc2242a80 20 started sync module instance, tier type = 2024-04-19T23:47:22.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.582+0000 7f4dc2242a80 20 started zone id=1dce6cf8-e9c2-4b48-9dab-6870e4058a87 (name=default) with tier type = 2024-04-19T23:47:22.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.582+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997ac00 con 0x5591098b7400 2024-04-19T23:47:22.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.583+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 9 ==== osd_op_reply(44 notify.0 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.583+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94081418066688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109531c00 con 0x5591098b7400 2024-04-19T23:47:22.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.583+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591098b7800 con 0x559109531800 2024-04-19T23:47:22.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.584+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94081418066688] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.584+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 17 ==== osd_op_reply(46 notify.1 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.584+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94081418067840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591098b7c00 con 0x559109531800 2024-04-19T23:47:22.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.584+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x5591098b7000 2024-04-19T23:47:22.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.585+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94081418067840] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.585+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 12 ==== osd_op_reply(48 notify.2 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.585+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94081418068992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997b000 con 0x5591098b7000 2024-04-19T23:47:22.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.585+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997ac00 con 0x5591098b7400 2024-04-19T23:47:22.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.586+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94081418068992] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.586+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 11 ==== osd_op_reply(50 notify.3 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.586+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94081418070144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a400 con 0x5591098b7400 2024-04-19T23:47:22.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.586+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997b800 con 0x559109531800 2024-04-19T23:47:22.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.587+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 19 ==== osd_op_reply(52 notify.4 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.587+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94081418071296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997bc00 con 0x559109531800 2024-04-19T23:47:22.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.587+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94081418070144] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.587+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997a800 con 0x55910997a000 2024-04-19T23:47:22.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.588+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94081418071296] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.588+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 9 ==== osd_op_reply(54 notify.5 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.588+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94081418072448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997b400 con 0x55910997a000 2024-04-19T23:47:22.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.588+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997b800 con 0x55910997a000 2024-04-19T23:47:22.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.589+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94081418072448] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.589+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 11 ==== osd_op_reply(56 notify.6 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.589+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94081418073600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997bc00 con 0x55910997a000 2024-04-19T23:47:22.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.589+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591098b7800 con 0x55910997a000 2024-04-19T23:47:22.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.590+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 12 ==== osd_op_reply(58 notify.7 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.590+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94081418073600] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.590+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94081418074752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591098b7c00 con 0x55910997a000 2024-04-19T23:47:22.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.590+0000 7f4dc2242a80 20 add_watcher() i=0 2024-04-19T23:47:22.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.590+0000 7f4dc2242a80 20 add_watcher() i=1 2024-04-19T23:47:22.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.590+0000 7f4dc2242a80 20 add_watcher() i=2 2024-04-19T23:47:22.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.590+0000 7f4dc2242a80 20 add_watcher() i=3 2024-04-19T23:47:22.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.590+0000 7f4dc2242a80 20 add_watcher() i=4 2024-04-19T23:47:22.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.590+0000 7f4dc2242a80 20 add_watcher() i=5 2024-04-19T23:47:22.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.590+0000 7f4dc2242a80 20 add_watcher() i=6 2024-04-19T23:47:22.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.591+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94081418074752] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.592+0000 7f4dc2242a80 20 add_watcher() i=7 2024-04-19T23:47:22.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.592+0000 7f4dc2242a80 2 all 8 watchers are set, enabling cache 2024-04-19T23:47:22.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.592+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591098b7800 con 0x559109531800 2024-04-19T23:47:22.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.592+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.592+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94081419616256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5591098b7c00 con 0x559109531800 2024-04-19T23:47:22.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.593+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94081419616256] v32'243 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.593+0000 7f4da71ba700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:47:22.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.593+0000 7f4dc2242a80 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-19T23:47:22.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.593+0000 7f4dc2242a80 20 check_secure_mon_conn(): mode 1 is insecure 2024-04-19T23:47:22.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.593+0000 7f4dc2242a80 1 Processor -- start 2024-04-19T23:47:22.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.593+0000 7f4dc2242a80 1 -- start start 2024-04-19T23:47:22.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.593+0000 7f4dc2242a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.593+0000 7f4dc2242a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591095d23c0 con 0x55910997b400 2024-04-19T23:47:22.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.594+0000 7f4dbf9eb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.594+0000 7f4dbf9eb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38828/0 (socket says 172.21.15.155:38828) 2024-04-19T23:47:22.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.594+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/3999846647 learned_addr learned my addr 172.21.15.155:0/3999846647 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.594+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/3999846647 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559109558b60 con 0x55910997b400 2024-04-19T23:47:22.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.594+0000 7f4dbf9eb700 1 --2- 172.21.15.155:0/3999846647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x5591098cb410 tx=0x55910987dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c9f0f798b3639 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.594+0000 7f4da69b9700 1 -- 172.21.15.155:0/3999846647 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591095e9760 con 0x55910997b400 2024-04-19T23:47:22.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.594+0000 7f4da69b9700 1 -- 172.21.15.155:0/3999846647 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5591099a2000 con 0x55910997b400 2024-04-19T23:47:22.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.594+0000 7f4da69b9700 1 -- 172.21.15.155:0/3999846647 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591099a4000 con 0x55910997b400 2024-04-19T23:47:22.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.595+0000 7f4dc2242a80 1 -- 172.21.15.155:0/3999846647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 msgr2=0x55910981a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.595+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/3999846647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x5591098cb410 tx=0x55910987dda0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.595+0000 7f4dc2242a80 1 -- 172.21.15.155:0/3999846647 shutdown_connections 2024-04-19T23:47:22.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.595+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/3999846647 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.595+0000 7f4dc2242a80 1 -- 172.21.15.155:0/3999846647 >> 172.21.15.155:0/3999846647 conn(0x55910997a800 msgr2=0x55910961e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.595+0000 7f4dc2242a80 1 -- 172.21.15.155:0/3999846647 shutdown_connections 2024-04-19T23:47:22.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.595+0000 7f4dc2242a80 1 -- 172.21.15.155:0/3999846647 wait complete. 2024-04-19T23:47:22.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.595+0000 7f4dc2242a80 1 Processor -- start 2024-04-19T23:47:22.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.595+0000 7f4dc2242a80 1 -- start start 2024-04-19T23:47:22.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.595+0000 7f4dc2242a80 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.595+0000 7f4dc2242a80 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591095d2500 con 0x55910997b400 2024-04-19T23:47:22.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.596+0000 7f4dbf9eb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.596+0000 7f4dbf9eb700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.155:38830/0 (socket says 172.21.15.155:38830) 2024-04-19T23:47:22.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.596+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2416992400 learned_addr learned my addr 172.21.15.155:0/2416992400 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-19T23:47:22.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.596+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2416992400 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559109558d00 con 0x55910997b400 2024-04-19T23:47:22.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.596+0000 7f4dbf9eb700 1 --2- 172.21.15.155:0/2416992400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x55910998f800 tx=0x559109621980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.596+0000 7f4da51b6700 1 -- 172.21.15.155:0/2416992400 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591099a4160 con 0x55910997b400 2024-04-19T23:47:22.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.596+0000 7f4da51b6700 1 -- 172.21.15.155:0/2416992400 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5591099a2180 con 0x55910997b400 2024-04-19T23:47:22.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.596+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2416992400 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559109558340 con 0x55910997b400 2024-04-19T23:47:22.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.596+0000 7f4da51b6700 1 -- 172.21.15.155:0/2416992400 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5591099a42c0 con 0x55910997b400 2024-04-19T23:47:22.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.596+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2416992400 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559109559d40 con 0x55910997b400 2024-04-19T23:47:22.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.597+0000 7f4da51b6700 1 -- 172.21.15.155:0/2416992400 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x55910a2d3b80 con 0x55910997b400 2024-04-19T23:47:22.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.597+0000 7f4da51b6700 1 --2- 172.21.15.155:0/2416992400 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559109a1e000 0x55910981b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:47:22.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.597+0000 7f4da51b6700 1 -- 172.21.15.155:0/2416992400 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x5591095ab500 con 0x55910997b400 2024-04-19T23:47:22.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.597+0000 7f4dc2242a80 5 note: GC not initialized 2024-04-19T23:47:22.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.597+0000 7f4dc09ed700 1 --2- 172.21.15.155:0/2416992400 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559109a1e000 0x55910981b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:47:22.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.598+0000 7f4dc09ed700 1 --2- 172.21.15.155:0/2416992400 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559109a1e000 0x55910981b700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x559109921f80 tx=0x55910987dbc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:47:22.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.598+0000 7f4da29b1700 20 reqs_thread_entry: start 2024-04-19T23:47:22.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.598+0000 7f4dc2242a80 20 init_complete bucket index max shards: 11 2024-04-19T23:47:22.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.598+0000 7f4dc2242a80 10 rgw notify: Started notification manager with: 1 workers 2024-04-19T23:47:22.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.598+0000 7f4da09ad700 20 rgw notify: INFO: next queues processing will happen at: Fri Apr 19 23:47:52 2024 2024-04-19T23:47:22.643 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-19T23:47:22.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4da018b700 20 reqs_thread_entry: start 2024-04-19T23:47:22.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-19T23:47:22.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55910997bc00 con 0x55910997a000 2024-04-19T23:47:22.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 15 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:22.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-04-19T23:47:22.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-19T23:47:22.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-04-19T23:47:22.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 20 rados->read ofs=0 len=0 2024-04-19T23:47:22.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a1e400 con 0x559109531800 2024-04-19T23:47:22.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 23 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 20 rados_obj.operate() r=-2 bl.length=0 2024-04-19T23:47:22.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-04-19T23:47:22.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-19T23:47:22.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-19T23:47:22.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-19T23:47:22.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.599+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~439 in=439b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a1e800 con 0x55910997a000 2024-04-19T23:47:22.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.600+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 16 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~439] v32'6 uv6 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dc2242a80 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-19T23:47:22.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dc2242a80 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-19T23:47:22.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dc2242a80 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-19T23:47:22.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94081419618560 in=627b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a1ec00 con 0x559109531800 2024-04-19T23:47:22.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 24 ==== watch-notify(notify (1) cookie 94081418071296 notify 137438953493 ret 0) v3 ==== 657+0+0 (crc 0 0 0) 0x559109925d40 con 0x559109531800 2024-04-19T23:47:22.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dba9e1700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94081418071296 notifier 4909 bl.length()=615 2024-04-19T23:47:22.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dba9e1700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-19T23:47:22.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dba9e1700 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-19T23:47:22.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 25 ==== osd_op_reply(65 notify.4 [notify cookie 94081419618560 out=8b] v0'0 uv240 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.646 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dba9e1700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a90000 con 0x559109531800 2024-04-19T23:47:22.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 27 ==== watch-notify(notify_complete (2) cookie 94081419618560 notify 137438953493 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5591099e7ba0 con 0x559109531800 2024-04-19T23:47:22.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.601+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a1f000 con 0x559109531800 2024-04-19T23:47:22.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.602+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 28 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v32'23 uv23 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.602+0000 7f4dc2242a80 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-19T23:47:22.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.602+0000 7f4dc2242a80 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-19T23:47:22.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.602+0000 7f4dc2242a80 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-04-19T23:47:22.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.602+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94081419618560 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a1f400 con 0x5591098b7000 2024-04-19T23:47:22.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.603+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 14 ==== watch-notify(notify (1) cookie 94081418068992 notify 137438953495 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55910987bd40 con 0x5591098b7000 2024-04-19T23:47:22.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.603+0000 7f4dba9e1700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94081418068992 notifier 4909 bl.length()=177 2024-04-19T23:47:22.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.603+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 15 ==== osd_op_reply(68 notify.2 [notify cookie 94081419618560 out=8b] v0'0 uv240 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.603+0000 7f4dba9e1700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-19T23:47:22.648 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.603+0000 7f4dba9e1700 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-19T23:47:22.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.603+0000 7f4dba9e1700 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a90400 con 0x5591098b7000 2024-04-19T23:47:22.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.603+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.649 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.603+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 17 ==== watch-notify(notify_complete (2) cookie 94081419618560 notify 137438953495 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5591099e5a00 con 0x5591098b7000 2024-04-19T23:47:22.649 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-19T23:47:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "user_id": "ada", 2024-04-19T23:47:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "display_name": "Ms. Admin User", 2024-04-19T23:47:22.649 INFO:teuthology.orchestra.run.smithi155.stdout: "email": "", 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "suspended": 0, 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "max_buckets": 0, 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "subusers": [], 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "keys": [ 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "user": "ada", 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "access_key": "MH1WC2XQ1S8UISFDZC8W", 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "secret_key": "dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG" 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "swift_keys": [], 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": [ 2024-04-19T23:47:22.650 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "buckets", 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "perm": "*" 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "info", 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "perm": "read" 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "ratelimit", 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "perm": "*" 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "usage", 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: "perm": "*" 2024-04-19T23:47:22.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "users", 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "perm": "*" 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "zone", 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "perm": "*" 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: ], 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "op_mask": "read, write, delete", 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "default_placement": "", 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "default_storage_class": "", 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "placement_tags": [], 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "bucket_quota": { 2024-04-19T23:47:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "user_quota": { 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "enabled": false, 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "check_on_raw": false, 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size": -1, 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "max_size_kb": 0, 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "max_objects": -1 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "temp_url_keys": [], 2024-04-19T23:47:22.653 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "rgw", 2024-04-19T23:47:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: "mfa_ids": [] 2024-04-19T23:47:22.654 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-19T23:47:22.654 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-19T23:47:22.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.604+0000 7f4da71ba700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-19T23:47:22.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.604+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94081419616256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a1f800 con 0x559109531800 2024-04-19T23:47:22.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.605+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94081419616256] v32'244 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.605+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94081418066688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a1fc00 con 0x5591098b7400 2024-04-19T23:47:22.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.606+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94081418066688] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.606+0000 7f4dc2242a80 20 remove_watcher() i=0 2024-04-19T23:47:22.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.606+0000 7f4dc2242a80 2 removed watcher, disabling cache 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.606+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94081418067840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a90000 con 0x559109531800 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.607+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94081418067840] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.607+0000 7f4dc2242a80 20 remove_watcher() i=1 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.607+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94081418068992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a90800 con 0x5591098b7000 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.608+0000 7f4dc01ec700 1 -- 172.21.15.155:0/2005370965 <== osd.3 v2:172.21.15.155:6808/41835 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94081418068992] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109973200 con 0x5591098b7000 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.608+0000 7f4dc2242a80 20 remove_watcher() i=2 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.608+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94081418070144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a90c00 con 0x5591098b7400 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.609+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 <== osd.2 v2:172.21.15.155:6812/41834 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94081418070144] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109973440 con 0x5591098b7400 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.609+0000 7f4dc2242a80 20 remove_watcher() i=3 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.609+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94081418071296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a91000 con 0x559109531800 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.610+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.1 v2:172.21.15.155:6800/41833 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94081418071296] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x559109531800 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.610+0000 7f4dc2242a80 20 remove_watcher() i=4 2024-04-19T23:47:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.610+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94081418072448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a91400 con 0x55910997a000 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.611+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94081418072448] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.611+0000 7f4dc2242a80 20 remove_watcher() i=5 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.611+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94081418073600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a91800 con 0x55910997a000 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.612+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94081418073600] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.612+0000 7f4dc2242a80 20 remove_watcher() i=6 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.612+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 --> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94081418074752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559109a91c00 con 0x55910997a000 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc09ed700 1 -- 172.21.15.155:0/2005370965 <== osd.0 v2:172.21.15.76:6800/39408 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94081418074752] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559109972b40 con 0x55910997a000 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 20 remove_watcher() i=7 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55910997a000 msgr2=0x55910981b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.76:6800/39408,v1:172.21.15.76:6801/39408] conn(0x55910997a000 0x55910981b180 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559109531800 msgr2=0x559109819b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6800/41833,v1:172.21.15.155:6801/41833] conn(0x559109531800 0x559109819b80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5591098b7400 msgr2=0x55910981ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6812/41834,v1:172.21.15.155:6814/41834] conn(0x5591098b7400 0x55910981ac00 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5591098b7000 msgr2=0x55910981a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6808/41835,v1:172.21.15.155:6809/41835] conn(0x5591098b7000 0x55910981a100 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5591098b6c00 msgr2=0x559109819600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5591098b6c00 0x559109819600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x559109813890 tx=0x559109621800 comp rx=0 tx=0).stop 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 msgr2=0x559109818b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2005370965 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109531400 0x559109818b00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x55910a3c23f0 tx=0x55910987c120 comp rx=0 tx=0).stop 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 reap_dead start 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dbf9eb700 1 -- 172.21.15.155:0/2005370965 reap_dead start 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 shutdown_connections 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 >> 172.21.15.155:0/2005370965 conn(0x559109530c00 msgr2=0x55910961d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 shutdown_connections 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.613+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2005370965 wait complete. 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2416992400 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559109a1e000 msgr2=0x55910981b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2416992400 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559109a1e000 0x55910981b700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x559109921f80 tx=0x55910987dbc0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2416992400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 msgr2=0x55910981a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2416992400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x55910998f800 tx=0x559109621980 comp rx=0 tx=0).stop 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2416992400 shutdown_connections 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2416992400 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x559109a1e000 0x55910981b700 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/2416992400 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55910997b400 0x55910981a680 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2416992400 >> 172.21.15.155:0/2416992400 conn(0x55910997a800 msgr2=0x55910961e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2416992400 shutdown_connections 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/2416992400 wait complete. 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1050877249 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5591098b6000 msgr2=0x559109819080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/1050877249 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5591098b6000 0x559109819080 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55910a3c2f00 tx=0x55910987c240 comp rx=0 tx=0).stop 2024-04-19T23:47:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1050877249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 msgr2=0x559109818580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:47:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/1050877249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55910a301e00 tx=0x559109621a40 comp rx=0 tx=0).stop 2024-04-19T23:47:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1050877249 shutdown_connections 2024-04-19T23:47:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/1050877249 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x5591098b6000 0x559109819080 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 --2- 172.21.15.155:0/1050877249 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559109530800 0x559109818580 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:47:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1050877249 >> 172.21.15.155:0/1050877249 conn(0x559109530400 msgr2=0x55910961d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:47:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1050877249 shutdown_connections 2024-04-19T23:47:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-19T23:47:22.614+0000 7f4dc2242a80 1 -- 172.21.15.155:0/1050877249 wait complete. 2024-04-19T23:47:22.665 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:22.666 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:22.666 ERROR:root:0 2024-04-19T23:47:22.667 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:47:22.712 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000d347c15fcab56ef5-006623028a-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:47:22.713 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-04-19T23:47:22.760 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:22.760 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-04-19T23:47:22.809 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-04-19T23:47:22.810 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-04-19T23:47:22.831 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-19T23:47:22.831 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-19T23:47:22.877 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-04-19T23:47:22.878 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:47:22.890 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:22.891 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-04-19T23:47:22.920 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:22.920 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-19T23:47:22.934 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:22.934 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:47:22.963 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:22.964 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-19T23:47:23.008 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:23.009 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:47:23.032 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:23.033 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-04-19T23:47:23.050 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}] 2024-04-19T23:47:23.051 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:47:23.089 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:23.090 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-04-19T23:47:23.106 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:47:23.106 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:47:23.130 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:23.130 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-04-19T23:47:23.147 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-04-19T23:47:23.148 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:47:23.170 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:23.170 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-04-19T23:47:23.206 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-04-19T23:47:23.207 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:47:23.219 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:23.220 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-04-19T23:47:23.255 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:47:23.255 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:47:23.267 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:23.267 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-04-19T23:47:23.289 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:47:23.289 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:47:23.301 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:23.302 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-04-19T23:47:23.324 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:47:23.324 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:47:23.336 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:23.337 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-19T23:47:23.350 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-19T23:47:23.351 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-19T23:47:23.365 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-19T23:47:23.390 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-19T23:47:23.404 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-04-19T23:47:23.405 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-19T23:47:23.423 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '415e25ff-1f45-4d94-b7a7-66fe1b576744', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.9', 'marker': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.9', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-19T23:47:23.384891Z', 'creation_time': '2024-04-19T23:47:23.379511Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-19T23:47:23.424 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-19T23:47:23.478 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '415e25ff-1f45-4d94-b7a7-66fe1b576744', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.9', 'marker': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.9', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-19T23:47:23.384891Z', 'creation_time': '2024-04-19T23:47:23.379511Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-19T23:47:23.484 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-19T23:47:23.502 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '415e25ff-1f45-4d94-b7a7-66fe1b576744', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.9', 'marker': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.9', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-19T23:47:23.384891Z', 'creation_time': '2024-04-19T23:47:23.379511Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-19T23:47:23.502 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-04-19T23:47:23.515 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000481a34ddc0a1f114-006623028b-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:47:23.520 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-04-19T23:47:23.537 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:47:23.537 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-04-19T23:47:23.589 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:47:23.598 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.9'} 2024-04-19T23:47:23.620 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:47:23.667 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.9'} 2024-04-19T23:47:23.687 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:47:23.687 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-04-19T23:47:23.717 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:47:23.732 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-04-19T23:47:23.755 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:47:23.755 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-19T23:47:23.777 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '415e25ff-1f45-4d94-b7a7-66fe1b576744', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.9', 'marker': '1dce6cf8-e9c2-4b48-9dab-6870e4058a87.4223.9', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-19T23:47:23.683014Z', 'creation_time': '2024-04-19T23:47:23.379511Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-19T23:48:23.831 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-04-19T23:48:23.857 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-04-19T23:48:23.858 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-04-19T23:48:23.892 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-04-19T23:48:23.892 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-19T23:48:23.913 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-04-19T23:48:23.913 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-04-19T23:48:23.937 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-04-19T23:48:23.937 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-04-19T23:48:23.949 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-04-19T23:48:23.949 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-04-19T23:48:23.972 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-04-19T23:48:23.973 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-04-19T23:48:23.985 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-04-19T23:00:00.000000Z', 'epoch': 1713567600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-04-19T23:48:23.986 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-04-19T23:48:24.001 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:48:24.001 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-19T23:48:24.029 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-04-19T23:48:24.029 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-19T23:48:24.046 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:48:24.074 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-19T23:48:24.124 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:48:24.394 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-19T23:48:24.407 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000091de7e4404efacd2-00662302c8-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:48:24.507 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-19T23:48:24.521 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'email': '', 'permission': {'flags': 15}, 'name': 'Foo', 'group': 0, 'url_spec': ''}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-19T23:48:24.525 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-19T23:48:24.551 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'id': '', 'email': '', 'permission': {'flags': 1}, 'name': '', 'group': 1, 'url_spec': ''}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'email': '', 'permission': {'flags': 15}, 'name': 'Foo', 'group': 0, 'url_spec': ''}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-19T23:48:24.650 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-04-19T23:48:24.710 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:48:24.711 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-19T23:48:24.724 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-04-19T23:48:24.724 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-19T23:48:24.738 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-19T23:48:24.749 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-19T23:48:24.774 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000468e1e8c9eb80914-00662302c8-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:48:24.781 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-04-19T23:48:24.831 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:48:24.832 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-19T23:48:24.852 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000c4b279112f8e0c29-00662302c8-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:48:24.852 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-04-19T23:48:24.873 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'b5aadf88-3af0-412d-86c8-081593c483a2'}]}} 2024-04-19T23:48:24.873 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-04-19T23:48:24.912 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-19T23:48:24.913 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-19T23:48:24.924 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-19T23:48:24.924 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-04-19T23:48:24.949 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000f0e5b445ada975d2-00662302c8-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:48:24.949 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-04-19T23:48:24.959 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000f3d1789f2b4a0730-00662302c8-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:48:24.970 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-19T23:48:24.994 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-19T23:48:24.994 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-04-19T23:48:25.017 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000ee44ab4f0386b85f-00662302c9-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:48:25.017 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-04-19T23:48:25.028 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000c794b8d64b964d10-00662302c9-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:48:25.028 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-04-19T23:48:25.053 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-19T23:48:25.053 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-04-19T23:48:25.066 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000005a0cbaa68b3248f-00662302c9-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:48:25.066 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-04-19T23:48:25.079 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000dc6dda0aee581ac5-00662302c9-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:48:25.080 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-04-19T23:48:25.092 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b8bee769179c6a0a-00662302c9-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:48:25.092 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-04-19T23:48:25.135 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000d9bfdb771ec706e3-00662302c9-107d-default', 'HostId': '107d-default-default'} 2024-04-19T23:48:25.135 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-04-19T23:48:25.154 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:48:25.154 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-19T23:48:25.177 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-04-19T23:48:25.177 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-04-19T23:48:25.191 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:48:25.191 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-19T23:48:25.222 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-04-19T23:48:25.222 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-04-19T23:48:25.248 INFO:tasks.radosgw_admin_rest: empty result 2024-04-19T23:48:25.252 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-19T23:48:25.262 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-19T23:48:25.262 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T23:48:25.263 INFO:tasks.rgw.client.0.smithi155.stdout:2024-04-19T23:48:25.263+0000 7f21d3edb700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 46938) UID: 0 2024-04-19T23:48:25.263 INFO:tasks.rgw.client.0.smithi155.stdout:2024-04-19T23:48:25.263+0000 7f21d8148a80 -1 shutting down 2024-04-19T23:48:26.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-19T23:48:31.365 INFO:tasks.rgw.client.0:Stopped 2024-04-19T23:48:31.365 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-19T23:48:31.387 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/vault-root-token 2024-04-19T23:48:31.458 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-19T23:48:31.468 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-19T23:48:31.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.602+0000 7f3a1320b700 1 Processor -- start 2024-04-19T23:48:31.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.602+0000 7f3a1320b700 1 -- start start 2024-04-19T23:48:31.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.602+0000 7f3a1320b700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f3a0c0939f0 0x7f3a0c093dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:48:31.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.602+0000 7f3a1320b700 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0c06d980 con 0x7f3a0c094310 2024-04-19T23:48:31.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.602+0000 7f3a1320b700 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c095a50 con 0x7f3a0c0939f0 2024-04-19T23:48:31.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.602+0000 7f3a10fa7700 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f3a0c0939f0 0x7f3a0c093dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.602+0000 7f3a0bfff700 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f3a0c094310 0x7f3a0c129e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:33044/0 (socket says 172.21.15.76:33044) 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.602+0000 7f3a0bfff700 1 -- 172.21.15.76:0/1128389275 learned_addr learned my addr 172.21.15.76:0/1128389275 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.603+0000 7f3a10fa7700 1 -- 172.21.15.76:0/1128389275 >> v1:172.21.15.76:6789/0 conn(0x7f3a0c094310 legacy=0x7f3a0c129e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.603+0000 7f3a10fa7700 1 -- 172.21.15.76:0/1128389275 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c06d590 con 0x7f3a0c0939f0 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.603+0000 7f3a10fa7700 1 --2- 172.21.15.76:0/1128389275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a0c0939f0 0x7f3a0c093dd0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3a000097c0 tx=0x7f3a00009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc441ae5e57f929 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.603+0000 7f3a0b7fe700 1 -- 172.21.15.76:0/1128389275 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a00004160 con 0x7f3a0c0939f0 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.603+0000 7f3a0b7fe700 1 -- 172.21.15.76:0/1128389275 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a000042c0 con 0x7f3a0c0939f0 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.603+0000 7f3a0b7fe700 1 -- 172.21.15.76:0/1128389275 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a00004580 con 0x7f3a0c0939f0 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.603+0000 7f3a1320b700 1 -- 172.21.15.76:0/1128389275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a0c0939f0 msgr2=0x7f3a0c093dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.603+0000 7f3a1320b700 1 --2- 172.21.15.76:0/1128389275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a0c0939f0 0x7f3a0c093dd0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3a000097c0 tx=0x7f3a00009ad0 comp rx=0 tx=0).stop 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.604+0000 7f3a1320b700 1 -- 172.21.15.76:0/1128389275 shutdown_connections 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.604+0000 7f3a1320b700 1 --2- 172.21.15.76:0/1128389275 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a0c0939f0 0x7f3a0c093dd0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:48:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.604+0000 7f3a1320b700 1 -- 172.21.15.76:0/1128389275 >> 172.21.15.76:0/1128389275 conn(0x7f3a0c099b60 msgr2=0x7f3a0c099f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:48:31.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.604+0000 7f3a1320b700 1 -- 172.21.15.76:0/1128389275 shutdown_connections 2024-04-19T23:48:31.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.604+0000 7f3a1320b700 1 -- 172.21.15.76:0/1128389275 wait complete. 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.604+0000 7f3a1320b700 1 Processor -- start 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.604+0000 7f3a1320b700 1 -- start start 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.605+0000 7f3a1320b700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a0c0939f0 0x7f3a0c1bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.605+0000 7f3a1320b700 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c1a5bb0 con 0x7f3a0c0939f0 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.605+0000 7f3a10fa7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a0c0939f0 0x7f3a0c1bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.605+0000 7f3a10fa7700 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a0c0939f0 0x7f3a0c1bddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46900/0 (socket says 172.21.15.76:46900) 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.605+0000 7f3a10fa7700 1 -- 172.21.15.76:0/829221627 learned_addr learned my addr 172.21.15.76:0/829221627 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.605+0000 7f3a10fa7700 1 -- 172.21.15.76:0/829221627 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a000094a0 con 0x7f3a0c0939f0 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.605+0000 7f3a10fa7700 1 --2- 172.21.15.76:0/829221627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a0c0939f0 0x7f3a0c1bddb0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0950d0 tx=0x7f3a000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.606+0000 7f3a097fa700 1 -- 172.21.15.76:0/829221627 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a00003df0 con 0x7f3a0c0939f0 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.606+0000 7f3a097fa700 1 -- 172.21.15.76:0/829221627 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a00011630 con 0x7f3a0c0939f0 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.606+0000 7f3a097fa700 1 -- 172.21.15.76:0/829221627 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a000118d0 con 0x7f3a0c0939f0 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.606+0000 7f3a1320b700 1 -- 172.21.15.76:0/829221627 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0c0716b0 con 0x7f3a0c0939f0 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.606+0000 7f3a1320b700 1 -- 172.21.15.76:0/829221627 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0c0916b0 con 0x7f3a0c0939f0 2024-04-19T23:48:31.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.606+0000 7f3a097fa700 1 -- 172.21.15.76:0/829221627 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 44817+0+0 (secure 0 0 0) 0x7f3a00011a30 con 0x7f3a0c0939f0 2024-04-19T23:48:31.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.607+0000 7f3a1320b700 1 -- 172.21.15.76:0/829221627 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0c0927b0 con 0x7f3a0c0939f0 2024-04-19T23:48:31.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.607+0000 7f3a097fa700 1 --2- 172.21.15.76:0/829221627 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f39f0037790 0x7f39f0039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-19T23:48:31.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.607+0000 7f3a097fa700 1 -- 172.21.15.76:0/829221627 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5938+0+0 (secure 0 0 0) 0x7f3a0004c3b0 con 0x7f3a0c0939f0 2024-04-19T23:48:31.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.607+0000 7f3a0bfff700 1 --2- 172.21.15.76:0/829221627 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f39f0037790 0x7f39f0039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-19T23:48:31.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.607+0000 7f3a0bfff700 1 --2- 172.21.15.76:0/829221627 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f39f0037790 0x7f39f0039c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f39f8000f60 tx=0x7f39f8007b10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-19T23:48:31.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.612+0000 7f3a097fa700 1 -- 172.21.15.76:0/829221627 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182227 (secure 0 0 0) 0x7f3a0c0927b0 con 0x7f3a0c0939f0 2024-04-19T23:48:31.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.802+0000 7f3a1320b700 1 -- 172.21.15.76:0/829221627 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3a0c09cb70 con 0x7f3a0c0939f0 2024-04-19T23:48:31.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.805+0000 7f3a097fa700 1 -- 172.21.15.76:0/829221627 <== mon.0 v2:172.21.15.76:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3a00006cc0 con 0x7f3a0c0939f0 2024-04-19T23:48:31.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.805+0000 7f3a097fa700 1 -- 172.21.15.76:0/829221627 <== mon.0 v2:172.21.15.76:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3a00018350 con 0x7f3a0c0939f0 2024-04-19T23:48:31.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.807+0000 7f3a1320b700 1 -- 172.21.15.76:0/829221627 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f39f0037790 msgr2=0x7f39f0039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:48:31.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.807+0000 7f3a1320b700 1 --2- 172.21.15.76:0/829221627 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f39f0037790 0x7f39f0039c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f39f8000f60 tx=0x7f39f8007b10 comp rx=0 tx=0).stop 2024-04-19T23:48:31.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.807+0000 7f3a1320b700 1 -- 172.21.15.76:0/829221627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a0c0939f0 msgr2=0x7f3a0c1bddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-19T23:48:31.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.807+0000 7f3a1320b700 1 --2- 172.21.15.76:0/829221627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a0c0939f0 0x7f3a0c1bddb0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0950d0 tx=0x7f3a000047c0 comp rx=0 tx=0).stop 2024-04-19T23:48:31.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.807+0000 7f3a1320b700 1 -- 172.21.15.76:0/829221627 shutdown_connections 2024-04-19T23:48:31.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.807+0000 7f3a1320b700 1 --2- 172.21.15.76:0/829221627 >> [v2:172.21.15.155:6824/41459,v1:172.21.15.155:6825/41459] conn(0x7f39f0037790 0x7f39f0039c50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:48:31.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.807+0000 7f3a1320b700 1 --2- 172.21.15.76:0/829221627 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3a0c0939f0 0x7f3a0c1bddb0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-19T23:48:31.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.807+0000 7f3a1320b700 1 -- 172.21.15.76:0/829221627 >> 172.21.15.76:0/829221627 conn(0x7f3a0c099b60 msgr2=0x7f3a0c088fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-19T23:48:31.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.807+0000 7f3a1320b700 1 -- 172.21.15.76:0/829221627 shutdown_connections 2024-04-19T23:48:31.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-04-19T23:48:31.807+0000 7f3a1320b700 1 -- 172.21.15.76:0/829221627 wait complete. 2024-04-19T23:48:31.820 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-19T23:48:31.820 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-19T23:48:31.820 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-19T23:48:31.820 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T23:48:31.860 INFO:tasks.ceph.osd.0:Stopped 2024-04-19T23:48:31.860 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-19T23:48:31.860 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T23:48:31.906 INFO:tasks.ceph.osd.1:Stopped 2024-04-19T23:48:31.906 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-19T23:48:31.906 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T23:48:31.944 INFO:tasks.ceph.osd.2:Stopped 2024-04-19T23:48:31.945 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-19T23:48:31.945 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T23:48:32.011 INFO:tasks.ceph.osd.3:Stopped 2024-04-19T23:48:32.012 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-19T23:48:32.012 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-19T23:48:32.012 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T23:48:32.077 INFO:tasks.ceph.mgr.x:Stopped 2024-04-19T23:48:32.078 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-19T23:48:32.078 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-19T23:48:32.078 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T23:48:32.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-19T23:48:32.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-19T23:48:32.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-19T23:48:32.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-19T23:48:32.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-19T23:48:32.088 INFO:tasks.ceph.mon.a:Stopped 2024-04-19T23:48:32.089 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-19T23:48:32.089 DEBUG:teuthology.orchestra.run.smithi076:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-19T23:48:32.159 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi076.front.sepia.ceph.com 2024-04-19T23:48:32.159 DEBUG:teuthology.orchestra.run.smithi076:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-19T23:48:32.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-19T23:48:32.367 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-19T23:48:32.591 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-19T23:48:32.591 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-19T23:48:32.708 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-19T23:48:32.708 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-19T23:48:32.780 INFO:tasks.ceph:Archiving mon data... 2024-04-19T23:48:32.781 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048/data/mon.a.tgz 2024-04-19T23:48:32.781 DEBUG:teuthology.orchestra.run.smithi076:> mktemp 2024-04-19T23:48:32.800 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/tmp.hZLbiyrqOe 2024-04-19T23:48:32.801 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hZLbiyrqOe 2024-04-19T23:48:32.926 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0666 /tmp/tmp.hZLbiyrqOe 2024-04-19T23:48:33.013 DEBUG:teuthology.orchestra.remote:smithi076:/tmp/tmp.hZLbiyrqOe is 212KB 2024-04-19T23:48:33.106 DEBUG:teuthology.orchestra.run.smithi076:> rm -fr /tmp/tmp.hZLbiyrqOe 2024-04-19T23:48:33.123 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-19T23:48:33.123 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T23:48:33.165 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T23:48:33.197 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-19T23:48:33.198 DEBUG:teuthology.orchestra.run.smithi076:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T23:48:33.232 DEBUG:teuthology.orchestra.run.smithi155:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T23:48:33.257 INFO:teuthology.orchestra.run.smithi076.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T23:48:33.269 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T23:48:33.275 INFO:tasks.ceph:Archiving crash dumps... 2024-04-19T23:48:33.277 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048/remote/smithi076/crash 2024-04-19T23:48:33.278 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T23:48:33.330 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048/remote/smithi155/crash 2024-04-19T23:48:33.331 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T23:48:33.368 INFO:tasks.ceph:Compressing logs... 2024-04-19T23:48:33.368 DEBUG:teuthology.orchestra.run.smithi076:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T23:48:33.374 DEBUG:teuthology.orchestra.run.smithi155:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T23:48:35.689 INFO:tasks.ceph:Archiving logs... 2024-04-19T23:48:35.689 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048/remote/smithi076/log 2024-04-19T23:48:35.690 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T23:48:35.860 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048/remote/smithi155/log 2024-04-19T23:48:35.861 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T23:48:36.222 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-19T23:48:36.232 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-19T23:48:36.232 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T23:48:36.234 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T23:48:36.343 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-19T23:48:36.353 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-19T23:48:36.353 DEBUG:teuthology.orchestra.run.smithi076:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T23:48:36.356 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T23:48:36.373 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2024-04-19T23:48:36.373 INFO:teuthology.orchestra.run.smithi076.stderr:bash: ntpq: command not found 2024-04-19T23:48:36.378 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T23:48:36.378 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-04-19T23:48:36.378 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 58 +365us[ +384us] +/- 71ms 2024-04-19T23:48:36.378 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -942us[ -923us] +/- 76ms 2024-04-19T23:48:36.378 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv03.front.sepia.ceph.com 3 6 377 57 +563us[ +582us] +/- 69ms 2024-04-19T23:48:36.378 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T23:48:36.379 INFO:teuthology.orchestra.run.smithi076.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T23:48:36.379 INFO:teuthology.orchestra.run.smithi076.stdout:=============================================================================== 2024-04-19T23:48:36.379 INFO:teuthology.orchestra.run.smithi076.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 60 +369us[ +369us] +/- 71ms 2024-04-19T23:48:36.379 INFO:teuthology.orchestra.run.smithi076.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 -923us[ -923us] +/- 76ms 2024-04-19T23:48:36.379 INFO:teuthology.orchestra.run.smithi076.stdout:^* hv03.front.sepia.ceph.com 3 6 377 61 +578us[ +587us] +/- 69ms 2024-04-19T23:48:36.379 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T23:48:36.380 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-19T23:48:36.388 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-19T23:48:36.389 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-19T23:48:36.397 DEBUG:teuthology.orchestra.run.smithi076:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-19T23:48:36.487 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-19T23:48:36.548 DEBUG:teuthology.orchestra.run.smithi076:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T23:48:36.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T23:48:36.580 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T23:48:36.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T23:48:36.610 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-19T23:48:36.620 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-19T23:48:36.629 INFO:teuthology.task.internal:Duration was 809.224894 seconds 2024-04-19T23:48:36.629 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-19T23:48:36.638 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-19T23:48:36.638 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T23:48:36.641 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T23:48:36.686 INFO:teuthology.orchestra.run.smithi076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T23:48:36.696 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T23:48:36.925 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-19T23:48:36.925 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi076.front.sepia.ceph.com 2024-04-19T23:48:36.925 DEBUG:teuthology.orchestra.run.smithi076:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T23:48:36.947 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-04-19T23:48:36.947 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T23:48:36.969 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-19T23:48:36.970 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T23:48:36.990 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T23:48:37.051 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-19T23:48:37.051 DEBUG:teuthology.orchestra.run.smithi076:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T23:48:37.072 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T23:48:37.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-19T23:48:37.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-19T23:48:37.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-19T23:48:37.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-19T23:48:37.158 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-19T23:48:37.169 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-19T23:48:37.169 DEBUG:teuthology.orchestra.run.smithi076:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T23:48:37.196 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T23:48:37.223 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-19T23:48:37.233 DEBUG:teuthology.orchestra.run.smithi076:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T23:48:37.238 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T23:48:37.262 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = core 2024-04-19T23:48:37.290 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-04-19T23:48:37.318 DEBUG:teuthology.orchestra.run.smithi076:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T23:48:37.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T23:48:37.339 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T23:48:37.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T23:48:37.375 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-19T23:48:37.386 INFO:teuthology.task.internal:Transferring archived files... 2024-04-19T23:48:37.387 DEBUG:teuthology.misc:Transferring archived files from smithi076:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048/remote/smithi076 2024-04-19T23:48:37.387 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T23:48:37.425 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-19_22:40:02-rgw-reef-distro-default-smithi/7664048/remote/smithi155 2024-04-19T23:48:37.425 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T23:48:37.464 INFO:teuthology.task.internal:Removing archive directory... 2024-04-19T23:48:37.465 DEBUG:teuthology.orchestra.run.smithi076:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T23:48:37.467 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T23:48:37.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-19T23:48:37.528 INFO:teuthology.task.internal:Not uploading archives. 2024-04-19T23:48:37.528 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-19T23:48:37.538 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-19T23:48:37.538 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T23:48:37.540 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T23:48:37.555 INFO:teuthology.orchestra.run.smithi076.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 23:48 /home/ubuntu/cephtest 2024-04-19T23:48:37.573 INFO:teuthology.orchestra.run.smithi155.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 23:48 /home/ubuntu/cephtest 2024-04-19T23:48:37.575 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-19T23:48:37.585 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-19T23:48:37.608 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} duration: 809.2248940467834 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-19T23:48:37.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T23:48:37.688 INFO:teuthology.run:pass